2026-03-28 18:35:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 18:35:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 18:35:05 [auto1.de] INFO: Batch mode enabled: batch 2/2
2026-03-28 18:35:05 [auto1.de] INFO: Starting spider auto1.de
2026-03-28 18:35:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 18:35:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 18:35:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 18:35:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 18:35:05 [scrapy.extensions.telnet] INFO: Telnet Password: 0e976f1e9340f2d8
2026-03-28 18:35:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 18:35:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_18_2026-03-28T18_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 18:35:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 18:35:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 18:35:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 18:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 18:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 18:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 18:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 18:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-28 18:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 18:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 18:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 18:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 18:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 18:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 18:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 18:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-28 18:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-28 18:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 18:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 18:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 18:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 18:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 18:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 18:35:15 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 5999 | hits on page: 40
2026-03-28 18:35:15 [auto1.de] INFO: Found listing with ID: KS98119
2026-03-28 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS98119%27 HTTP/1.1" 200 None
2026-03-28 18:35:15 [auto1.de] INFO: Scrape type for KS98119: 2
2026-03-28 18:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420 with identifier: KS98119
2026-03-28 18:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420 with scrape type 2
2026-03-28 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420 with scrape type 2
2026-03-28 18:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420, identifier: KS98119
2026-03-28 18:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420 with identifier: KS98119
2026-03-28 18:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 18:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 18:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420 with identifier: KS98119
2026-03-28 18:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420 with identifier: KS98119 to the API
2026-03-28 18:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:43:51Z',
 'fuel_type': 'petrol',
 'id': 'ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS98119',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 109561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-22',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 Destination 4x2',
 'transmission': 'manual',
 'trim': 'Destination 4x2',
 'year': 2013}
2026-03-28 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS98119%27 HTTP/1.1" 200 None
2026-03-28 18:35:17 [auto1.de] INFO: Saving data for KS98119: {'auction_closing_time': 1774885431.0, 'created_time': 1774031875.311433, 'last_price_update_time': 1774722917.747511}
2026-03-28 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS98119') HTTP/1.1" 204 0
2026-03-28 18:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:17 [auto1.de] INFO: Found listing with ID: HW05295
2026-03-28 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW05295%27 HTTP/1.1" 200 None
2026-03-28 18:35:17 [auto1.de] INFO: Scrape type for HW05295: 2
2026-03-28 18:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a62b3d57-6c76-5bd4-8d11-6a222ca2ff68 with identifier: HW05295
2026-03-28 18:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a62b3d57-6c76-5bd4-8d11-6a222ca2ff68 with scrape type 2
2026-03-28 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a62b3d57-6c76-5bd4-8d11-6a222ca2ff68 with scrape type 2
2026-03-28 18:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a62b3d57-6c76-5bd4-8d11-6a222ca2ff68, identifier: HW05295
2026-03-28 18:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a62b3d57-6c76-5bd4-8d11-6a222ca2ff68 with identifier: HW05295
2026-03-28 18:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 18:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a62b3d57-6c76-5bd4-8d11-6a222ca2ff68 with identifier: HW05295
2026-03-28 18:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a62b3d57-6c76-5bd4-8d11-6a222ca2ff68 with identifier: HW05295 to the API
2026-03-28 18:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:03:41Z',
 'fuel_type': 'hybrid',
 'id': 'a62b3d57-6c76-5bd4-8d11-6a222ca2ff68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW05295',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 32867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-28',
 'seller_name': None,
 'title': 'Honda HR-V 1.5 i-MMD Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2022}
2026-03-28 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW05295%27 HTTP/1.1" 200 None
2026-03-28 18:35:18 [auto1.de] INFO: Saving data for HW05295: {'auction_closing_time': 1774883021.0, 'created_time': 1774003285.758218, 'last_price_update_time': 1774722918.770934}
2026-03-28 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW05295') HTTP/1.1" 204 0
2026-03-28 18:35:18 [auto1.de] INFO: Found listing with ID: BN60503
2026-03-28 18:35:18 [auto1.de] INFO: Found listing with ID: BG41279
2026-03-28 18:35:18 [auto1.de] INFO: Found listing with ID: DK12229
2026-03-28 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK12229%27 HTTP/1.1" 200 None
2026-03-28 18:35:18 [auto1.de] INFO: Scrape type for DK12229: 2
2026-03-28 18:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 820f7486-e6f3-568c-a1bd-be862f6302bb with identifier: DK12229
2026-03-28 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 820f7486-e6f3-568c-a1bd-be862f6302bb with scrape type 2
2026-03-28 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 820f7486-e6f3-568c-a1bd-be862f6302bb with scrape type 2
2026-03-28 18:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 820f7486-e6f3-568c-a1bd-be862f6302bb, identifier: DK12229
2026-03-28 18:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 820f7486-e6f3-568c-a1bd-be862f6302bb with identifier: DK12229
2026-03-28 18:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 820f7486-e6f3-568c-a1bd-be862f6302bb with identifier: DK12229
2026-03-28 18:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 820f7486-e6f3-568c-a1bd-be862f6302bb with identifier: DK12229 to the API
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:56Z',
 'fuel_type': 'diesel',
 'id': '820f7486-e6f3-568c-a1bd-be862f6302bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK12229',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 119133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Lounge Sport & Style 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Lounge Sport & Style 4Motion BlueMotion',
 'year': 2015}
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK12229%27 HTTP/1.1" 200 None
2026-03-28 18:35:19 [auto1.de] INFO: Saving data for DK12229: {'auction_closing_time': 1774884176.0, 'created_time': 1773381497.085018, 'last_price_update_time': 1774722919.498998}
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK12229') HTTP/1.1" 204 0
2026-03-28 18:35:19 [auto1.de] INFO: Found listing with ID: ND89828
2026-03-28 18:35:19 [auto1.de] INFO: Found listing with ID: YB47390
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47390%27 HTTP/1.1" 200 None
2026-03-28 18:35:19 [auto1.de] INFO: Scrape type for YB47390: 2
2026-03-28 18:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e574adbe-c877-5974-90f2-095ae8626b1e with identifier: YB47390
2026-03-28 18:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e574adbe-c877-5974-90f2-095ae8626b1e with scrape type 2
2026-03-28 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e574adbe-c877-5974-90f2-095ae8626b1e with scrape type 2
2026-03-28 18:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e574adbe-c877-5974-90f2-095ae8626b1e, identifier: YB47390
2026-03-28 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e574adbe-c877-5974-90f2-095ae8626b1e with identifier: YB47390
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e574adbe-c877-5974-90f2-095ae8626b1e with identifier: YB47390
2026-03-28 18:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e574adbe-c877-5974-90f2-095ae8626b1e with identifier: YB47390 to the API
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:02:31Z',
 'fuel_type': 'petrol',
 'id': 'e574adbe-c877-5974-90f2-095ae8626b1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB47390',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 203052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47390%27 HTTP/1.1" 200 None
2026-03-28 18:35:20 [auto1.de] INFO: Saving data for YB47390: {'auction_closing_time': 1774882951.0, 'created_time': 1774033307.244952, 'last_price_update_time': 1774722920.080704}
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB47390') HTTP/1.1" 204 0
2026-03-28 18:35:20 [auto1.de] INFO: Found listing with ID: VX00455
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX00455%27 HTTP/1.1" 200 None
2026-03-28 18:35:20 [auto1.de] INFO: Scrape type for VX00455: 2
2026-03-28 18:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1 with identifier: VX00455
2026-03-28 18:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1 with scrape type 2
2026-03-28 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1 with scrape type 2
2026-03-28 18:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1, identifier: VX00455
2026-03-28 18:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1 with identifier: VX00455
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 18:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1 with identifier: VX00455
2026-03-28 18:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1 with identifier: VX00455 to the API
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:12:38Z',
 'fuel_type': 'petrol',
 'id': 'bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX00455',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 85341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-15',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2005}
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX00455%27 HTTP/1.1" 200 None
2026-03-28 18:35:20 [auto1.de] INFO: Saving data for VX00455: {'auction_closing_time': 1774883558.0, 'created_time': 1774033544.186554, 'last_price_update_time': 1774722920.601729}
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX00455') HTTP/1.1" 204 0
2026-03-28 18:35:20 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW07399%27 HTTP/1.1" 200 None
2026-03-28 18:35:20 [auto1.de] INFO: Scrape type for VW07399: 1
2026-03-28 18:35:20 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ67140%27 HTTP/1.1" 200 None
2026-03-28 18:35:20 [auto1.de] INFO: Scrape type for SZ67140: 2
2026-03-28 18:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca144f1c-4a0a-5d87-a449-18bc4f514b23 with identifier: SZ67140
2026-03-28 18:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca144f1c-4a0a-5d87-a449-18bc4f514b23 with scrape type 2
2026-03-28 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca144f1c-4a0a-5d87-a449-18bc4f514b23 with scrape type 2
2026-03-28 18:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca144f1c-4a0a-5d87-a449-18bc4f514b23, identifier: SZ67140
2026-03-28 18:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca144f1c-4a0a-5d87-a449-18bc4f514b23 with identifier: SZ67140
2026-03-28 18:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca144f1c-4a0a-5d87-a449-18bc4f514b23 with identifier: SZ67140
2026-03-28 18:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca144f1c-4a0a-5d87-a449-18bc4f514b23 with identifier: SZ67140 to the API
2026-03-28 18:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:22:53Z',
 'fuel_type': 'petrol',
 'id': 'ca144f1c-4a0a-5d87-a449-18bc4f514b23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ67140',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 47883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ67140%27 HTTP/1.1" 200 None
2026-03-28 18:35:21 [auto1.de] INFO: Saving data for SZ67140: {'auction_closing_time': 1774884173.0, 'created_time': 1774034677.566655, 'last_price_update_time': 1774722921.109915}
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ67140') HTTP/1.1" 204 0
2026-03-28 18:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:21 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-28 18:35:21 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT40242%27 HTTP/1.1" 200 None
2026-03-28 18:35:21 [auto1.de] INFO: Scrape type for HT40242: 2
2026-03-28 18:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541cd21e-efad-57ff-965e-bf3d0dde4fed with identifier: HT40242
2026-03-28 18:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541cd21e-efad-57ff-965e-bf3d0dde4fed with scrape type 2
2026-03-28 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 541cd21e-efad-57ff-965e-bf3d0dde4fed with scrape type 2
2026-03-28 18:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 541cd21e-efad-57ff-965e-bf3d0dde4fed, identifier: HT40242
2026-03-28 18:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 541cd21e-efad-57ff-965e-bf3d0dde4fed with identifier: HT40242
2026-03-28 18:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 541cd21e-efad-57ff-965e-bf3d0dde4fed with identifier: HT40242
2026-03-28 18:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 541cd21e-efad-57ff-965e-bf3d0dde4fed with identifier: HT40242 to the API
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-30T15:14:44Z',
 'fuel_type': 'petrol',
 'id': '541cd21e-efad-57ff-965e-bf3d0dde4fed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT40242',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 126891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-04',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0-VVT-i X-Play Connect',
 'transmission': 'manual',
 'trim': 'X-Play Connect',
 'year': 2018}
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT40242%27 HTTP/1.1" 200 None
2026-03-28 18:35:21 [auto1.de] INFO: Saving data for HT40242: {'auction_closing_time': 1774883684.0, 'created_time': 1774350822.15705, 'last_price_update_time': 1774722921.56928}
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT40242') HTTP/1.1" 204 0
2026-03-28 18:35:21 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-28 18:35:21 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-28 18:35:21 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-28 18:35:21 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC96507%27 HTTP/1.1" 200 None
2026-03-28 18:35:21 [auto1.de] INFO: Scrape type for AC96507: 2
2026-03-28 18:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e14343e3-ac3c-5b95-8ffc-3018fb6081dd with identifier: AC96507
2026-03-28 18:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e14343e3-ac3c-5b95-8ffc-3018fb6081dd with scrape type 2
2026-03-28 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e14343e3-ac3c-5b95-8ffc-3018fb6081dd with scrape type 2
2026-03-28 18:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e14343e3-ac3c-5b95-8ffc-3018fb6081dd, identifier: AC96507
2026-03-28 18:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e14343e3-ac3c-5b95-8ffc-3018fb6081dd with identifier: AC96507
2026-03-28 18:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e14343e3-ac3c-5b95-8ffc-3018fb6081dd with identifier: AC96507
2026-03-28 18:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e14343e3-ac3c-5b95-8ffc-3018fb6081dd with identifier: AC96507 to the API
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:24:47Z',
 'fuel_type': 'petrol',
 'id': 'e14343e3-ac3c-5b95-8ffc-3018fb6081dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC96507',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Bayon',
 'odometer': 79806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': None,
 'title': 'Hyundai Bayon 1.0 TGDI Intro Edition 2WD',
 'transmission': 'manual',
 'trim': 'Intro Edition 2WD',
 'year': 2022}
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC96507%27 HTTP/1.1" 200 None
2026-03-28 18:35:22 [auto1.de] INFO: Saving data for AC96507: {'auction_closing_time': 1774884287.0, 'created_time': 1773341258.079326, 'last_price_update_time': 1774722922.095007}
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC96507') HTTP/1.1" 204 0
2026-03-28 18:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:22 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS65782%27 HTTP/1.1" 200 None
2026-03-28 18:35:22 [auto1.de] INFO: Scrape type for YS65782: 2
2026-03-28 18:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d99ae1bc-2440-504e-9516-fb1e880c2748 with identifier: YS65782
2026-03-28 18:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99ae1bc-2440-504e-9516-fb1e880c2748 with scrape type 2
2026-03-28 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d99ae1bc-2440-504e-9516-fb1e880c2748 with scrape type 2
2026-03-28 18:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d99ae1bc-2440-504e-9516-fb1e880c2748, identifier: YS65782
2026-03-28 18:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d99ae1bc-2440-504e-9516-fb1e880c2748 with identifier: YS65782
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 18:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d99ae1bc-2440-504e-9516-fb1e880c2748 with identifier: YS65782
2026-03-28 18:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d99ae1bc-2440-504e-9516-fb1e880c2748 with identifier: YS65782 to the API
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:28:01Z',
 'fuel_type': 'petrol',
 'id': 'd99ae1bc-2440-504e-9516-fb1e880c2748',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS65782',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Lancer',
 'odometer': 266427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-19',
 'seller_name': None,
 'title': 'Mitsubishi Lancer 1.8 DOHC Intense',
 'transmission': 'automatic',
 'trim': 'Intense',
 'year': 2009}
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS65782%27 HTTP/1.1" 200 None
2026-03-28 18:35:22 [auto1.de] INFO: Saving data for YS65782: {'auction_closing_time': 1774884481.0, 'created_time': 1774118663.785543, 'last_price_update_time': 1774722922.859323}
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS65782') HTTP/1.1" 204 0
2026-03-28 18:35:22 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-28 18:35:22 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-28 18:35:22 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40023%27 HTTP/1.1" 200 None
2026-03-28 18:35:22 [auto1.de] INFO: Scrape type for ZU40023: 2
2026-03-28 18:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8069ed36-6f78-5211-bf0a-1362cc5e62c1 with identifier: ZU40023
2026-03-28 18:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8069ed36-6f78-5211-bf0a-1362cc5e62c1 with scrape type 2
2026-03-28 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8069ed36-6f78-5211-bf0a-1362cc5e62c1 with scrape type 2
2026-03-28 18:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8069ed36-6f78-5211-bf0a-1362cc5e62c1, identifier: ZU40023
2026-03-28 18:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8069ed36-6f78-5211-bf0a-1362cc5e62c1 with identifier: ZU40023
2026-03-28 18:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8069ed36-6f78-5211-bf0a-1362cc5e62c1 with identifier: ZU40023
2026-03-28 18:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8069ed36-6f78-5211-bf0a-1362cc5e62c1 with identifier: ZU40023 to the API
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:15:06Z',
 'fuel_type': 'diesel',
 'id': '8069ed36-6f78-5211-bf0a-1362cc5e62c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU40023',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 33615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40023%27 HTTP/1.1" 200 None
2026-03-28 18:35:23 [auto1.de] INFO: Saving data for ZU40023: {'auction_closing_time': 1774883706.0, 'created_time': 1774034979.068991, 'last_price_update_time': 1774722923.318905}
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU40023') HTTP/1.1" 204 0
2026-03-28 18:35:23 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-28 18:35:23 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE55813%27 HTTP/1.1" 200 None
2026-03-28 18:35:23 [auto1.de] INFO: Scrape type for PE55813: 0
2026-03-28 18:35:23 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-28 18:35:23 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-28 18:35:23 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-28 18:35:23 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-28 18:35:23 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-28 18:35:23 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY96814%27 HTTP/1.1" 200 None
2026-03-28 18:35:23 [auto1.de] INFO: Scrape type for AY96814: 2
2026-03-28 18:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd600ef-6ecf-5883-ab91-ff48320495e2 with identifier: AY96814
2026-03-28 18:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd600ef-6ecf-5883-ab91-ff48320495e2 with scrape type 2
2026-03-28 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fd600ef-6ecf-5883-ab91-ff48320495e2 with scrape type 2
2026-03-28 18:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fd600ef-6ecf-5883-ab91-ff48320495e2, identifier: AY96814
2026-03-28 18:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fd600ef-6ecf-5883-ab91-ff48320495e2 with identifier: AY96814
2026-03-28 18:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fd600ef-6ecf-5883-ab91-ff48320495e2 with identifier: AY96814
2026-03-28 18:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fd600ef-6ecf-5883-ab91-ff48320495e2 with identifier: AY96814 to the API
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:10:37Z',
 'fuel_type': 'petrol',
 'id': '5fd600ef-6ecf-5883-ab91-ff48320495e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY96814',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 144434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-28',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2006}
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY96814%27 HTTP/1.1" 200 None
2026-03-28 18:35:23 [auto1.de] INFO: Saving data for AY96814: {'auction_closing_time': 1774883437.0, 'created_time': 1773305293.202306, 'last_price_update_time': 1774722923.775712}
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY96814') HTTP/1.1" 204 0
2026-03-28 18:35:23 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 5999 | hits on page: 40
2026-03-28 18:35:23 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-28 18:35:23 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-28 18:35:23 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-28 18:35:23 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT29857%27 HTTP/1.1" 200 None
2026-03-28 18:35:23 [auto1.de] INFO: Scrape type for PT29857: 2
2026-03-28 18:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6c1f861-41f0-5ee5-95ab-02982fcb771e with identifier: PT29857
2026-03-28 18:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c1f861-41f0-5ee5-95ab-02982fcb771e with scrape type 2
2026-03-28 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6c1f861-41f0-5ee5-95ab-02982fcb771e with scrape type 2
2026-03-28 18:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6c1f861-41f0-5ee5-95ab-02982fcb771e, identifier: PT29857
2026-03-28 18:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6c1f861-41f0-5ee5-95ab-02982fcb771e with identifier: PT29857
2026-03-28 18:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6c1f861-41f0-5ee5-95ab-02982fcb771e with identifier: PT29857
2026-03-28 18:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6c1f861-41f0-5ee5-95ab-02982fcb771e with identifier: PT29857 to the API
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:59:41Z',
 'fuel_type': 'petrol',
 'id': 'f6c1f861-41f0-5ee5-95ab-02982fcb771e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT29857',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 202857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-28',
 'seller_name': None,
 'title': 'Audi A4 1.8 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT29857%27 HTTP/1.1" 200 None
2026-03-28 18:35:24 [auto1.de] INFO: Saving data for PT29857: {'auction_closing_time': 1774886381.0, 'created_time': 1774118888.600873, 'last_price_update_time': 1774722924.312421}
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT29857') HTTP/1.1" 204 0
2026-03-28 18:35:24 [auto1.de] INFO: Found listing with ID: KS98119
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS98119%27 HTTP/1.1" 200 None
2026-03-28 18:35:24 [auto1.de] INFO: Scrape type for KS98119: 0
2026-03-28 18:35:24 [auto1.de] INFO: Found listing with ID: HW05295
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW05295%27 HTTP/1.1" 200 None
2026-03-28 18:35:24 [auto1.de] INFO: Scrape type for HW05295: 0
2026-03-28 18:35:24 [auto1.de] INFO: Found listing with ID: BN60503
2026-03-28 18:35:24 [auto1.de] INFO: Found listing with ID: BG41279
2026-03-28 18:35:24 [auto1.de] INFO: Found listing with ID: DK12229
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK12229%27 HTTP/1.1" 200 None
2026-03-28 18:35:24 [auto1.de] INFO: Scrape type for DK12229: 0
2026-03-28 18:35:24 [auto1.de] INFO: Found listing with ID: ND89828
2026-03-28 18:35:24 [auto1.de] INFO: Found listing with ID: YB47390
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47390%27 HTTP/1.1" 200 None
2026-03-28 18:35:24 [auto1.de] INFO: Scrape type for YB47390: 0
2026-03-28 18:35:24 [auto1.de] INFO: Found listing with ID: VX00455
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX00455%27 HTTP/1.1" 200 None
2026-03-28 18:35:24 [auto1.de] INFO: Scrape type for VX00455: 0
2026-03-28 18:35:24 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-28 18:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:24 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-28 18:35:24 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-28 18:35:24 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA25791%27 HTTP/1.1" 200 None
2026-03-28 18:35:24 [auto1.de] INFO: Scrape type for WA25791: 2
2026-03-28 18:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e0f0cb-5794-56ad-a202-36fbe06a8ead with identifier: WA25791
2026-03-28 18:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e0f0cb-5794-56ad-a202-36fbe06a8ead with scrape type 2
2026-03-28 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68e0f0cb-5794-56ad-a202-36fbe06a8ead with scrape type 2
2026-03-28 18:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68e0f0cb-5794-56ad-a202-36fbe06a8ead, identifier: WA25791
2026-03-28 18:35:24 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/VW07399/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 18:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68e0f0cb-5794-56ad-a202-36fbe06a8ead with identifier: WA25791
2026-03-28 18:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68e0f0cb-5794-56ad-a202-36fbe06a8ead with identifier: WA25791
2026-03-28 18:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68e0f0cb-5794-56ad-a202-36fbe06a8ead with identifier: WA25791 to the API
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:32Z',
 'fuel_type': 'petrol',
 'id': '68e0f0cb-5794-56ad-a202-36fbe06a8ead',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA25791',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 81679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-27',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA25791%27 HTTP/1.1" 200 None
2026-03-28 18:35:24 [auto1.de] INFO: Saving data for WA25791: {'auction_closing_time': 1774883732.0, 'created_time': 1774089697.001036, 'last_price_update_time': 1774722924.974218}
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA25791') HTTP/1.1" 204 0
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ67140%27 HTTP/1.1" 200 None
2026-03-28 18:35:25 [auto1.de] INFO: Scrape type for SZ67140: 0
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT40242%27 HTTP/1.1" 200 None
2026-03-28 18:35:25 [auto1.de] INFO: Scrape type for HT40242: 0
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC96507%27 HTTP/1.1" 200 None
2026-03-28 18:35:25 [auto1.de] INFO: Scrape type for AC96507: 0
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS65782%27 HTTP/1.1" 200 None
2026-03-28 18:35:25 [auto1.de] INFO: Scrape type for YS65782: 0
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40023%27 HTTP/1.1" 200 None
2026-03-28 18:35:25 [auto1.de] INFO: Scrape type for ZU40023: 0
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE55813%27 HTTP/1.1" 200 None
2026-03-28 18:35:25 [auto1.de] INFO: Scrape type for PE55813: 0
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY96814%27 HTTP/1.1" 200 None
2026-03-28 18:35:25 [auto1.de] INFO: Scrape type for AY96814: 0
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT29857%27 HTTP/1.1" 200 None
2026-03-28 18:35:25 [auto1.de] INFO: Scrape type for PT29857: 0
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA25791%27 HTTP/1.1" 200 None
2026-03-28 18:35:25 [auto1.de] INFO: Scrape type for WA25791: 0
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN99770%27 HTTP/1.1" 200 None
2026-03-28 18:35:25 [auto1.de] INFO: Scrape type for LN99770: 2
2026-03-28 18:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8c753a4-038b-59b2-a066-d050d99b5419 with identifier: LN99770
2026-03-28 18:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c753a4-038b-59b2-a066-d050d99b5419 with scrape type 2
2026-03-28 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8c753a4-038b-59b2-a066-d050d99b5419 with scrape type 2
2026-03-28 18:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8c753a4-038b-59b2-a066-d050d99b5419, identifier: LN99770
2026-03-28 18:35:25 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN99770%27 HTTP/1.1" 200 None
2026-03-28 18:35:25 [auto1.de] INFO: Scrape type for LN99770: 2
2026-03-28 18:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c753a4-038b-59b2-a066-d050d99b5419 with scrape type 2
2026-03-28 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8c753a4-038b-59b2-a066-d050d99b5419 with scrape type 2
2026-03-28 18:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8c753a4-038b-59b2-a066-d050d99b5419, identifier: LN99770
2026-03-28 18:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8c753a4-038b-59b2-a066-d050d99b5419 with identifier: LN99770
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 18:35:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8c753a4-038b-59b2-a066-d050d99b5419 with identifier: LN99770
2026-03-28 18:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8c753a4-038b-59b2-a066-d050d99b5419 with identifier: LN99770 to the API
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:17Z',
 'fuel_type': 'diesel',
 'id': 'c8c753a4-038b-59b2-a066-d050d99b5419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN99770',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 94317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-01',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN99770%27 HTTP/1.1" 200 None
2026-03-28 18:35:25 [auto1.de] INFO: Saving data for LN99770: {'auction_closing_time': 1774885277.0, 'created_time': 1774350053.46097, 'last_price_update_time': 1774722925.9463}
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN99770') HTTP/1.1" 204 0
2026-03-28 18:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW07399/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8c753a4-038b-59b2-a066-d050d99b5419 with identifier: LN99770
2026-03-28 18:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8c753a4-038b-59b2-a066-d050d99b5419 with identifier: LN99770
2026-03-28 18:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8c753a4-038b-59b2-a066-d050d99b5419 with identifier: LN99770 to the API
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:17Z',
 'fuel_type': 'diesel',
 'id': 'c8c753a4-038b-59b2-a066-d050d99b5419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN99770',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 94317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-01',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN99770%27 HTTP/1.1" 200 None
2026-03-28 18:35:26 [auto1.de] INFO: Saving data for LN99770: {'auction_closing_time': 1774885277.0, 'created_time': 1774350053.46097, 'last_price_update_time': 1774722926.349647}
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN99770') HTTP/1.1" 204 0
2026-03-28 18:35:26 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK17990%27 HTTP/1.1" 200 None
2026-03-28 18:35:26 [auto1.de] INFO: Scrape type for NK17990: 2
2026-03-28 18:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1f83260-43d5-5574-a4fa-6b450a2b209e with identifier: NK17990
2026-03-28 18:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1f83260-43d5-5574-a4fa-6b450a2b209e with scrape type 2
2026-03-28 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1f83260-43d5-5574-a4fa-6b450a2b209e with scrape type 2
2026-03-28 18:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1f83260-43d5-5574-a4fa-6b450a2b209e, identifier: NK17990
2026-03-28 18:35:26 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK17990%27 HTTP/1.1" 200 None
2026-03-28 18:35:26 [auto1.de] INFO: Scrape type for NK17990: 2
2026-03-28 18:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1f83260-43d5-5574-a4fa-6b450a2b209e with scrape type 2
2026-03-28 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1f83260-43d5-5574-a4fa-6b450a2b209e with scrape type 2
2026-03-28 18:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1f83260-43d5-5574-a4fa-6b450a2b209e, identifier: NK17990
2026-03-28 18:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1f83260-43d5-5574-a4fa-6b450a2b209e with identifier: NK17990
2026-03-28 18:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1f83260-43d5-5574-a4fa-6b450a2b209e with identifier: NK17990
2026-03-28 18:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1f83260-43d5-5574-a4fa-6b450a2b209e with identifier: NK17990 to the API
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:41Z',
 'fuel_type': 'petrol',
 'id': 'e1f83260-43d5-5574-a4fa-6b450a2b209e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK17990',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 104324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-11',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'automatic',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK17990%27 HTTP/1.1" 200 None
2026-03-28 18:35:26 [auto1.de] INFO: Saving data for NK17990: {'auction_closing_time': 1774883981.0, 'created_time': 1774031835.568954, 'last_price_update_time': 1774722926.917158}
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK17990') HTTP/1.1" 204 0
2026-03-28 18:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1f83260-43d5-5574-a4fa-6b450a2b209e with identifier: NK17990
2026-03-28 18:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1f83260-43d5-5574-a4fa-6b450a2b209e with identifier: NK17990
2026-03-28 18:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1f83260-43d5-5574-a4fa-6b450a2b209e with identifier: NK17990 to the API
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:41Z',
 'fuel_type': 'petrol',
 'id': 'e1f83260-43d5-5574-a4fa-6b450a2b209e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK17990',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 104324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-11',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'automatic',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK17990%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Saving data for NK17990: {'auction_closing_time': 1774883981.0, 'created_time': 1774031835.568954, 'last_price_update_time': 1774722927.246443}
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK17990') HTTP/1.1" 204 0
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY43451%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Scrape type for CY43451: 1
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX96561%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Scrape type for ZX96561: 2
2026-03-28 18:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82935d13-c601-511d-afeb-cc596b21a7b2 with identifier: ZX96561
2026-03-28 18:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82935d13-c601-511d-afeb-cc596b21a7b2 with scrape type 2
2026-03-28 18:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82935d13-c601-511d-afeb-cc596b21a7b2 with scrape type 2
2026-03-28 18:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82935d13-c601-511d-afeb-cc596b21a7b2, identifier: ZX96561
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX96561%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Scrape type for ZX96561: 2
2026-03-28 18:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82935d13-c601-511d-afeb-cc596b21a7b2 with scrape type 2
2026-03-28 18:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82935d13-c601-511d-afeb-cc596b21a7b2 with scrape type 2
2026-03-28 18:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82935d13-c601-511d-afeb-cc596b21a7b2, identifier: ZX96561
2026-03-28 18:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82935d13-c601-511d-afeb-cc596b21a7b2 with identifier: ZX96561
2026-03-28 18:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82935d13-c601-511d-afeb-cc596b21a7b2 with identifier: ZX96561
2026-03-28 18:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82935d13-c601-511d-afeb-cc596b21a7b2 with identifier: ZX96561 to the API
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:05:15Z',
 'fuel_type': 'petrol',
 'id': '82935d13-c601-511d-afeb-cc596b21a7b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX96561',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 114680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-21',
 'seller_name': None,
 'title': 'Honda Civic 1.4 DSi Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2008}
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX96561%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Saving data for ZX96561: {'auction_closing_time': 1774883115.0, 'created_time': 1774033878.718627, 'last_price_update_time': 1774722927.808547}
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX96561') HTTP/1.1" 204 0
2026-03-28 18:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82935d13-c601-511d-afeb-cc596b21a7b2 with identifier: ZX96561
2026-03-28 18:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82935d13-c601-511d-afeb-cc596b21a7b2 with identifier: ZX96561
2026-03-28 18:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82935d13-c601-511d-afeb-cc596b21a7b2 with identifier: ZX96561 to the API
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:05:15Z',
 'fuel_type': 'petrol',
 'id': '82935d13-c601-511d-afeb-cc596b21a7b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX96561',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 114680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-21',
 'seller_name': None,
 'title': 'Honda Civic 1.4 DSi Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2008}
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX96561%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Saving data for ZX96561: {'auction_closing_time': 1774883115.0, 'created_time': 1774033878.718627, 'last_price_update_time': 1774722928.12911}
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX96561') HTTP/1.1" 204 0
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX79709%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Scrape type for LX79709: 2
2026-03-28 18:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb6c23cf-ba3b-5a46-adc1-0e4791931deb with identifier: LX79709
2026-03-28 18:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb6c23cf-ba3b-5a46-adc1-0e4791931deb with scrape type 2
2026-03-28 18:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb6c23cf-ba3b-5a46-adc1-0e4791931deb with scrape type 2
2026-03-28 18:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb6c23cf-ba3b-5a46-adc1-0e4791931deb, identifier: LX79709
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX79709%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Scrape type for LX79709: 2
2026-03-28 18:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb6c23cf-ba3b-5a46-adc1-0e4791931deb with scrape type 2
2026-03-28 18:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb6c23cf-ba3b-5a46-adc1-0e4791931deb with scrape type 2
2026-03-28 18:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb6c23cf-ba3b-5a46-adc1-0e4791931deb, identifier: LX79709
2026-03-28 18:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb6c23cf-ba3b-5a46-adc1-0e4791931deb with identifier: LX79709
2026-03-28 18:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb6c23cf-ba3b-5a46-adc1-0e4791931deb with identifier: LX79709
2026-03-28 18:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb6c23cf-ba3b-5a46-adc1-0e4791931deb with identifier: LX79709 to the API
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:13:02Z',
 'fuel_type': 'diesel',
 'id': 'bb6c23cf-ba3b-5a46-adc1-0e4791931deb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX79709',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 381825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-31',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Match BlueMotion',
 'transmission': 'automatic',
 'trim': 'Match BlueMotion',
 'year': 2013}
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX79709%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Saving data for LX79709: {'auction_closing_time': 1774883582.0, 'created_time': 1774034104.510288, 'last_price_update_time': 1774722928.694509}
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX79709') HTTP/1.1" 204 0
2026-03-28 18:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb6c23cf-ba3b-5a46-adc1-0e4791931deb with identifier: LX79709
2026-03-28 18:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb6c23cf-ba3b-5a46-adc1-0e4791931deb with identifier: LX79709
2026-03-28 18:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb6c23cf-ba3b-5a46-adc1-0e4791931deb with identifier: LX79709 to the API
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:13:02Z',
 'fuel_type': 'diesel',
 'id': 'bb6c23cf-ba3b-5a46-adc1-0e4791931deb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX79709',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 381825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-31',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Match BlueMotion',
 'transmission': 'automatic',
 'trim': 'Match BlueMotion',
 'year': 2013}
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX79709%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Saving data for LX79709: {'auction_closing_time': 1774883582.0, 'created_time': 1774034104.510288, 'last_price_update_time': 1774722928.980259}
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX79709') HTTP/1.1" 204 0
2026-03-28 18:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY43451/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:29 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:29 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-28 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX79709%27 HTTP/1.1" 200 None
2026-03-28 18:35:29 [auto1.de] INFO: Scrape type for LX79709: 0
2026-03-28 18:35:29 [auto1.de] INFO: Found listing with ID: KC50640
2026-03-28 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC50640%27 HTTP/1.1" 200 None
2026-03-28 18:35:29 [auto1.de] INFO: Scrape type for KC50640: 2
2026-03-28 18:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14283376-e4a1-531b-9e42-8c7ba6fc502f with identifier: KC50640
2026-03-28 18:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14283376-e4a1-531b-9e42-8c7ba6fc502f with scrape type 2
2026-03-28 18:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14283376-e4a1-531b-9e42-8c7ba6fc502f with scrape type 2
2026-03-28 18:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14283376-e4a1-531b-9e42-8c7ba6fc502f, identifier: KC50640
2026-03-28 18:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14283376-e4a1-531b-9e42-8c7ba6fc502f with identifier: KC50640
2026-03-28 18:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14283376-e4a1-531b-9e42-8c7ba6fc502f with identifier: KC50640
2026-03-28 18:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14283376-e4a1-531b-9e42-8c7ba6fc502f with identifier: KC50640 to the API
2026-03-28 18:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:07:43Z',
 'fuel_type': 'diesel',
 'id': '14283376-e4a1-531b-9e42-8c7ba6fc502f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC50640',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 221452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-17',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2016}
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC50640%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Saving data for KC50640: {'auction_closing_time': 1774883263.0, 'created_time': 1774032327.744975, 'last_price_update_time': 1774722930.197229}
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC50640') HTTP/1.1" 204 0
2026-03-28 18:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: VR60747
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR60747%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for VR60747: 2
2026-03-28 18:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04167ce4-9513-5dba-9969-eeebeda8f5bf with identifier: VR60747
2026-03-28 18:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04167ce4-9513-5dba-9969-eeebeda8f5bf with scrape type 2
2026-03-28 18:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04167ce4-9513-5dba-9969-eeebeda8f5bf with scrape type 2
2026-03-28 18:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04167ce4-9513-5dba-9969-eeebeda8f5bf, identifier: VR60747
2026-03-28 18:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04167ce4-9513-5dba-9969-eeebeda8f5bf with identifier: VR60747
2026-03-28 18:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04167ce4-9513-5dba-9969-eeebeda8f5bf with identifier: VR60747
2026-03-28 18:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04167ce4-9513-5dba-9969-eeebeda8f5bf with identifier: VR60747 to the API
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:04Z',
 'fuel_type': 'diesel',
 'id': '04167ce4-9513-5dba-9969-eeebeda8f5bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR60747',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 136187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-29',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR60747%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Saving data for VR60747: {'auction_closing_time': 1774884604.0, 'created_time': 1773383487.567235, 'last_price_update_time': 1774722930.680572}
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR60747') HTTP/1.1" 204 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: SZ06147
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ06147%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for SZ06147: 2
2026-03-28 18:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a with identifier: SZ06147
2026-03-28 18:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a with scrape type 2
2026-03-28 18:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a with scrape type 2
2026-03-28 18:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a, identifier: SZ06147
2026-03-28 18:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a with identifier: SZ06147
2026-03-28 18:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a with identifier: SZ06147
2026-03-28 18:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a with identifier: SZ06147 to the API
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:10:12Z',
 'fuel_type': 'diesel',
 'id': '4a63b3f8-a051-5fb6-9ec7-d265e880ec4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ06147',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 93556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-03',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 JTD 130',
 'transmission': 'manual',
 'trim': '130',
 'year': 2014}
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ06147%27 HTTP/1.1" 200 None
2026-03-28 18:35:31 [auto1.de] INFO: Saving data for SZ06147: {'auction_closing_time': 1774883412.0, 'created_time': 1773383236.134235, 'last_price_update_time': 1774722931.464218}
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ06147') HTTP/1.1" 204 0
2026-03-28 18:35:31 [auto1.de] INFO: Found listing with ID: CW95568
2026-03-28 18:35:31 [auto1.de] INFO: Found listing with ID: NV70278
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV70278%27 HTTP/1.1" 200 None
2026-03-28 18:35:31 [auto1.de] INFO: Scrape type for NV70278: 2
2026-03-28 18:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 742b7ad3-9a4c-57a5-a8d1-3516c96f386c with identifier: NV70278
2026-03-28 18:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 742b7ad3-9a4c-57a5-a8d1-3516c96f386c with scrape type 2
2026-03-28 18:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 742b7ad3-9a4c-57a5-a8d1-3516c96f386c with scrape type 2
2026-03-28 18:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 742b7ad3-9a4c-57a5-a8d1-3516c96f386c, identifier: NV70278
2026-03-28 18:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW07399> (referer: https://www.auto1.com/v1/car-details-view/VW07399/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 742b7ad3-9a4c-57a5-a8d1-3516c96f386c with identifier: NV70278
2026-03-28 18:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 742b7ad3-9a4c-57a5-a8d1-3516c96f386c with identifier: NV70278
2026-03-28 18:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 742b7ad3-9a4c-57a5-a8d1-3516c96f386c with identifier: NV70278 to the API
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:29:53Z',
 'fuel_type': 'diesel',
 'id': '742b7ad3-9a4c-57a5-a8d1-3516c96f386c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV70278',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 241637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-09',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 CDI BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2013}
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV70278%27 HTTP/1.1" 200 None
2026-03-28 18:35:32 [auto1.de] INFO: Saving data for NV70278: {'auction_closing_time': 1774884593.0, 'created_time': 1774350274.231879, 'last_price_update_time': 1774722932.019355}
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV70278') HTTP/1.1" 204 0
2026-03-28 18:35:32 [auto1.de] INFO: Found listing with ID: ZL59344
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL59344%27 HTTP/1.1" 200 None
2026-03-28 18:35:32 [auto1.de] INFO: Scrape type for ZL59344: 2
2026-03-28 18:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ff85131-00d4-5279-8b97-f28c34485a13 with identifier: ZL59344
2026-03-28 18:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ff85131-00d4-5279-8b97-f28c34485a13 with scrape type 2
2026-03-28 18:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ff85131-00d4-5279-8b97-f28c34485a13 with scrape type 2
2026-03-28 18:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ff85131-00d4-5279-8b97-f28c34485a13, identifier: ZL59344
2026-03-28 18:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ff85131-00d4-5279-8b97-f28c34485a13 with identifier: ZL59344
2026-03-28 18:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ff85131-00d4-5279-8b97-f28c34485a13 with identifier: ZL59344
2026-03-28 18:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ff85131-00d4-5279-8b97-f28c34485a13 with identifier: ZL59344 to the API
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:12:44Z',
 'fuel_type': 'diesel',
 'id': '9ff85131-00d4-5279-8b97-f28c34485a13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL59344',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 55605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-12',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL59344%27 HTTP/1.1" 200 None
2026-03-28 18:35:32 [auto1.de] INFO: Saving data for ZL59344: {'auction_closing_time': 1774883564.0, 'created_time': 1773306251.274197, 'last_price_update_time': 1774722932.463741}
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL59344') HTTP/1.1" 204 0
2026-03-28 18:35:32 [auto1.de] INFO: Found listing with ID: GD26044
2026-03-28 18:35:32 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-28 18:35:32 [auto1.de] INFO: Found listing with ID: NH06338
2026-03-28 18:35:32 [auto1.de] INFO: Found listing with ID: DS59005
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59005%27 HTTP/1.1" 200 None
2026-03-28 18:35:32 [auto1.de] INFO: Scrape type for DS59005: 2
2026-03-28 18:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a24ad860-2529-5a91-b5e6-d2722b200446 with identifier: DS59005
2026-03-28 18:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a24ad860-2529-5a91-b5e6-d2722b200446 with scrape type 2
2026-03-28 18:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a24ad860-2529-5a91-b5e6-d2722b200446 with scrape type 2
2026-03-28 18:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a24ad860-2529-5a91-b5e6-d2722b200446, identifier: DS59005
2026-03-28 18:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a24ad860-2529-5a91-b5e6-d2722b200446 with identifier: DS59005
2026-03-28 18:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a24ad860-2529-5a91-b5e6-d2722b200446 with identifier: DS59005
2026-03-28 18:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a24ad860-2529-5a91-b5e6-d2722b200446 with identifier: DS59005 to the API
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:32:13Z',
 'fuel_type': 'diesel',
 'id': 'a24ad860-2529-5a91-b5e6-d2722b200446',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS59005',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 246444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-20',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2015}
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59005%27 HTTP/1.1" 200 None
2026-03-28 18:35:32 [auto1.de] INFO: Saving data for DS59005: {'auction_closing_time': 1774884733.0, 'created_time': 1774032145.47049, 'last_price_update_time': 1774722932.952994}
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS59005') HTTP/1.1" 204 0
2026-03-28 18:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff7cb189-f878-5ccd-b5d6-6a08b496cf4d with identifier: VW07399
2026-03-28 18:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff7cb189-f878-5ccd-b5d6-6a08b496cf4d with scrape type 1
2026-03-28 18:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ff7cb189-f878-5ccd-b5d6-6a08b496cf4d
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fcf%252Fc3cf93dc5614b58bc5bb0dd6357859a1%252Fpa%252FVW07399_b79d03da35ea887ff1e471c5e6d2ccc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_b79d03da35ea887ff1e471c5e6d2ccc3.jpg already downloaded
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fcf%252Fc3cf93dc5614b58bc5bb0dd6357859a1%252Fpa%252FVW07399_a4c71dacaf04279e86f97f676eea10e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_a4c71dacaf04279e86f97f676eea10e5.jpg already downloaded
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fcf%252Fc3cf93dc5614b58bc5bb0dd6357859a1%252Fpa%252FVW07399_1e0493464f9d8b5404525bdce8631a6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_1e0493464f9d8b5404525bdce8631a6d.jpg already downloaded
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fcf%252Fc3cf93dc5614b58bc5bb0dd6357859a1%252Fpa%252FVW07399_995287d402b6d65342d4b17efd4cec1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_995287d402b6d65342d4b17efd4cec1c.jpg already downloaded
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fcf%252Fc3cf93dc5614b58bc5bb0dd6357859a1%252Fpa%252FVW07399_90b86487a81a057437b6b6fac495b561.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_90b86487a81a057437b6b6fac495b561.jpg already downloaded
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fcf%252Fc3cf93dc5614b58bc5bb0dd6357859a1%252Fpa%252FVW07399_706ad85f3697e3c38cee286d06e5edc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_706ad85f3697e3c38cee286d06e5edc8.jpg already downloaded
2026-03-28 18:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff7cb189-f878-5ccd-b5d6-6a08b496cf4d, identifier: VW07399
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: MF86039
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: JV48558
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV48558%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [auto1.de] INFO: Scrape type for JV48558: 2
2026-03-28 18:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc87eaf-732b-563e-8798-2fc15356553d with identifier: JV48558
2026-03-28 18:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc87eaf-732b-563e-8798-2fc15356553d with scrape type 2
2026-03-28 18:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffc87eaf-732b-563e-8798-2fc15356553d with scrape type 2
2026-03-28 18:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffc87eaf-732b-563e-8798-2fc15356553d, identifier: JV48558
2026-03-28 18:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff7cb189-f878-5ccd-b5d6-6a08b496cf4d with identifier: VW07399
2026-03-28 18:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff7cb189-f878-5ccd-b5d6-6a08b496cf4d with identifier: VW07399
2026-03-28 18:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff7cb189-f878-5ccd-b5d6-6a08b496cf4d with identifier: VW07399 to the API
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VW07399>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:48:18Z',
 'fuel_type': 'petrol',
 'id': 'ff7cb189-f878-5ccd-b5d6-6a08b496cf4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW07399',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 121502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_b79d03da35ea887ff1e471c5e6d2ccc3.jpg',
                'https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_a4c71dacaf04279e86f97f676eea10e5.jpg',
                'https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_1e0493464f9d8b5404525bdce8631a6d.jpg',
                'https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_995287d402b6d65342d4b17efd4cec1c.jpg',
                'https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_90b86487a81a057437b6b6fac495b561.jpg',
                'https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_706ad85f3697e3c38cee286d06e5edc8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7cb189-f878-5ccd-b5d6-6a08b496cf4d/ff7cb189-f878-5ccd-b5d6-6a08b496cf4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_b79d03da35ea887ff1e471c5e6d2ccc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7cb189-f878-5ccd-b5d6-6a08b496cf4d/ff7cb189-f878-5ccd-b5d6-6a08b496cf4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_a4c71dacaf04279e86f97f676eea10e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7cb189-f878-5ccd-b5d6-6a08b496cf4d/ff7cb189-f878-5ccd-b5d6-6a08b496cf4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_1e0493464f9d8b5404525bdce8631a6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7cb189-f878-5ccd-b5d6-6a08b496cf4d/ff7cb189-f878-5ccd-b5d6-6a08b496cf4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_995287d402b6d65342d4b17efd4cec1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7cb189-f878-5ccd-b5d6-6a08b496cf4d/ff7cb189-f878-5ccd-b5d6-6a08b496cf4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_90b86487a81a057437b6b6fac495b561.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7cb189-f878-5ccd-b5d6-6a08b496cf4d/ff7cb189-f878-5ccd-b5d6-6a08b496cf4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/cf/c3cf93dc5614b58bc5bb0dd6357859a1/pa/VW07399_706ad85f3697e3c38cee286d06e5edc8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.1 FIFA WM Edition',
 'transmission': 'manual',
 'trim': 'FIFA WM Edition',
 'year': 2011}
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW07399%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [auto1.de] INFO: Saving data for VW07399: {'created_time': 1774722933.67837, 'last_price_update_time': 1774722933.678383, 'auction_closing_time': 1774885698.0}
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW07399') HTTP/1.1" 204 0
2026-03-28 18:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffc87eaf-732b-563e-8798-2fc15356553d with identifier: JV48558
2026-03-28 18:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffc87eaf-732b-563e-8798-2fc15356553d with identifier: JV48558
2026-03-28 18:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffc87eaf-732b-563e-8798-2fc15356553d with identifier: JV48558 to the API
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:54:33Z',
 'fuel_type': 'petrol',
 'id': 'ffc87eaf-732b-563e-8798-2fc15356553d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV48558',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 116712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV48558%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Saving data for JV48558: {'auction_closing_time': 1774886073.0, 'created_time': 1774033654.986265, 'last_price_update_time': 1774722934.085982}
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV48558') HTTP/1.1" 204 0
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: SJ64604
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: LH54346
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH54346%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Scrape type for LH54346: 2
2026-03-28 18:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da3893a-91a0-52f9-83c2-df225296d56e with identifier: LH54346
2026-03-28 18:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da3893a-91a0-52f9-83c2-df225296d56e with scrape type 2
2026-03-28 18:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5da3893a-91a0-52f9-83c2-df225296d56e with scrape type 2
2026-03-28 18:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5da3893a-91a0-52f9-83c2-df225296d56e, identifier: LH54346
2026-03-28 18:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5da3893a-91a0-52f9-83c2-df225296d56e with identifier: LH54346
2026-03-28 18:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5da3893a-91a0-52f9-83c2-df225296d56e with identifier: LH54346
2026-03-28 18:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5da3893a-91a0-52f9-83c2-df225296d56e with identifier: LH54346 to the API
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:35:57Z',
 'fuel_type': 'petrol',
 'id': '5da3893a-91a0-52f9-83c2-df225296d56e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH54346',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 66303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-06',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH54346%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Saving data for LH54346: {'auction_closing_time': 1774884957.0, 'created_time': 1773426989.221201, 'last_price_update_time': 1774722934.59476}
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH54346') HTTP/1.1" 204 0
2026-03-28 18:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: DT57257
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: VT63649
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: JX79740
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: FR69109
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: BS19118
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: JX21647
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX21647%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Scrape type for JX21647: 2
2026-03-28 18:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca277e76-00a2-5deb-9089-2392cfb55009 with identifier: JX21647
2026-03-28 18:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca277e76-00a2-5deb-9089-2392cfb55009 with scrape type 2
2026-03-28 18:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca277e76-00a2-5deb-9089-2392cfb55009 with scrape type 2
2026-03-28 18:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca277e76-00a2-5deb-9089-2392cfb55009, identifier: JX21647
2026-03-28 18:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca277e76-00a2-5deb-9089-2392cfb55009 with identifier: JX21647
2026-03-28 18:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca277e76-00a2-5deb-9089-2392cfb55009 with identifier: JX21647
2026-03-28 18:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca277e76-00a2-5deb-9089-2392cfb55009 with identifier: JX21647 to the API
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:19:20Z',
 'fuel_type': 'diesel',
 'id': 'ca277e76-00a2-5deb-9089-2392cfb55009',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX21647',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC70',
 'odometer': 249871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-06',
 'seller_name': None,
 'title': 'Volvo XC70 2.4 D5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2007}
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX21647%27 HTTP/1.1" 200 None
2026-03-28 18:35:35 [auto1.de] INFO: Saving data for JX21647: {'auction_closing_time': 1774883960.0, 'created_time': 1773429539.771537, 'last_price_update_time': 1774722935.164918}
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX21647') HTTP/1.1" 204 0
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: VU30885
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU30885%27 HTTP/1.1" 200 None
2026-03-28 18:35:35 [auto1.de] INFO: Scrape type for VU30885: 2
2026-03-28 18:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7332a38-ae61-561d-bc59-e9a447d43851 with identifier: VU30885
2026-03-28 18:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7332a38-ae61-561d-bc59-e9a447d43851 with scrape type 2
2026-03-28 18:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7332a38-ae61-561d-bc59-e9a447d43851 with scrape type 2
2026-03-28 18:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7332a38-ae61-561d-bc59-e9a447d43851, identifier: VU30885
2026-03-28 18:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7332a38-ae61-561d-bc59-e9a447d43851 with identifier: VU30885
2026-03-28 18:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7332a38-ae61-561d-bc59-e9a447d43851 with identifier: VU30885
2026-03-28 18:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7332a38-ae61-561d-bc59-e9a447d43851 with identifier: VU30885 to the API
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:17Z',
 'fuel_type': 'diesel',
 'id': 'a7332a38-ae61-561d-bc59-e9a447d43851',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU30885',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 110915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-12',
 'seller_name': None,
 'title': 'BMW 1er 118d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2016}
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU30885%27 HTTP/1.1" 200 None
2026-03-28 18:35:35 [auto1.de] INFO: Saving data for VU30885: {'auction_closing_time': 1774884737.0, 'created_time': 1773427294.805044, 'last_price_update_time': 1774722935.595946}
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU30885') HTTP/1.1" 204 0
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: MM90627
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90627%27 HTTP/1.1" 200 None
2026-03-28 18:35:35 [auto1.de] INFO: Scrape type for MM90627: 2
2026-03-28 18:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef926eb4-aeb7-568f-8ce7-366ff306a319 with identifier: MM90627
2026-03-28 18:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef926eb4-aeb7-568f-8ce7-366ff306a319 with scrape type 2
2026-03-28 18:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef926eb4-aeb7-568f-8ce7-366ff306a319 with scrape type 2
2026-03-28 18:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef926eb4-aeb7-568f-8ce7-366ff306a319, identifier: MM90627
2026-03-28 18:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef926eb4-aeb7-568f-8ce7-366ff306a319 with identifier: MM90627
2026-03-28 18:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef926eb4-aeb7-568f-8ce7-366ff306a319 with identifier: MM90627
2026-03-28 18:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef926eb4-aeb7-568f-8ce7-366ff306a319 with identifier: MM90627 to the API
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:52:41Z',
 'fuel_type': 'petrol',
 'id': 'ef926eb4-aeb7-568f-8ce7-366ff306a319',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM90627',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 177358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-18',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Match BlueMotion',
 'transmission': 'manual',
 'trim': 'Match BlueMotion',
 'year': 2012}
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90627%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Saving data for MM90627: {'auction_closing_time': 1774885961.0, 'created_time': 1774089528.919424, 'last_price_update_time': 1774722936.081067}
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM90627') HTTP/1.1" 204 0
2026-03-28 18:35:36 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: SL92984
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: GH39731
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: JG03809
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG03809%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Scrape type for JG03809: 1
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: FR18143
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: FP56300
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP56300%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Scrape type for FP56300: 2
2026-03-28 18:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24d74543-e32d-51b8-9311-d1eb79e2c796 with identifier: FP56300
2026-03-28 18:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24d74543-e32d-51b8-9311-d1eb79e2c796 with scrape type 2
2026-03-28 18:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24d74543-e32d-51b8-9311-d1eb79e2c796 with scrape type 2
2026-03-28 18:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24d74543-e32d-51b8-9311-d1eb79e2c796, identifier: FP56300
2026-03-28 18:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: SN42334
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: NV30450
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: ZW50012
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: YV85598
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV85598%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Scrape type for YV85598: 1
2026-03-28 18:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24d74543-e32d-51b8-9311-d1eb79e2c796 with identifier: FP56300
2026-03-28 18:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24d74543-e32d-51b8-9311-d1eb79e2c796 with identifier: FP56300
2026-03-28 18:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24d74543-e32d-51b8-9311-d1eb79e2c796 with identifier: FP56300 to the API
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:18Z',
 'fuel_type': 'petrol',
 'id': '24d74543-e32d-51b8-9311-d1eb79e2c796',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP56300',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 54960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-14',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP56300%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Saving data for FP56300: {'auction_closing_time': 1774884618.0, 'created_time': 1774034408.837887, 'last_price_update_time': 1774722936.586667}
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP56300') HTTP/1.1" 204 0
2026-03-28 18:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY43451> (referer: https://www.auto1.com/v1/car-details-view/CY43451/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: WF13702
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: DU56840
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU56840%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Scrape type for DU56840: 1
2026-03-28 18:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: LE50284
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE50284%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Scrape type for LE50284: 2
2026-03-28 18:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe87daf-49e2-59be-8048-5ec13778aa9d with identifier: LE50284
2026-03-28 18:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe87daf-49e2-59be-8048-5ec13778aa9d with scrape type 2
2026-03-28 18:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fe87daf-49e2-59be-8048-5ec13778aa9d with scrape type 2
2026-03-28 18:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fe87daf-49e2-59be-8048-5ec13778aa9d, identifier: LE50284
2026-03-28 18:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fe87daf-49e2-59be-8048-5ec13778aa9d with identifier: LE50284
2026-03-28 18:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fe87daf-49e2-59be-8048-5ec13778aa9d with identifier: LE50284
2026-03-28 18:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fe87daf-49e2-59be-8048-5ec13778aa9d with identifier: LE50284 to the API
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:41:59Z',
 'fuel_type': 'petrol',
 'id': '1fe87daf-49e2-59be-8048-5ec13778aa9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE50284',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 151326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'Ford Focus 1.8 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE50284%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Saving data for LE50284: {'auction_closing_time': 1774885319.0, 'created_time': 1774118745.623213, 'last_price_update_time': 1774722937.139767}
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE50284') HTTP/1.1" 204 0
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: HJ42862
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ42862%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Scrape type for HJ42862: 1
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: AB49133
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: FN52751
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN52751%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Scrape type for FN52751: 2
2026-03-28 18:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 399e0cb9-41f0-56df-ba6a-a57707e30d66 with identifier: FN52751
2026-03-28 18:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 399e0cb9-41f0-56df-ba6a-a57707e30d66 with scrape type 2
2026-03-28 18:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 399e0cb9-41f0-56df-ba6a-a57707e30d66 with scrape type 2
2026-03-28 18:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 399e0cb9-41f0-56df-ba6a-a57707e30d66, identifier: FN52751
2026-03-28 18:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 399e0cb9-41f0-56df-ba6a-a57707e30d66 with identifier: FN52751
2026-03-28 18:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 399e0cb9-41f0-56df-ba6a-a57707e30d66 with identifier: FN52751
2026-03-28 18:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 399e0cb9-41f0-56df-ba6a-a57707e30d66 with identifier: FN52751 to the API
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:59:31Z',
 'fuel_type': 'petrol',
 'id': '399e0cb9-41f0-56df-ba6a-a57707e30d66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN52751',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 110732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TSI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2019}
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN52751%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Saving data for FN52751: {'auction_closing_time': 1774886371.0, 'created_time': 1773382558.343973, 'last_price_update_time': 1774722937.608521}
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN52751') HTTP/1.1" 204 0
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: HH06006
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: LU46217
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: NC63257
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC63257%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Scrape type for NC63257: 2
2026-03-28 18:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 549018d2-e3fb-578f-9172-23f107888292 with identifier: NC63257
2026-03-28 18:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 549018d2-e3fb-578f-9172-23f107888292 with scrape type 2
2026-03-28 18:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 549018d2-e3fb-578f-9172-23f107888292 with scrape type 2
2026-03-28 18:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 549018d2-e3fb-578f-9172-23f107888292, identifier: NC63257
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: KB67170
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: SC23766
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC23766%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Scrape type for SC23766: 1
2026-03-28 18:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 549018d2-e3fb-578f-9172-23f107888292 with identifier: NC63257
2026-03-28 18:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 549018d2-e3fb-578f-9172-23f107888292 with identifier: NC63257
2026-03-28 18:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 549018d2-e3fb-578f-9172-23f107888292 with identifier: NC63257 to the API
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:40:20Z',
 'fuel_type': 'diesel',
 'id': '549018d2-e3fb-578f-9172-23f107888292',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC63257',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 115619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-28',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 d Shooting Brake 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2018}
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC63257%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [auto1.de] INFO: Saving data for NC63257: {'auction_closing_time': 1774885220.0, 'created_time': 1773429408.10556, 'last_price_update_time': 1774722938.062949}
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC63257') HTTP/1.1" 204 0
2026-03-28 18:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 358f8608-f8f9-5d8b-8015-9f99a01cea36 with identifier: CY43451
2026-03-28 18:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 358f8608-f8f9-5d8b-8015-9f99a01cea36 with scrape type 1
2026-03-28 18:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 358f8608-f8f9-5d8b-8015-9f99a01cea36
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9b6a4149774c0078ef7472c057b399%252Fpa%252FCY43451_33149ea1a7cab72eb17478e642ed1b9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_33149ea1a7cab72eb17478e642ed1b9d.jpg already downloaded
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9b6a4149774c0078ef7472c057b399%252Fpa%252FCY43451_3b79cb5937d6ee0041dbf004bd7bfc6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_3b79cb5937d6ee0041dbf004bd7bfc6e.jpg already downloaded
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9b6a4149774c0078ef7472c057b399%252Fpa%252FCY43451_a565b216937826c99ffef6f584ac3976.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_a565b216937826c99ffef6f584ac3976.jpg already downloaded
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9b6a4149774c0078ef7472c057b399%252Fpa%252FCY43451_fcbc873a725f7d31434af6adc2017789.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_fcbc873a725f7d31434af6adc2017789.jpg already downloaded
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9b6a4149774c0078ef7472c057b399%252Fpa%252FCY43451_6d16add40834a646b0ef529bd90d8b14.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_6d16add40834a646b0ef529bd90d8b14.jpg already downloaded
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9b6a4149774c0078ef7472c057b399%252Fpa%252FCY43451_0936e1cceea037da441a2184f2fdf0b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_0936e1cceea037da441a2184f2fdf0b8.jpg already downloaded
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9b6a4149774c0078ef7472c057b399%252Fpa%252FCY43451_bbc17527d51226c65465cd7a63cfde31.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_bbc17527d51226c65465cd7a63cfde31.jpg already downloaded
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9b6a4149774c0078ef7472c057b399%252Fpa%252FCY43451_4e05b001e88f7d0c0d0a6411e42e4085.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_4e05b001e88f7d0c0d0a6411e42e4085.jpg already downloaded
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9b6a4149774c0078ef7472c057b399%252Fpa%252FCY43451_4d57a40e3cb3cd6e55e893fd430d7097.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_4d57a40e3cb3cd6e55e893fd430d7097.jpg already downloaded
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F9b%252Fce9b6a4149774c0078ef7472c057b399%252Fpa%252FCY43451_4e903ec4af86ec5405b111cb5f80bb45.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_4e903ec4af86ec5405b111cb5f80bb45.jpg already downloaded
2026-03-28 18:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 358f8608-f8f9-5d8b-8015-9f99a01cea36, identifier: CY43451
2026-03-28 18:35:38 [auto1.de] INFO: Found listing with ID: HA49497
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA49497%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [auto1.de] INFO: Scrape type for HA49497: 1
2026-03-28 18:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 358f8608-f8f9-5d8b-8015-9f99a01cea36 with identifier: CY43451
2026-03-28 18:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 358f8608-f8f9-5d8b-8015-9f99a01cea36 with identifier: CY43451
2026-03-28 18:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 358f8608-f8f9-5d8b-8015-9f99a01cea36 with identifier: CY43451 to the API
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CY43451>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:10:18Z',
 'fuel_type': 'diesel',
 'id': '358f8608-f8f9-5d8b-8015-9f99a01cea36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY43451',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 131679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_33149ea1a7cab72eb17478e642ed1b9d.jpg',
                'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_3b79cb5937d6ee0041dbf004bd7bfc6e.jpg',
                'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_a565b216937826c99ffef6f584ac3976.jpg',
                'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_fcbc873a725f7d31434af6adc2017789.jpg',
                'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_6d16add40834a646b0ef529bd90d8b14.jpg',
                'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_0936e1cceea037da441a2184f2fdf0b8.jpg',
                'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_bbc17527d51226c65465cd7a63cfde31.jpg',
                'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_4e05b001e88f7d0c0d0a6411e42e4085.jpg',
                'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_4d57a40e3cb3cd6e55e893fd430d7097.jpg',
                'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_4e903ec4af86ec5405b111cb5f80bb45.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358f8608-f8f9-5d8b-8015-9f99a01cea36/358f8608-f8f9-5d8b-8015-9f99a01cea36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_33149ea1a7cab72eb17478e642ed1b9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358f8608-f8f9-5d8b-8015-9f99a01cea36/358f8608-f8f9-5d8b-8015-9f99a01cea36_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_3b79cb5937d6ee0041dbf004bd7bfc6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358f8608-f8f9-5d8b-8015-9f99a01cea36/358f8608-f8f9-5d8b-8015-9f99a01cea36_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_a565b216937826c99ffef6f584ac3976.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358f8608-f8f9-5d8b-8015-9f99a01cea36/358f8608-f8f9-5d8b-8015-9f99a01cea36_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_fcbc873a725f7d31434af6adc2017789.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358f8608-f8f9-5d8b-8015-9f99a01cea36/358f8608-f8f9-5d8b-8015-9f99a01cea36_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_6d16add40834a646b0ef529bd90d8b14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358f8608-f8f9-5d8b-8015-9f99a01cea36/358f8608-f8f9-5d8b-8015-9f99a01cea36_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_0936e1cceea037da441a2184f2fdf0b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358f8608-f8f9-5d8b-8015-9f99a01cea36/358f8608-f8f9-5d8b-8015-9f99a01cea36_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_bbc17527d51226c65465cd7a63cfde31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358f8608-f8f9-5d8b-8015-9f99a01cea36/358f8608-f8f9-5d8b-8015-9f99a01cea36_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_4e05b001e88f7d0c0d0a6411e42e4085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358f8608-f8f9-5d8b-8015-9f99a01cea36/358f8608-f8f9-5d8b-8015-9f99a01cea36_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_4d57a40e3cb3cd6e55e893fd430d7097.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358f8608-f8f9-5d8b-8015-9f99a01cea36/358f8608-f8f9-5d8b-8015-9f99a01cea36_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/9b/ce9b6a4149774c0078ef7472c057b399/pa/CY43451_4e903ec4af86ec5405b111cb5f80bb45.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Alltrack 4Motion',
 'transmission': 'automatic',
 'trim': 'Alltrack 4Motion',
 'year': 2022}
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY43451%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [auto1.de] INFO: Saving data for CY43451: {'created_time': 1774722938.857839, 'last_price_update_time': 1774722938.857849, 'auction_closing_time': 1774883418.0}
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY43451') HTTP/1.1" 204 0
2026-03-28 18:35:38 [auto1.de] INFO: Found listing with ID: CL73395
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL73395%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [auto1.de] INFO: Scrape type for CL73395: 2
2026-03-28 18:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f758f033-4219-53ef-97e1-7cc6a0f0cc02 with identifier: CL73395
2026-03-28 18:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f758f033-4219-53ef-97e1-7cc6a0f0cc02 with scrape type 2
2026-03-28 18:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f758f033-4219-53ef-97e1-7cc6a0f0cc02 with scrape type 2
2026-03-28 18:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f758f033-4219-53ef-97e1-7cc6a0f0cc02, identifier: CL73395
2026-03-28 18:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f758f033-4219-53ef-97e1-7cc6a0f0cc02 with identifier: CL73395
2026-03-28 18:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f758f033-4219-53ef-97e1-7cc6a0f0cc02 with identifier: CL73395
2026-03-28 18:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f758f033-4219-53ef-97e1-7cc6a0f0cc02 with identifier: CL73395 to the API
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:48:23Z',
 'fuel_type': 'petrol',
 'id': 'f758f033-4219-53ef-97e1-7cc6a0f0cc02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL73395',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 164424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-28',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL73395%27 HTTP/1.1" 200 None
2026-03-28 18:35:39 [auto1.de] INFO: Saving data for CL73395: {'auction_closing_time': 1774885703.0, 'created_time': 1774034532.646449, 'last_price_update_time': 1774722939.308498}
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL73395') HTTP/1.1" 204 0
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: GN25688
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN25688%27 HTTP/1.1" 200 None
2026-03-28 18:35:39 [auto1.de] INFO: Scrape type for GN25688: 2
2026-03-28 18:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 942cc83e-f9e9-538f-8ff1-2d6e836d9882 with identifier: GN25688
2026-03-28 18:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 942cc83e-f9e9-538f-8ff1-2d6e836d9882 with scrape type 2
2026-03-28 18:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 942cc83e-f9e9-538f-8ff1-2d6e836d9882 with scrape type 2
2026-03-28 18:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 942cc83e-f9e9-538f-8ff1-2d6e836d9882, identifier: GN25688
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: ZU96971
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU96971%27 HTTP/1.1" 200 None
2026-03-28 18:35:39 [auto1.de] INFO: Scrape type for ZU96971: 2
2026-03-28 18:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f26f4a8-425d-554e-816e-9c1b50b5eafd with identifier: ZU96971
2026-03-28 18:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f26f4a8-425d-554e-816e-9c1b50b5eafd with scrape type 2
2026-03-28 18:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f26f4a8-425d-554e-816e-9c1b50b5eafd with scrape type 2
2026-03-28 18:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f26f4a8-425d-554e-816e-9c1b50b5eafd, identifier: ZU96971
2026-03-28 18:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 942cc83e-f9e9-538f-8ff1-2d6e836d9882 with identifier: GN25688
2026-03-28 18:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 942cc83e-f9e9-538f-8ff1-2d6e836d9882 with identifier: GN25688
2026-03-28 18:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 942cc83e-f9e9-538f-8ff1-2d6e836d9882 with identifier: GN25688 to the API
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:30:36Z',
 'fuel_type': 'diesel',
 'id': '942cc83e-f9e9-538f-8ff1-2d6e836d9882',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN25688',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 170202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-19',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN25688%27 HTTP/1.1" 200 None
2026-03-28 18:35:39 [auto1.de] INFO: Saving data for GN25688: {'auction_closing_time': 1774884636.0, 'created_time': 1773400072.13368, 'last_price_update_time': 1774722939.900223}
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN25688') HTTP/1.1" 204 0
2026-03-28 18:35:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f26f4a8-425d-554e-816e-9c1b50b5eafd with identifier: ZU96971
2026-03-28 18:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f26f4a8-425d-554e-816e-9c1b50b5eafd with identifier: ZU96971
2026-03-28 18:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f26f4a8-425d-554e-816e-9c1b50b5eafd with identifier: ZU96971 to the API
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:59:42Z',
 'fuel_type': 'petrol',
 'id': '2f26f4a8-425d-554e-816e-9c1b50b5eafd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU96971',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 97263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-21',
 'seller_name': None,
 'title': 'Peugeot 206+ 1.4 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU96971%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Saving data for ZU96971: {'auction_closing_time': 1774886382.0, 'created_time': 1773772530.714305, 'last_price_update_time': 1774722940.251445}
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU96971') HTTP/1.1" 204 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: DC32299
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: SD24294
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD24294%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Scrape type for SD24294: 2
2026-03-28 18:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bffffd0-6f0d-539f-aa13-d351800e4985 with identifier: SD24294
2026-03-28 18:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bffffd0-6f0d-539f-aa13-d351800e4985 with scrape type 2
2026-03-28 18:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bffffd0-6f0d-539f-aa13-d351800e4985 with scrape type 2
2026-03-28 18:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bffffd0-6f0d-539f-aa13-d351800e4985, identifier: SD24294
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: KF93262
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: BP80209
2026-03-28 18:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bffffd0-6f0d-539f-aa13-d351800e4985 with identifier: SD24294
2026-03-28 18:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bffffd0-6f0d-539f-aa13-d351800e4985 with identifier: SD24294
2026-03-28 18:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bffffd0-6f0d-539f-aa13-d351800e4985 with identifier: SD24294 to the API
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:28:51Z',
 'fuel_type': 'diesel',
 'id': '1bffffd0-6f0d-539f-aa13-d351800e4985',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD24294',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 236683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-07',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD24294%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Saving data for SD24294: {'auction_closing_time': 1774884531.0, 'created_time': 1774031791.775366, 'last_price_update_time': 1774722940.686375}
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD24294') HTTP/1.1" 204 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: JY97697
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY97697%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Scrape type for JY97697: 2
2026-03-28 18:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 817627b8-db25-52e5-994b-78ba13d1974a with identifier: JY97697
2026-03-28 18:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817627b8-db25-52e5-994b-78ba13d1974a with scrape type 2
2026-03-28 18:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 817627b8-db25-52e5-994b-78ba13d1974a with scrape type 2
2026-03-28 18:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 817627b8-db25-52e5-994b-78ba13d1974a, identifier: JY97697
2026-03-28 18:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 817627b8-db25-52e5-994b-78ba13d1974a with identifier: JY97697
2026-03-28 18:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 817627b8-db25-52e5-994b-78ba13d1974a with identifier: JY97697
2026-03-28 18:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 817627b8-db25-52e5-994b-78ba13d1974a with identifier: JY97697 to the API
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:39:23Z',
 'fuel_type': 'diesel',
 'id': '817627b8-db25-52e5-994b-78ba13d1974a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY97697',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 144984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-12',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2015}
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY97697%27 HTTP/1.1" 200 None
2026-03-28 18:35:41 [auto1.de] INFO: Saving data for JY97697: {'auction_closing_time': 1774885163.0, 'created_time': 1773381635.286719, 'last_price_update_time': 1774722941.127684}
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY97697') HTTP/1.1" 204 0
2026-03-28 18:35:41 [auto1.de] INFO: Found listing with ID: ZM10504
2026-03-28 18:35:41 [auto1.de] INFO: Found listing with ID: CH24864
2026-03-28 18:35:41 [auto1.de] INFO: Found listing with ID: NA60022
2026-03-28 18:35:41 [auto1.de] INFO: Found listing with ID: GX79735
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX79735%27 HTTP/1.1" 200 None
2026-03-28 18:35:41 [auto1.de] INFO: Scrape type for GX79735: 1
2026-03-28 18:35:41 [auto1.de] INFO: Found listing with ID: ZY33636
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY33636%27 HTTP/1.1" 200 None
2026-03-28 18:35:41 [auto1.de] INFO: Scrape type for ZY33636: 2
2026-03-28 18:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b412a89-49ac-58ea-9b0e-9718aee0dbd3 with identifier: ZY33636
2026-03-28 18:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b412a89-49ac-58ea-9b0e-9718aee0dbd3 with scrape type 2
2026-03-28 18:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b412a89-49ac-58ea-9b0e-9718aee0dbd3 with scrape type 2
2026-03-28 18:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b412a89-49ac-58ea-9b0e-9718aee0dbd3, identifier: ZY33636
2026-03-28 18:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b412a89-49ac-58ea-9b0e-9718aee0dbd3 with identifier: ZY33636
2026-03-28 18:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b412a89-49ac-58ea-9b0e-9718aee0dbd3 with identifier: ZY33636
2026-03-28 18:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b412a89-49ac-58ea-9b0e-9718aee0dbd3 with identifier: ZY33636 to the API
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:58Z',
 'fuel_type': 'petrol',
 'id': '0b412a89-49ac-58ea-9b0e-9718aee0dbd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY33636',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 197664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-01',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.4 Turbo Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2014}
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY33636%27 HTTP/1.1" 200 None
2026-03-28 18:35:41 [auto1.de] INFO: Saving data for ZY33636: {'auction_closing_time': 1774884118.0, 'created_time': 1773429460.695704, 'last_price_update_time': 1774722941.581788}
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY33636') HTTP/1.1" 204 0
2026-03-28 18:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:41 [auto1.de] INFO: Found listing with ID: HJ92241
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ92241%27 HTTP/1.1" 200 None
2026-03-28 18:35:41 [auto1.de] INFO: Scrape type for HJ92241: 2
2026-03-28 18:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff7440ba-7118-5418-9225-70cde3da9d7f with identifier: HJ92241
2026-03-28 18:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff7440ba-7118-5418-9225-70cde3da9d7f with scrape type 2
2026-03-28 18:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff7440ba-7118-5418-9225-70cde3da9d7f with scrape type 2
2026-03-28 18:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff7440ba-7118-5418-9225-70cde3da9d7f, identifier: HJ92241
2026-03-28 18:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff7440ba-7118-5418-9225-70cde3da9d7f with identifier: HJ92241
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 18:35:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff7440ba-7118-5418-9225-70cde3da9d7f with identifier: HJ92241
2026-03-28 18:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff7440ba-7118-5418-9225-70cde3da9d7f with identifier: HJ92241 to the API
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:03:11Z',
 'fuel_type': 'electro',
 'id': 'ff7440ba-7118-5418-9225-70cde3da9d7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ92241',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'bZ4X',
 'odometer': 14203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-19',
 'seller_name': None,
 'title': 'Toyota bZ4X electric drive 150 kW FWD',
 'transmission': 'automatic',
 'trim': 'FWD',
 'year': 2023}
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ92241%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Saving data for HJ92241: {'auction_closing_time': 1774882991.0, 'created_time': 1774002945.156531, 'last_price_update_time': 1774722942.287148}
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ92241') HTTP/1.1" 204 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: FL18278
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL18278%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for FL18278: 2
2026-03-28 18:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b74853e1-e671-55e3-8f56-0f223bd311a9 with identifier: FL18278
2026-03-28 18:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b74853e1-e671-55e3-8f56-0f223bd311a9 with scrape type 2
2026-03-28 18:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b74853e1-e671-55e3-8f56-0f223bd311a9 with scrape type 2
2026-03-28 18:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b74853e1-e671-55e3-8f56-0f223bd311a9, identifier: FL18278
2026-03-28 18:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG03809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU56840/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b74853e1-e671-55e3-8f56-0f223bd311a9 with identifier: FL18278
2026-03-28 18:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b74853e1-e671-55e3-8f56-0f223bd311a9 with identifier: FL18278
2026-03-28 18:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b74853e1-e671-55e3-8f56-0f223bd311a9 with identifier: FL18278 to the API
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:10:27Z',
 'fuel_type': 'hybrid',
 'id': 'b74853e1-e671-55e3-8f56-0f223bd311a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL18278',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 47365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-08',
 'seller_name': None,
 'title': 'Audi Q5 55 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL18278%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Saving data for FL18278: {'auction_closing_time': 1774883427.0, 'created_time': 1774032035.39741, 'last_price_update_time': 1774722942.747011}
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL18278') HTTP/1.1" 204 0
2026-03-28 18:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV85598/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: TE81012
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE81012%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for TE81012: 2
2026-03-28 18:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeeb9e31-55e1-57d7-97eb-65980871326d with identifier: TE81012
2026-03-28 18:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeeb9e31-55e1-57d7-97eb-65980871326d with scrape type 2
2026-03-28 18:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeeb9e31-55e1-57d7-97eb-65980871326d with scrape type 2
2026-03-28 18:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aeeb9e31-55e1-57d7-97eb-65980871326d, identifier: TE81012
2026-03-28 18:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC23766/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aeeb9e31-55e1-57d7-97eb-65980871326d with identifier: TE81012
2026-03-28 18:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aeeb9e31-55e1-57d7-97eb-65980871326d with identifier: TE81012
2026-03-28 18:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aeeb9e31-55e1-57d7-97eb-65980871326d with identifier: TE81012 to the API
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:24:00Z',
 'fuel_type': 'diesel',
 'id': 'aeeb9e31-55e1-57d7-97eb-65980871326d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE81012',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 91736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-05',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2016}
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE81012%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Saving data for TE81012: {'auction_closing_time': 1774884240.0, 'created_time': 1773382037.156294, 'last_price_update_time': 1774722943.228651}
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE81012') HTTP/1.1" 204 0
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: CG37224
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37224%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Scrape type for CG37224: 2
2026-03-28 18:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c511a35-2510-5bbb-99ca-5225a27979eb with identifier: CG37224
2026-03-28 18:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c511a35-2510-5bbb-99ca-5225a27979eb with scrape type 2
2026-03-28 18:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c511a35-2510-5bbb-99ca-5225a27979eb with scrape type 2
2026-03-28 18:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c511a35-2510-5bbb-99ca-5225a27979eb, identifier: CG37224
2026-03-28 18:35:43 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c511a35-2510-5bbb-99ca-5225a27979eb with identifier: CG37224
2026-03-28 18:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c511a35-2510-5bbb-99ca-5225a27979eb with identifier: CG37224
2026-03-28 18:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c511a35-2510-5bbb-99ca-5225a27979eb with identifier: CG37224 to the API
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:09:42Z',
 'fuel_type': 'petrol',
 'id': '6c511a35-2510-5bbb-99ca-5225a27979eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG37224',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 161977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37224%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Saving data for CG37224: {'auction_closing_time': 1774883382.0, 'created_time': 1773340844.041017, 'last_price_update_time': 1774722943.709615}
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG37224') HTTP/1.1" 204 0
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: BE55111
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE55111%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Scrape type for BE55111: 1
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: LX33649
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX33649%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Scrape type for LX33649: 2
2026-03-28 18:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ebf0469-2886-5b42-a16c-21e4f83773f6 with identifier: LX33649
2026-03-28 18:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ebf0469-2886-5b42-a16c-21e4f83773f6 with scrape type 2
2026-03-28 18:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ebf0469-2886-5b42-a16c-21e4f83773f6 with scrape type 2
2026-03-28 18:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ebf0469-2886-5b42-a16c-21e4f83773f6, identifier: LX33649
2026-03-28 18:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA49497/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ebf0469-2886-5b42-a16c-21e4f83773f6 with identifier: LX33649
2026-03-28 18:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ebf0469-2886-5b42-a16c-21e4f83773f6 with identifier: LX33649
2026-03-28 18:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ebf0469-2886-5b42-a16c-21e4f83773f6 with identifier: LX33649 to the API
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:27:26Z',
 'fuel_type': 'diesel',
 'id': '1ebf0469-2886-5b42-a16c-21e4f83773f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX33649',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 131192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-27',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX33649%27 HTTP/1.1" 200 None
2026-03-28 18:35:44 [auto1.de] INFO: Saving data for LX33649: {'auction_closing_time': 1774884446.0, 'created_time': 1773428967.09504, 'last_price_update_time': 1774722944.17802}
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX33649') HTTP/1.1" 204 0
2026-03-28 18:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:44 [auto1.de] INFO: Found listing with ID: LV65947
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV65947%27 HTTP/1.1" 200 None
2026-03-28 18:35:44 [auto1.de] INFO: Scrape type for LV65947: 2
2026-03-28 18:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 862c35f1-8815-55c8-855b-de5d1b2748fd with identifier: LV65947
2026-03-28 18:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 862c35f1-8815-55c8-855b-de5d1b2748fd with scrape type 2
2026-03-28 18:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 862c35f1-8815-55c8-855b-de5d1b2748fd with scrape type 2
2026-03-28 18:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 862c35f1-8815-55c8-855b-de5d1b2748fd, identifier: LV65947
2026-03-28 18:35:44 [auto1.de] INFO: Found listing with ID: CX30934
2026-03-28 18:35:44 [auto1.de] INFO: Found listing with ID: KT37105
2026-03-28 18:35:44 [auto1.de] INFO: Found listing with ID: NT69326
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT69326%27 HTTP/1.1" 200 None
2026-03-28 18:35:44 [auto1.de] INFO: Scrape type for NT69326: 2
2026-03-28 18:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 626821e8-7f03-523c-9d58-0275f5fd691a with identifier: NT69326
2026-03-28 18:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 626821e8-7f03-523c-9d58-0275f5fd691a with scrape type 2
2026-03-28 18:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 626821e8-7f03-523c-9d58-0275f5fd691a with scrape type 2
2026-03-28 18:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 626821e8-7f03-523c-9d58-0275f5fd691a, identifier: NT69326
2026-03-28 18:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 862c35f1-8815-55c8-855b-de5d1b2748fd with identifier: LV65947
2026-03-28 18:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 862c35f1-8815-55c8-855b-de5d1b2748fd with identifier: LV65947
2026-03-28 18:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 862c35f1-8815-55c8-855b-de5d1b2748fd with identifier: LV65947 to the API
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:42:00Z',
 'fuel_type': 'hybrid',
 'id': '862c35f1-8815-55c8-855b-de5d1b2748fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV65947',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 33907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-02',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 Plug-in Hybrid GT-Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT-Line 4WD',
 'year': 2022}
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV65947%27 HTTP/1.1" 200 None
2026-03-28 18:35:44 [auto1.de] INFO: Saving data for LV65947: {'auction_closing_time': 1774885320.0, 'created_time': 1773399838.304547, 'last_price_update_time': 1774722944.746595}
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV65947') HTTP/1.1" 204 0
2026-03-28 18:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 626821e8-7f03-523c-9d58-0275f5fd691a with identifier: NT69326
2026-03-28 18:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 626821e8-7f03-523c-9d58-0275f5fd691a with identifier: NT69326
2026-03-28 18:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 626821e8-7f03-523c-9d58-0275f5fd691a with identifier: NT69326 to the API
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:43:59Z',
 'fuel_type': 'diesel',
 'id': '626821e8-7f03-523c-9d58-0275f5fd691a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT69326',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 233694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-11',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2012}
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT69326%27 HTTP/1.1" 200 None
2026-03-28 18:35:45 [auto1.de] INFO: Saving data for NT69326: {'auction_closing_time': 1774885439.0, 'created_time': 1773429293.462461, 'last_price_update_time': 1774722945.0881}
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT69326') HTTP/1.1" 204 0
2026-03-28 18:35:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:45 [auto1.de] INFO: Found listing with ID: VN71215
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN71215%27 HTTP/1.1" 200 None
2026-03-28 18:35:45 [auto1.de] INFO: Scrape type for VN71215: 2
2026-03-28 18:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbc79706-32da-5093-9d13-7cd6accb8992 with identifier: VN71215
2026-03-28 18:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc79706-32da-5093-9d13-7cd6accb8992 with scrape type 2
2026-03-28 18:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbc79706-32da-5093-9d13-7cd6accb8992 with scrape type 2
2026-03-28 18:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbc79706-32da-5093-9d13-7cd6accb8992, identifier: VN71215
2026-03-28 18:35:45 [auto1.de] INFO: Found listing with ID: MP45750
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP45750%27 HTTP/1.1" 200 None
2026-03-28 18:35:45 [auto1.de] INFO: Scrape type for MP45750: 2
2026-03-28 18:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f91507fb-f0d5-568e-8433-fc259e6af072 with identifier: MP45750
2026-03-28 18:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f91507fb-f0d5-568e-8433-fc259e6af072 with scrape type 2
2026-03-28 18:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f91507fb-f0d5-568e-8433-fc259e6af072 with scrape type 2
2026-03-28 18:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f91507fb-f0d5-568e-8433-fc259e6af072, identifier: MP45750
2026-03-28 18:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbc79706-32da-5093-9d13-7cd6accb8992 with identifier: VN71215
2026-03-28 18:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbc79706-32da-5093-9d13-7cd6accb8992 with identifier: VN71215
2026-03-28 18:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbc79706-32da-5093-9d13-7cd6accb8992 with identifier: VN71215 to the API
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:01:04Z',
 'fuel_type': 'petrol',
 'id': 'fbc79706-32da-5093-9d13-7cd6accb8992',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN71215',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vectra',
 'odometer': 137317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-21',
 'seller_name': None,
 'title': 'Opel Vectra 1.8 GTS',
 'transmission': 'manual',
 'trim': 'GTS',
 'year': 2003}
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN71215%27 HTTP/1.1" 200 None
2026-03-28 18:35:45 [auto1.de] INFO: Saving data for VN71215: {'auction_closing_time': 1774882864.0, 'created_time': 1773428790.228689, 'last_price_update_time': 1774722945.678723}
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN71215') HTTP/1.1" 204 0
2026-03-28 18:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f91507fb-f0d5-568e-8433-fc259e6af072 with identifier: MP45750
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 18:35:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f91507fb-f0d5-568e-8433-fc259e6af072 with identifier: MP45750
2026-03-28 18:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f91507fb-f0d5-568e-8433-fc259e6af072 with identifier: MP45750 to the API
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:49:35Z',
 'fuel_type': 'petrol',
 'id': 'f91507fb-f0d5-568e-8433-fc259e6af072',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP45750',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 27973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-06',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Paris',
 'transmission': 'automatic',
 'trim': 'Paris',
 'year': 2014}
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP45750%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Saving data for MP45750: {'auction_closing_time': 1774885775.0, 'created_time': 1773340884.387861, 'last_price_update_time': 1774722946.314974}
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP45750') HTTP/1.1" 204 0
2026-03-28 18:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX79735/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: FY57331
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57331%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for FY57331: 1
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: BS14329
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14329%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for BS14329: 2
2026-03-28 18:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7465cf5-92ab-5735-8743-b6796b6fe637 with identifier: BS14329
2026-03-28 18:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7465cf5-92ab-5735-8743-b6796b6fe637 with scrape type 2
2026-03-28 18:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7465cf5-92ab-5735-8743-b6796b6fe637 with scrape type 2
2026-03-28 18:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7465cf5-92ab-5735-8743-b6796b6fe637, identifier: BS14329
2026-03-28 18:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7465cf5-92ab-5735-8743-b6796b6fe637 with identifier: BS14329
2026-03-28 18:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7465cf5-92ab-5735-8743-b6796b6fe637 with identifier: BS14329
2026-03-28 18:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7465cf5-92ab-5735-8743-b6796b6fe637 with identifier: BS14329 to the API
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:08:24Z',
 'fuel_type': 'petrol',
 'id': 'a7465cf5-92ab-5735-8743-b6796b6fe637',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS14329',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 142377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-26',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2013}
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14329%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Saving data for BS14329: {'auction_closing_time': 1774883304.0, 'created_time': 1773340994.233248, 'last_price_update_time': 1774722946.80308}
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS14329') HTTP/1.1" 204 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: GS42870
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS42870%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for GS42870: 2
2026-03-28 18:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13389882-0c83-535c-8d4a-4064cc5649f7 with identifier: GS42870
2026-03-28 18:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13389882-0c83-535c-8d4a-4064cc5649f7 with scrape type 2
2026-03-28 18:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13389882-0c83-535c-8d4a-4064cc5649f7 with scrape type 2
2026-03-28 18:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13389882-0c83-535c-8d4a-4064cc5649f7, identifier: GS42870
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: HW62804
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW62804%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for HW62804: 2
2026-03-28 18:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9d3241c-15c5-576e-8e4a-31edabb1538d with identifier: HW62804
2026-03-28 18:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d3241c-15c5-576e-8e4a-31edabb1538d with scrape type 2
2026-03-28 18:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9d3241c-15c5-576e-8e4a-31edabb1538d with scrape type 2
2026-03-28 18:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9d3241c-15c5-576e-8e4a-31edabb1538d, identifier: HW62804
2026-03-28 18:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13389882-0c83-535c-8d4a-4064cc5649f7 with identifier: GS42870
2026-03-28 18:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13389882-0c83-535c-8d4a-4064cc5649f7 with identifier: GS42870
2026-03-28 18:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13389882-0c83-535c-8d4a-4064cc5649f7 with identifier: GS42870 to the API
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:21:36Z',
 'fuel_type': 'petrol',
 'id': '13389882-0c83-535c-8d4a-4064cc5649f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS42870',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 117861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS42870%27 HTTP/1.1" 200 None
2026-03-28 18:35:47 [auto1.de] INFO: Saving data for GS42870: {'auction_closing_time': 1774884096.0, 'created_time': 1774350279.961746, 'last_price_update_time': 1774722947.397996}
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS42870') HTTP/1.1" 204 0
2026-03-28 18:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9d3241c-15c5-576e-8e4a-31edabb1538d with identifier: HW62804
2026-03-28 18:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9d3241c-15c5-576e-8e4a-31edabb1538d with identifier: HW62804
2026-03-28 18:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9d3241c-15c5-576e-8e4a-31edabb1538d with identifier: HW62804 to the API
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 260,
 'expiration_date': '2026-03-30T15:51:50Z',
 'fuel_type': 'petrol',
 'id': 'c9d3241c-15c5-576e-8e4a-31edabb1538d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW62804',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 121968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 2.0 SIDI Turbo Innovation 4x4',
 'transmission': 'automatic',
 'trim': 'Innovation 4x4',
 'year': 2017}
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW62804%27 HTTP/1.1" 200 None
2026-03-28 18:35:47 [auto1.de] INFO: Saving data for HW62804: {'auction_closing_time': 1774885910.0, 'created_time': 1773340891.730652, 'last_price_update_time': 1774722947.737795}
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW62804') HTTP/1.1" 204 0
2026-03-28 18:35:47 [auto1.de] INFO: Found listing with ID: MT54263
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT54263%27 HTTP/1.1" 200 None
2026-03-28 18:35:47 [auto1.de] INFO: Scrape type for MT54263: 2
2026-03-28 18:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 171d7b08-9311-5335-9a4f-9c7831d449a3 with identifier: MT54263
2026-03-28 18:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 171d7b08-9311-5335-9a4f-9c7831d449a3 with scrape type 2
2026-03-28 18:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 171d7b08-9311-5335-9a4f-9c7831d449a3 with scrape type 2
2026-03-28 18:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 171d7b08-9311-5335-9a4f-9c7831d449a3, identifier: MT54263
2026-03-28 18:35:47 [auto1.de] INFO: Found listing with ID: BS91998
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS91998%27 HTTP/1.1" 200 None
2026-03-28 18:35:47 [auto1.de] INFO: Scrape type for BS91998: 1
2026-03-28 18:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 171d7b08-9311-5335-9a4f-9c7831d449a3 with identifier: MT54263
2026-03-28 18:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 171d7b08-9311-5335-9a4f-9c7831d449a3 with identifier: MT54263
2026-03-28 18:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 171d7b08-9311-5335-9a4f-9c7831d449a3 with identifier: MT54263 to the API
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:01:32Z',
 'fuel_type': 'diesel',
 'id': '171d7b08-9311-5335-9a4f-9c7831d449a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT54263',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 92147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-26',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2007}
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT54263%27 HTTP/1.1" 200 None
2026-03-28 18:35:48 [auto1.de] INFO: Saving data for MT54263: {'auction_closing_time': 1774882892.0, 'created_time': 1774032333.920533, 'last_price_update_time': 1774722948.222952}
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT54263') HTTP/1.1" 204 0
2026-03-28 18:35:48 [auto1.de] INFO: Found listing with ID: AK26500
2026-03-28 18:35:48 [auto1.de] INFO: Found listing with ID: ZZ49081
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ49081%27 HTTP/1.1" 200 None
2026-03-28 18:35:48 [auto1.de] INFO: Scrape type for ZZ49081: 2
2026-03-28 18:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f70411d8-ecbe-5110-8d85-119499307c66 with identifier: ZZ49081
2026-03-28 18:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f70411d8-ecbe-5110-8d85-119499307c66 with scrape type 2
2026-03-28 18:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f70411d8-ecbe-5110-8d85-119499307c66 with scrape type 2
2026-03-28 18:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f70411d8-ecbe-5110-8d85-119499307c66, identifier: ZZ49081
2026-03-28 18:35:48 [auto1.de] INFO: Found listing with ID: WW27591
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27591%27 HTTP/1.1" 200 None
2026-03-28 18:35:48 [auto1.de] INFO: Scrape type for WW27591: 2
2026-03-28 18:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c36433ab-49ac-52d3-9323-471b0b694f8c with identifier: WW27591
2026-03-28 18:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c36433ab-49ac-52d3-9323-471b0b694f8c with scrape type 2
2026-03-28 18:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c36433ab-49ac-52d3-9323-471b0b694f8c with scrape type 2
2026-03-28 18:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c36433ab-49ac-52d3-9323-471b0b694f8c, identifier: WW27591
2026-03-28 18:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f70411d8-ecbe-5110-8d85-119499307c66 with identifier: ZZ49081
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 18:35:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f70411d8-ecbe-5110-8d85-119499307c66 with identifier: ZZ49081
2026-03-28 18:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f70411d8-ecbe-5110-8d85-119499307c66 with identifier: ZZ49081 to the API
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:26:25Z',
 'fuel_type': 'petrol',
 'id': 'f70411d8-ecbe-5110-8d85-119499307c66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ49081',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 86286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-04',
 'seller_name': None,
 'title': 'Hyundai i30 1.0 TGDI Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2018}
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ49081%27 HTTP/1.1" 200 None
2026-03-28 18:35:48 [auto1.de] INFO: Saving data for ZZ49081: {'auction_closing_time': 1774884385.0, 'created_time': 1774350660.334283, 'last_price_update_time': 1774722948.96395}
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ49081') HTTP/1.1" 204 0
2026-03-28 18:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c36433ab-49ac-52d3-9323-471b0b694f8c with identifier: WW27591
2026-03-28 18:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c36433ab-49ac-52d3-9323-471b0b694f8c with identifier: WW27591
2026-03-28 18:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c36433ab-49ac-52d3-9323-471b0b694f8c with identifier: WW27591 to the API
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:27:59Z',
 'fuel_type': 'petrol',
 'id': 'c36433ab-49ac-52d3-9323-471b0b694f8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW27591',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 130812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-03-18',
 'seller_name': None,
 'title': 'Volvo V40 1.9 T4',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27591%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Saving data for WW27591: {'auction_closing_time': 1774884479.0, 'created_time': 1773382220.11877, 'last_price_update_time': 1774722949.32898}
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW27591') HTTP/1.1" 204 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: JL32962
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY35476%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for GY35476: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: UN88738
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: TV18525
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: GB49809
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB49809%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for GB49809: 1
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: SS07399
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: ZM46839
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM46839%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for ZM46839: 2
2026-03-28 18:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1531b90c-f1a4-5bdf-aa51-4069f39212fd with identifier: ZM46839
2026-03-28 18:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1531b90c-f1a4-5bdf-aa51-4069f39212fd with scrape type 2
2026-03-28 18:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1531b90c-f1a4-5bdf-aa51-4069f39212fd with scrape type 2
2026-03-28 18:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1531b90c-f1a4-5bdf-aa51-4069f39212fd, identifier: ZM46839
2026-03-28 18:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1531b90c-f1a4-5bdf-aa51-4069f39212fd with identifier: ZM46839
2026-03-28 18:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1531b90c-f1a4-5bdf-aa51-4069f39212fd with identifier: ZM46839
2026-03-28 18:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1531b90c-f1a4-5bdf-aa51-4069f39212fd with identifier: ZM46839 to the API
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:41Z',
 'fuel_type': 'diesel',
 'id': '1531b90c-f1a4-5bdf-aa51-4069f39212fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM46839',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 240988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-04',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM46839%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Saving data for ZM46839: {'auction_closing_time': 1774883201.0, 'created_time': 1773427688.417628, 'last_price_update_time': 1774722949.839812}
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM46839') HTTP/1.1" 204 0
2026-03-28 18:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: LT85175
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT85175%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for LT85175: 1
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: PL16151
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL16151%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for PL16151: 1
2026-03-28 18:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU56840> (referer: https://www.auto1.com/v1/car-details-view/DU56840/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG03809> (referer: https://www.auto1.com/v1/car-details-view/JG03809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV85598> (referer: https://www.auto1.com/v1/car-details-view/YV85598/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE55111/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC23766> (referer: https://www.auto1.com/v1/car-details-view/SC23766/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: MU81714
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: ZL07582
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: PW12377
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: RD52099
2026-03-28 18:35:50 [auto1.de] INFO: Found listing with ID: GT44390
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT44390%27 HTTP/1.1" 200 None
2026-03-28 18:35:50 [auto1.de] INFO: Scrape type for GT44390: 2
2026-03-28 18:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0acbd2-9ac5-571c-a50b-786cfecea682 with identifier: GT44390
2026-03-28 18:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0acbd2-9ac5-571c-a50b-786cfecea682 with scrape type 2
2026-03-28 18:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe0acbd2-9ac5-571c-a50b-786cfecea682 with scrape type 2
2026-03-28 18:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe0acbd2-9ac5-571c-a50b-786cfecea682, identifier: GT44390
2026-03-28 18:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe0acbd2-9ac5-571c-a50b-786cfecea682 with identifier: GT44390
2026-03-28 18:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe0acbd2-9ac5-571c-a50b-786cfecea682 with identifier: GT44390
2026-03-28 18:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe0acbd2-9ac5-571c-a50b-786cfecea682 with identifier: GT44390 to the API
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:24:47Z',
 'fuel_type': 'petrol',
 'id': 'fe0acbd2-9ac5-571c-a50b-786cfecea682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT44390',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 160042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-30',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT44390%27 HTTP/1.1" 200 None
2026-03-28 18:35:50 [auto1.de] INFO: Saving data for GT44390: {'auction_closing_time': 1774884287.0, 'created_time': 1774034124.843856, 'last_price_update_time': 1774722950.426926}
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT44390') HTTP/1.1" 204 0
2026-03-28 18:35:50 [auto1.de] INFO: Found listing with ID: NK02034
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK02034%27 HTTP/1.1" 200 None
2026-03-28 18:35:50 [auto1.de] INFO: Scrape type for NK02034: 2
2026-03-28 18:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dd45248-0eb1-585f-b373-0dcbda18287c with identifier: NK02034
2026-03-28 18:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dd45248-0eb1-585f-b373-0dcbda18287c with scrape type 2
2026-03-28 18:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dd45248-0eb1-585f-b373-0dcbda18287c with scrape type 2
2026-03-28 18:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dd45248-0eb1-585f-b373-0dcbda18287c, identifier: NK02034
2026-03-28 18:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dd45248-0eb1-585f-b373-0dcbda18287c with identifier: NK02034
2026-03-28 18:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dd45248-0eb1-585f-b373-0dcbda18287c with identifier: NK02034
2026-03-28 18:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dd45248-0eb1-585f-b373-0dcbda18287c with identifier: NK02034 to the API
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:24:59Z',
 'fuel_type': 'petrol',
 'id': '4dd45248-0eb1-585f-b373-0dcbda18287c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK02034',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 169143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 CMon',
 'transmission': 'manual',
 'trim': 'CMon',
 'year': 2011}
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK02034%27 HTTP/1.1" 200 None
2026-03-28 18:35:50 [auto1.de] INFO: Saving data for NK02034: {'auction_closing_time': 1774884299.0, 'created_time': 1773383490.424292, 'last_price_update_time': 1774722950.859083}
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK02034') HTTP/1.1" 204 0
2026-03-28 18:35:50 [auto1.de] INFO: Found listing with ID: RR54011
2026-03-28 18:35:50 [auto1.de] INFO: Found listing with ID: PN39432
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN39432%27 HTTP/1.1" 200 None
2026-03-28 18:35:50 [auto1.de] INFO: Scrape type for PN39432: 2
2026-03-28 18:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 049652ce-7d88-5dbc-91d8-1533ca0a1a59 with identifier: PN39432
2026-03-28 18:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 049652ce-7d88-5dbc-91d8-1533ca0a1a59 with scrape type 2
2026-03-28 18:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 049652ce-7d88-5dbc-91d8-1533ca0a1a59 with scrape type 2
2026-03-28 18:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 049652ce-7d88-5dbc-91d8-1533ca0a1a59, identifier: PN39432
2026-03-28 18:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 049652ce-7d88-5dbc-91d8-1533ca0a1a59 with identifier: PN39432
2026-03-28 18:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 049652ce-7d88-5dbc-91d8-1533ca0a1a59 with identifier: PN39432
2026-03-28 18:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 049652ce-7d88-5dbc-91d8-1533ca0a1a59 with identifier: PN39432 to the API
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:42:07Z',
 'fuel_type': 'petrol',
 'id': '049652ce-7d88-5dbc-91d8-1533ca0a1a59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN39432',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 98356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-03',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2017}
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN39432%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [auto1.de] INFO: Saving data for PN39432: {'auction_closing_time': 1774885327.0, 'created_time': 1774034618.296253, 'last_price_update_time': 1774722951.3329}
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN39432') HTTP/1.1" 204 0
2026-03-28 18:35:51 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5d855a0-5ebb-55a0-b360-025ca21c840f with identifier: DU56840
2026-03-28 18:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5d855a0-5ebb-55a0-b360-025ca21c840f with scrape type 1
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d5d855a0-5ebb-55a0-b360-025ca21c840f
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F21%252F5421d19c314d5113c1e59d75352588d2%252Fpa%252FDU56840_f0f5d258f4b291e4a24f3d795c8ba32a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_f0f5d258f4b291e4a24f3d795c8ba32a.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F21%252F5421d19c314d5113c1e59d75352588d2%252Fpa%252FDU56840_73490d3a8913761c206b8d10ac93fc7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_73490d3a8913761c206b8d10ac93fc7a.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F21%252F5421d19c314d5113c1e59d75352588d2%252Fpa%252FDU56840_3a2d28fe92cf0fde98c5753c8909c083.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_3a2d28fe92cf0fde98c5753c8909c083.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F21%252F5421d19c314d5113c1e59d75352588d2%252Fpa%252FDU56840_e5c8eb29532731efbd4885cd8f73f54b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_e5c8eb29532731efbd4885cd8f73f54b.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F21%252F5421d19c314d5113c1e59d75352588d2%252Fpa%252FDU56840_bb2bae7464bcb564b8c73c4b24e49ae5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_bb2bae7464bcb564b8c73c4b24e49ae5.jpg already downloaded
2026-03-28 18:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5d855a0-5ebb-55a0-b360-025ca21c840f, identifier: DU56840
2026-03-28 18:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d86a5e6e-f3e0-5cb2-b815-f62777885c16 with identifier: JG03809
2026-03-28 18:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d86a5e6e-f3e0-5cb2-b815-f62777885c16 with scrape type 1
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d86a5e6e-f3e0-5cb2-b815-f62777885c16
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fec%252Fedecacdccb41ccfd6aede51f52f451c9%252Fpa%252FJG03809_69f5ce5884f13d9cb8d2aa7dc7a09df8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_69f5ce5884f13d9cb8d2aa7dc7a09df8.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fec%252Fedecacdccb41ccfd6aede51f52f451c9%252Fpa%252FJG03809_4f4b3cdd66c86098d844c6ce3d5d4034.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_4f4b3cdd66c86098d844c6ce3d5d4034.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fec%252Fedecacdccb41ccfd6aede51f52f451c9%252Fpa%252FJG03809_94d5461258e4df13a31c6a1a3cc1cfbe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_94d5461258e4df13a31c6a1a3cc1cfbe.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fec%252Fedecacdccb41ccfd6aede51f52f451c9%252Fpa%252FJG03809_9290fd11eed12d5e141c2ee1c632b6b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_9290fd11eed12d5e141c2ee1c632b6b9.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fec%252Fedecacdccb41ccfd6aede51f52f451c9%252Fpa%252FJG03809_5c3604f3b51255ef033d597fbdeda7a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_5c3604f3b51255ef033d597fbdeda7a5.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fec%252Fedecacdccb41ccfd6aede51f52f451c9%252Fpa%252FJG03809_c2405e6b5f1a5d89bdcaf2c6a49f40d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_c2405e6b5f1a5d89bdcaf2c6a49f40d4.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fec%252Fedecacdccb41ccfd6aede51f52f451c9%252Fpa%252FJG03809_1278562e023d838ee64aeeda7be0879e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_1278562e023d838ee64aeeda7be0879e.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fec%252Fedecacdccb41ccfd6aede51f52f451c9%252Fpa%252FJG03809_e0f0358dfb57de4ddebdcb609bbd3dc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_e0f0358dfb57de4ddebdcb609bbd3dc5.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fec%252Fedecacdccb41ccfd6aede51f52f451c9%252Fpa%252FJG03809_dcd67103dcacebe2964f755c4e1b5778.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_dcd67103dcacebe2964f755c4e1b5778.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fec%252Fedecacdccb41ccfd6aede51f52f451c9%252Fpa%252FJG03809_8ef2dc17c43b0f7f92a00466282be417.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_8ef2dc17c43b0f7f92a00466282be417.jpg already downloaded
2026-03-28 18:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d86a5e6e-f3e0-5cb2-b815-f62777885c16, identifier: JG03809
2026-03-28 18:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 603b3f55-b0d1-5f34-becc-a4d98a1e102a with identifier: YV85598
2026-03-28 18:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 603b3f55-b0d1-5f34-becc-a4d98a1e102a with scrape type 1
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 603b3f55-b0d1-5f34-becc-a4d98a1e102a
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe4%252Fc7e427975b2dd126245dfb536c027076%252Fpa%252FYV85598_72da921745c58e433bdaaf65b744c9fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_72da921745c58e433bdaaf65b744c9fc.jpg already downloaded
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe4%252Fc7e427975b2dd126245dfb536c027076%252Fpa%252FYV85598_33497957e84bb3fb6cf20a80f0d09a03.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_33497957e84bb3fb6cf20a80f0d09a03.jpg already downloaded
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe4%252Fc7e427975b2dd126245dfb536c027076%252Fpa%252FYV85598_1bc940ebf09d0bdeeb52ba129d418414.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_1bc940ebf09d0bdeeb52ba129d418414.jpg already downloaded
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe4%252Fc7e427975b2dd126245dfb536c027076%252Fpa%252FYV85598_abc9c807b4b1ef046137fea32394000a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_abc9c807b4b1ef046137fea32394000a.jpg already downloaded
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe4%252Fc7e427975b2dd126245dfb536c027076%252Fpa%252FYV85598_9719136a15cb2b269b8c0d248a48d205.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_9719136a15cb2b269b8c0d248a48d205.jpg already downloaded
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe4%252Fc7e427975b2dd126245dfb536c027076%252Fpa%252FYV85598_7829b7270dced8d3514e2ce626ac8594.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_7829b7270dced8d3514e2ce626ac8594.jpg already downloaded
2026-03-28 18:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 603b3f55-b0d1-5f34-becc-a4d98a1e102a, identifier: YV85598
2026-03-28 18:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf2783f1-e1c3-583e-b9b9-6e94ca097f4b with identifier: SC23766
2026-03-28 18:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf2783f1-e1c3-583e-b9b9-6e94ca097f4b with scrape type 1
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf2783f1-e1c3-583e-b9b9-6e94ca097f4b
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F66%252F76662105690061108877c51dec94e674%252Fpa%252FSC23766_49c91902c99572aaf5d7c4c641835a61.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_49c91902c99572aaf5d7c4c641835a61.jpg already downloaded
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F66%252F76662105690061108877c51dec94e674%252Fpa%252FSC23766_17fddd4f61b8f630aeb8321677b56b67.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_17fddd4f61b8f630aeb8321677b56b67.jpg already downloaded
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F66%252F76662105690061108877c51dec94e674%252Fpa%252FSC23766_1323c8bda4f81d4c9d826629b6819fd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_1323c8bda4f81d4c9d826629b6819fd0.jpg already downloaded
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F66%252F76662105690061108877c51dec94e674%252Fpa%252FSC23766_1182b28b6f2c4590f125e0a2600fd00b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_1182b28b6f2c4590f125e0a2600fd00b.jpg already downloaded
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F66%252F76662105690061108877c51dec94e674%252Fpa%252FSC23766_e4d3f95a8633c001ef010b82d2f3be2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_e4d3f95a8633c001ef010b82d2f3be2e.jpg already downloaded
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F66%252F76662105690061108877c51dec94e674%252Fpa%252FSC23766_3e9a4a6d081cf6901f17f3ba6e8bcc9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_3e9a4a6d081cf6901f17f3ba6e8bcc9d.jpg already downloaded
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F66%252F76662105690061108877c51dec94e674%252Fpa%252FSC23766_ab0f99bc5dbb3f1745080eddf34dd144.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_ab0f99bc5dbb3f1745080eddf34dd144.jpg already downloaded
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F66%252F76662105690061108877c51dec94e674%252Fpa%252FSC23766_09dd0db87e8d384c5b3d5921498ca32d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_09dd0db87e8d384c5b3d5921498ca32d.jpg already downloaded
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F66%252F76662105690061108877c51dec94e674%252Fpa%252FSC23766_c0fbad60486806c60fd5b7dfc04381d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_c0fbad60486806c60fd5b7dfc04381d1.jpg already downloaded
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F66%252F76662105690061108877c51dec94e674%252Fpa%252FSC23766_3316848aac16c67f99c782558751dfff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_3316848aac16c67f99c782558751dfff.jpg already downloaded
2026-03-28 18:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf2783f1-e1c3-583e-b9b9-6e94ca097f4b, identifier: SC23766
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: XB31619
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB31619%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [auto1.de] INFO: Scrape type for XB31619: 1
2026-03-28 18:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA49497> (referer: https://www.auto1.com/v1/car-details-view/HA49497/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5d855a0-5ebb-55a0-b360-025ca21c840f with identifier: DU56840
2026-03-28 18:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5d855a0-5ebb-55a0-b360-025ca21c840f with identifier: DU56840
2026-03-28 18:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5d855a0-5ebb-55a0-b360-025ca21c840f with identifier: DU56840 to the API
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DU56840>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:21:12Z',
 'fuel_type': 'petrol',
 'id': 'd5d855a0-5ebb-55a0-b360-025ca21c840f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU56840',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 80663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_f0f5d258f4b291e4a24f3d795c8ba32a.jpg',
                'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_73490d3a8913761c206b8d10ac93fc7a.jpg',
                'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_3a2d28fe92cf0fde98c5753c8909c083.jpg',
                'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_e5c8eb29532731efbd4885cd8f73f54b.jpg',
                'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_bb2bae7464bcb564b8c73c4b24e49ae5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_f0f5d258f4b291e4a24f3d795c8ba32a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_73490d3a8913761c206b8d10ac93fc7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_3a2d28fe92cf0fde98c5753c8909c083.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_e5c8eb29532731efbd4885cd8f73f54b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5d855a0-5ebb-55a0-b360-025ca21c840f/d5d855a0-5ebb-55a0-b360-025ca21c840f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/21/5421d19c314d5113c1e59d75352588d2/pa/DU56840_bb2bae7464bcb564b8c73c4b24e49ae5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.4 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU56840%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [auto1.de] INFO: Saving data for DU56840: {'created_time': 1774722952.820784, 'last_price_update_time': 1774722952.820803, 'auction_closing_time': 1774884072.0}
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU56840') HTTP/1.1" 204 0
2026-03-28 18:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d86a5e6e-f3e0-5cb2-b815-f62777885c16 with identifier: JG03809
2026-03-28 18:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d86a5e6e-f3e0-5cb2-b815-f62777885c16 with identifier: JG03809
2026-03-28 18:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d86a5e6e-f3e0-5cb2-b815-f62777885c16 with identifier: JG03809 to the API
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JG03809>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:54Z',
 'fuel_type': 'petrol',
 'id': 'd86a5e6e-f3e0-5cb2-b815-f62777885c16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG03809',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 42770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_69f5ce5884f13d9cb8d2aa7dc7a09df8.jpg',
                'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_4f4b3cdd66c86098d844c6ce3d5d4034.jpg',
                'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_94d5461258e4df13a31c6a1a3cc1cfbe.jpg',
                'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_9290fd11eed12d5e141c2ee1c632b6b9.jpg',
                'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_5c3604f3b51255ef033d597fbdeda7a5.jpg',
                'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_c2405e6b5f1a5d89bdcaf2c6a49f40d4.jpg',
                'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_1278562e023d838ee64aeeda7be0879e.jpg',
                'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_e0f0358dfb57de4ddebdcb609bbd3dc5.jpg',
                'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_dcd67103dcacebe2964f755c4e1b5778.jpg',
                'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_8ef2dc17c43b0f7f92a00466282be417.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d86a5e6e-f3e0-5cb2-b815-f62777885c16/d86a5e6e-f3e0-5cb2-b815-f62777885c16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_69f5ce5884f13d9cb8d2aa7dc7a09df8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d86a5e6e-f3e0-5cb2-b815-f62777885c16/d86a5e6e-f3e0-5cb2-b815-f62777885c16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_4f4b3cdd66c86098d844c6ce3d5d4034.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d86a5e6e-f3e0-5cb2-b815-f62777885c16/d86a5e6e-f3e0-5cb2-b815-f62777885c16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_94d5461258e4df13a31c6a1a3cc1cfbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d86a5e6e-f3e0-5cb2-b815-f62777885c16/d86a5e6e-f3e0-5cb2-b815-f62777885c16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2527664,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_9290fd11eed12d5e141c2ee1c632b6b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d86a5e6e-f3e0-5cb2-b815-f62777885c16/d86a5e6e-f3e0-5cb2-b815-f62777885c16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_5c3604f3b51255ef033d597fbdeda7a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d86a5e6e-f3e0-5cb2-b815-f62777885c16/d86a5e6e-f3e0-5cb2-b815-f62777885c16_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_c2405e6b5f1a5d89bdcaf2c6a49f40d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d86a5e6e-f3e0-5cb2-b815-f62777885c16/d86a5e6e-f3e0-5cb2-b815-f62777885c16_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_1278562e023d838ee64aeeda7be0879e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d86a5e6e-f3e0-5cb2-b815-f62777885c16/d86a5e6e-f3e0-5cb2-b815-f62777885c16_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_e0f0358dfb57de4ddebdcb609bbd3dc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d86a5e6e-f3e0-5cb2-b815-f62777885c16/d86a5e6e-f3e0-5cb2-b815-f62777885c16_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_dcd67103dcacebe2964f755c4e1b5778.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d86a5e6e-f3e0-5cb2-b815-f62777885c16/d86a5e6e-f3e0-5cb2-b815-f62777885c16_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ec/edecacdccb41ccfd6aede51f52f451c9/pa/JG03809_8ef2dc17c43b0f7f92a00466282be417.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2021}
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG03809%27 HTTP/1.1" 200 None
2026-03-28 18:35:53 [auto1.de] INFO: Saving data for JG03809: {'created_time': 1774722953.289349, 'last_price_update_time': 1774722953.289362, 'auction_closing_time': 1774885194.0}
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG03809') HTTP/1.1" 204 0
2026-03-28 18:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 603b3f55-b0d1-5f34-becc-a4d98a1e102a with identifier: YV85598
2026-03-28 18:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 603b3f55-b0d1-5f34-becc-a4d98a1e102a with identifier: YV85598
2026-03-28 18:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 603b3f55-b0d1-5f34-becc-a4d98a1e102a with identifier: YV85598 to the API
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YV85598>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:40:12Z',
 'fuel_type': 'diesel',
 'id': '603b3f55-b0d1-5f34-becc-a4d98a1e102a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV85598',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 268904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_72da921745c58e433bdaaf65b744c9fc.jpg',
                'https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_33497957e84bb3fb6cf20a80f0d09a03.jpg',
                'https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_1bc940ebf09d0bdeeb52ba129d418414.jpg',
                'https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_abc9c807b4b1ef046137fea32394000a.jpg',
                'https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_9719136a15cb2b269b8c0d248a48d205.jpg',
                'https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_7829b7270dced8d3514e2ce626ac8594.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603b3f55-b0d1-5f34-becc-a4d98a1e102a/603b3f55-b0d1-5f34-becc-a4d98a1e102a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_72da921745c58e433bdaaf65b744c9fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603b3f55-b0d1-5f34-becc-a4d98a1e102a/603b3f55-b0d1-5f34-becc-a4d98a1e102a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_33497957e84bb3fb6cf20a80f0d09a03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603b3f55-b0d1-5f34-becc-a4d98a1e102a/603b3f55-b0d1-5f34-becc-a4d98a1e102a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_1bc940ebf09d0bdeeb52ba129d418414.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603b3f55-b0d1-5f34-becc-a4d98a1e102a/603b3f55-b0d1-5f34-becc-a4d98a1e102a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_abc9c807b4b1ef046137fea32394000a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603b3f55-b0d1-5f34-becc-a4d98a1e102a/603b3f55-b0d1-5f34-becc-a4d98a1e102a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_9719136a15cb2b269b8c0d248a48d205.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_603b3f55-b0d1-5f34-becc-a4d98a1e102a/603b3f55-b0d1-5f34-becc-a4d98a1e102a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e4/c7e427975b2dd126245dfb536c027076/pa/YV85598_7829b7270dced8d3514e2ce626ac8594.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Grand C-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV85598%27 HTTP/1.1" 200 None
2026-03-28 18:35:53 [auto1.de] INFO: Saving data for YV85598: {'created_time': 1774722953.625629, 'last_price_update_time': 1774722953.62564, 'auction_closing_time': 1774885212.0}
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV85598') HTTP/1.1" 204 0
2026-03-28 18:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf2783f1-e1c3-583e-b9b9-6e94ca097f4b with identifier: SC23766
2026-03-28 18:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf2783f1-e1c3-583e-b9b9-6e94ca097f4b with identifier: SC23766
2026-03-28 18:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf2783f1-e1c3-583e-b9b9-6e94ca097f4b with identifier: SC23766 to the API
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC23766>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:16:25Z',
 'fuel_type': 'petrol',
 'id': 'cf2783f1-e1c3-583e-b9b9-6e94ca097f4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC23766',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 54047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_49c91902c99572aaf5d7c4c641835a61.jpg',
                'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_17fddd4f61b8f630aeb8321677b56b67.jpg',
                'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_1323c8bda4f81d4c9d826629b6819fd0.jpg',
                'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_1182b28b6f2c4590f125e0a2600fd00b.jpg',
                'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_e4d3f95a8633c001ef010b82d2f3be2e.jpg',
                'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_3e9a4a6d081cf6901f17f3ba6e8bcc9d.jpg',
                'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_ab0f99bc5dbb3f1745080eddf34dd144.jpg',
                'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_09dd0db87e8d384c5b3d5921498ca32d.jpg',
                'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_c0fbad60486806c60fd5b7dfc04381d1.jpg',
                'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_3316848aac16c67f99c782558751dfff.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2783f1-e1c3-583e-b9b9-6e94ca097f4b/cf2783f1-e1c3-583e-b9b9-6e94ca097f4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_49c91902c99572aaf5d7c4c641835a61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2783f1-e1c3-583e-b9b9-6e94ca097f4b/cf2783f1-e1c3-583e-b9b9-6e94ca097f4b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_17fddd4f61b8f630aeb8321677b56b67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2783f1-e1c3-583e-b9b9-6e94ca097f4b/cf2783f1-e1c3-583e-b9b9-6e94ca097f4b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_1323c8bda4f81d4c9d826629b6819fd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2783f1-e1c3-583e-b9b9-6e94ca097f4b/cf2783f1-e1c3-583e-b9b9-6e94ca097f4b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_1182b28b6f2c4590f125e0a2600fd00b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2783f1-e1c3-583e-b9b9-6e94ca097f4b/cf2783f1-e1c3-583e-b9b9-6e94ca097f4b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_e4d3f95a8633c001ef010b82d2f3be2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2783f1-e1c3-583e-b9b9-6e94ca097f4b/cf2783f1-e1c3-583e-b9b9-6e94ca097f4b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_3e9a4a6d081cf6901f17f3ba6e8bcc9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2783f1-e1c3-583e-b9b9-6e94ca097f4b/cf2783f1-e1c3-583e-b9b9-6e94ca097f4b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_ab0f99bc5dbb3f1745080eddf34dd144.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2783f1-e1c3-583e-b9b9-6e94ca097f4b/cf2783f1-e1c3-583e-b9b9-6e94ca097f4b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_09dd0db87e8d384c5b3d5921498ca32d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2783f1-e1c3-583e-b9b9-6e94ca097f4b/cf2783f1-e1c3-583e-b9b9-6e94ca097f4b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_c0fbad60486806c60fd5b7dfc04381d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2783f1-e1c3-583e-b9b9-6e94ca097f4b/cf2783f1-e1c3-583e-b9b9-6e94ca097f4b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/66/76662105690061108877c51dec94e674/pa/SC23766_3316848aac16c67f99c782558751dfff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 18i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC23766%27 HTTP/1.1" 200 None
2026-03-28 18:35:53 [auto1.de] INFO: Saving data for SC23766: {'created_time': 1774722953.960108, 'last_price_update_time': 1774722953.96012, 'auction_closing_time': 1774883785.0}
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC23766') HTTP/1.1" 204 0
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP45840%27 HTTP/1.1" 200 None
2026-03-28 18:35:53 [auto1.de] INFO: Scrape type for BP45840: 0
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA63852%27 HTTP/1.1" 200 None
2026-03-28 18:35:54 [auto1.de] INFO: Scrape type for FA63852: 0
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL79995%27 HTTP/1.1" 200 None
2026-03-28 18:35:54 [auto1.de] INFO: Scrape type for FL79995: 2
2026-03-28 18:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 753e7f57-036c-5a75-a3ea-bf48be584fc4 with identifier: FL79995
2026-03-28 18:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 753e7f57-036c-5a75-a3ea-bf48be584fc4 with scrape type 2
2026-03-28 18:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 753e7f57-036c-5a75-a3ea-bf48be584fc4 with scrape type 2
2026-03-28 18:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 753e7f57-036c-5a75-a3ea-bf48be584fc4, identifier: FL79995
2026-03-28 18:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: YA55481
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA55481%27 HTTP/1.1" 200 None
2026-03-28 18:35:54 [auto1.de] INFO: Scrape type for YA55481: 2
2026-03-28 18:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94dfbddb-8b40-546d-8854-2933966e0e42 with identifier: YA55481
2026-03-28 18:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94dfbddb-8b40-546d-8854-2933966e0e42 with scrape type 2
2026-03-28 18:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94dfbddb-8b40-546d-8854-2933966e0e42 with scrape type 2
2026-03-28 18:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94dfbddb-8b40-546d-8854-2933966e0e42, identifier: YA55481
2026-03-28 18:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 753e7f57-036c-5a75-a3ea-bf48be584fc4 with identifier: FL79995
2026-03-28 18:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 753e7f57-036c-5a75-a3ea-bf48be584fc4 with identifier: FL79995
2026-03-28 18:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 753e7f57-036c-5a75-a3ea-bf48be584fc4 with identifier: FL79995 to the API
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:34:44Z',
 'fuel_type': 'petrol',
 'id': '753e7f57-036c-5a75-a3ea-bf48be584fc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL79995',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 64809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-12',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CGI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL79995%27 HTTP/1.1" 200 None
2026-03-28 18:35:54 [auto1.de] INFO: Saving data for FL79995: {'auction_closing_time': 1774884884.0, 'created_time': 1774522509.1848, 'last_price_update_time': 1774722954.597457}
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL79995') HTTP/1.1" 204 0
2026-03-28 18:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HJ42862/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94dfbddb-8b40-546d-8854-2933966e0e42 with identifier: YA55481
2026-03-28 18:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94dfbddb-8b40-546d-8854-2933966e0e42 with identifier: YA55481
2026-03-28 18:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94dfbddb-8b40-546d-8854-2933966e0e42 with identifier: YA55481 to the API
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:44:20Z',
 'fuel_type': 'petrol',
 'id': '94dfbddb-8b40-546d-8854-2933966e0e42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA55481',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 297206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-31',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2010}
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA55481%27 HTTP/1.1" 200 None
2026-03-28 18:35:54 [auto1.de] INFO: Saving data for YA55481: {'auction_closing_time': 1774885460.0, 'created_time': 1774350077.535373, 'last_price_update_time': 1774722954.933611}
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA55481') HTTP/1.1" 204 0
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM92730%27 HTTP/1.1" 200 None
2026-03-28 18:35:54 [auto1.de] INFO: Scrape type for PM92730: 0
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35466%27 HTTP/1.1" 200 None
2026-03-28 18:35:54 [auto1.de] INFO: Scrape type for RD35466: 0
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK60410%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for SK60410: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS01373%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for TS01373: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX41895%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for VX41895: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST88871%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for ST88871: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH96137%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for KH96137: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH64312%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for FH64312: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE37865%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for BE37865: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV12841%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for GV12841: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN51683%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for HN51683: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML63417%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for ML63417: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP71706%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for FP71706: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU02977%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for RU02977: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW26653%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for RW26653: 2
2026-03-28 18:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with identifier: RW26653
2026-03-28 18:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with scrape type 2
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with scrape type 2
2026-03-28 18:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883, identifier: RW26653
2026-03-28 18:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8c976dc-1476-5398-9a48-5be093272f06 with identifier: HA49497
2026-03-28 18:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8c976dc-1476-5398-9a48-5be093272f06 with scrape type 1
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8c976dc-1476-5398-9a48-5be093272f06
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F75%252Fd575855157c93caa6e7aa7ae9f68e390%252Fpa%252FHA49497_aaffd0327f7c82df61375cbc763f53cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_aaffd0327f7c82df61375cbc763f53cb.jpg already downloaded
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F75%252Fd575855157c93caa6e7aa7ae9f68e390%252Fpa%252FHA49497_98ccc55b16c051807c988c5f5fff708c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_98ccc55b16c051807c988c5f5fff708c.jpg already downloaded
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F75%252Fd575855157c93caa6e7aa7ae9f68e390%252Fpa%252FHA49497_f711b6cf9c5291474fbc6ece4f92fd77.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_f711b6cf9c5291474fbc6ece4f92fd77.jpg already downloaded
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F75%252Fd575855157c93caa6e7aa7ae9f68e390%252Fpa%252FHA49497_7083e8a99c7d65a4c1c20bb57f86cdc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_7083e8a99c7d65a4c1c20bb57f86cdc9.jpg already downloaded
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F75%252Fd575855157c93caa6e7aa7ae9f68e390%252Fpa%252FHA49497_2f4efd73fab9989bbeef72d3ad7266f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_2f4efd73fab9989bbeef72d3ad7266f4.jpg already downloaded
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F75%252Fd575855157c93caa6e7aa7ae9f68e390%252Fpa%252FHA49497_f2c81fc5f9f109dbb052321c05fe3991.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_f2c81fc5f9f109dbb052321c05fe3991.jpg already downloaded
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F75%252Fd575855157c93caa6e7aa7ae9f68e390%252Fpa%252FHA49497_9eb7268c95c936ae236432f315e2fd5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_9eb7268c95c936ae236432f315e2fd5d.jpg already downloaded
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F75%252Fd575855157c93caa6e7aa7ae9f68e390%252Fpa%252FHA49497_b3baa99f03cee630ee621847ed6635e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_b3baa99f03cee630ee621847ed6635e9.jpg already downloaded
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F75%252Fd575855157c93caa6e7aa7ae9f68e390%252Fpa%252FHA49497_9c5fdc667436c41ff84d7b08334c9d2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_9c5fdc667436c41ff84d7b08334c9d2a.jpg already downloaded
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F75%252Fd575855157c93caa6e7aa7ae9f68e390%252Fpa%252FHA49497_71fd2f7b734ddc6d43d540a9f170634e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_71fd2f7b734ddc6d43d540a9f170634e.jpg already downloaded
2026-03-28 18:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8c976dc-1476-5398-9a48-5be093272f06, identifier: HA49497
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: KP96972
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ56711%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for DJ56711: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX41654%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for GX41654: 2
2026-03-28 18:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0e3c4c-9df7-5962-8d7f-37961f94179d with identifier: GX41654
2026-03-28 18:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0e3c4c-9df7-5962-8d7f-37961f94179d with scrape type 2
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0e3c4c-9df7-5962-8d7f-37961f94179d with scrape type 2
2026-03-28 18:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b0e3c4c-9df7-5962-8d7f-37961f94179d, identifier: GX41654
2026-03-28 18:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with identifier: RW26653
2026-03-28 18:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with identifier: RW26653
2026-03-28 18:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with identifier: RW26653 to the API
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:14Z',
 'fuel_type': 'petrol',
 'id': '8a7e1c8e-d4dd-5f99-93e8-9e8989116883',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW26653',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 28147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-29',
 'seller_name': None,
 'title': 'Cupra Formentor 1.5 TSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW26653%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Saving data for RW26653: {'auction_closing_time': 1774883174.0, 'created_time': 1773341713.150887, 'last_price_update_time': 1774722956.131724}
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW26653') HTTP/1.1" 204 0
2026-03-28 18:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8c976dc-1476-5398-9a48-5be093272f06 with identifier: HA49497
2026-03-28 18:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8c976dc-1476-5398-9a48-5be093272f06 with identifier: HA49497
2026-03-28 18:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8c976dc-1476-5398-9a48-5be093272f06 with identifier: HA49497 to the API
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HA49497>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:15:04Z',
 'fuel_type': 'diesel',
 'id': 'd8c976dc-1476-5398-9a48-5be093272f06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA49497',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 204379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_aaffd0327f7c82df61375cbc763f53cb.jpg',
                'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_98ccc55b16c051807c988c5f5fff708c.jpg',
                'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_f711b6cf9c5291474fbc6ece4f92fd77.jpg',
                'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_7083e8a99c7d65a4c1c20bb57f86cdc9.jpg',
                'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_2f4efd73fab9989bbeef72d3ad7266f4.jpg',
                'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_f2c81fc5f9f109dbb052321c05fe3991.jpg',
                'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_9eb7268c95c936ae236432f315e2fd5d.jpg',
                'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_b3baa99f03cee630ee621847ed6635e9.jpg',
                'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_9c5fdc667436c41ff84d7b08334c9d2a.jpg',
                'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_71fd2f7b734ddc6d43d540a9f170634e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8c976dc-1476-5398-9a48-5be093272f06/d8c976dc-1476-5398-9a48-5be093272f06_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_aaffd0327f7c82df61375cbc763f53cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8c976dc-1476-5398-9a48-5be093272f06/d8c976dc-1476-5398-9a48-5be093272f06_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_98ccc55b16c051807c988c5f5fff708c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8c976dc-1476-5398-9a48-5be093272f06/d8c976dc-1476-5398-9a48-5be093272f06_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_f711b6cf9c5291474fbc6ece4f92fd77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8c976dc-1476-5398-9a48-5be093272f06/d8c976dc-1476-5398-9a48-5be093272f06_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_7083e8a99c7d65a4c1c20bb57f86cdc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8c976dc-1476-5398-9a48-5be093272f06/d8c976dc-1476-5398-9a48-5be093272f06_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_2f4efd73fab9989bbeef72d3ad7266f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8c976dc-1476-5398-9a48-5be093272f06/d8c976dc-1476-5398-9a48-5be093272f06_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_f2c81fc5f9f109dbb052321c05fe3991.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8c976dc-1476-5398-9a48-5be093272f06/d8c976dc-1476-5398-9a48-5be093272f06_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_9eb7268c95c936ae236432f315e2fd5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8c976dc-1476-5398-9a48-5be093272f06/d8c976dc-1476-5398-9a48-5be093272f06_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_b3baa99f03cee630ee621847ed6635e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8c976dc-1476-5398-9a48-5be093272f06/d8c976dc-1476-5398-9a48-5be093272f06_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_9c5fdc667436c41ff84d7b08334c9d2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8c976dc-1476-5398-9a48-5be093272f06/d8c976dc-1476-5398-9a48-5be093272f06_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/75/d575855157c93caa6e7aa7ae9f68e390/pa/HA49497_71fd2f7b734ddc6d43d540a9f170634e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Cosmo',
 'transmission': 'automatic',
 'trim': 'Cosmo',
 'year': 2010}
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA49497%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Saving data for HA49497: {'created_time': 1774722956.555698, 'last_price_update_time': 1774722956.555709, 'auction_closing_time': 1774883704.0}
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA49497') HTTP/1.1" 204 0
2026-03-28 18:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b0e3c4c-9df7-5962-8d7f-37961f94179d with identifier: GX41654
2026-03-28 18:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b0e3c4c-9df7-5962-8d7f-37961f94179d with identifier: GX41654
2026-03-28 18:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b0e3c4c-9df7-5962-8d7f-37961f94179d with identifier: GX41654 to the API
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:32:02Z',
 'fuel_type': 'diesel',
 'id': '3b0e3c4c-9df7-5962-8d7f-37961f94179d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX41654',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 250024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-29',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX41654%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Saving data for GX41654: {'auction_closing_time': 1774884722.0, 'created_time': 1774350537.063586, 'last_price_update_time': 1774722956.89798}
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX41654') HTTP/1.1" 204 0
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23740%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Scrape type for AZ23740: 0
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN42254%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Scrape type for MN42254: 0
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF81751%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Scrape type for GF81751: 0
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS01911%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Scrape type for GS01911: 0
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY72717%27 HTTP/1.1" 200 None
2026-03-28 18:35:57 [auto1.de] INFO: Scrape type for ZY72717: 0
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW18163%27 HTTP/1.1" 200 None
2026-03-28 18:35:57 [auto1.de] INFO: Scrape type for LW18163: 0
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP30050%27 HTTP/1.1" 200 None
2026-03-28 18:35:57 [auto1.de] INFO: Scrape type for EP30050: 0
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC23376%27 HTTP/1.1" 200 None
2026-03-28 18:35:57 [auto1.de] INFO: Scrape type for RC23376: 0
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG96584%27 HTTP/1.1" 200 None
2026-03-28 18:35:57 [auto1.de] INFO: Scrape type for TG96584: 0
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: BM86036
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM86036%27 HTTP/1.1" 200 None
2026-03-28 18:35:57 [auto1.de] INFO: Scrape type for BM86036: 2
2026-03-28 18:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f0a3241-28e0-5e4a-b772-253395a1f1db with identifier: BM86036
2026-03-28 18:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f0a3241-28e0-5e4a-b772-253395a1f1db with scrape type 2
2026-03-28 18:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f0a3241-28e0-5e4a-b772-253395a1f1db with scrape type 2
2026-03-28 18:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f0a3241-28e0-5e4a-b772-253395a1f1db, identifier: BM86036
2026-03-28 18:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f0a3241-28e0-5e4a-b772-253395a1f1db with identifier: BM86036
2026-03-28 18:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f0a3241-28e0-5e4a-b772-253395a1f1db with identifier: BM86036
2026-03-28 18:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f0a3241-28e0-5e4a-b772-253395a1f1db with identifier: BM86036 to the API
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 84,
 'expiration_date': '2026-03-30T15:52:08Z',
 'fuel_type': 'petrol',
 'id': '3f0a3241-28e0-5e4a-b772-253395a1f1db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM86036',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 8279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-06',
 'seller_name': None,
 'title': 'Kia Picanto 1.2 GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2024}
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM86036%27 HTTP/1.1" 200 None
2026-03-28 18:35:57 [auto1.de] INFO: Saving data for BM86036: {'auction_closing_time': 1774885928.0, 'created_time': 1773426941.464583, 'last_price_update_time': 1774722957.558282}
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM86036') HTTP/1.1" 204 0
2026-03-28 18:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY57331/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB49809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL16151/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT85175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS91998/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GX79735> (referer: https://www.auto1.com/v1/car-details-view/GX79735/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea302e3b-34bd-5242-9e59-95f59b14bfef with identifier: GX79735
2026-03-28 18:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea302e3b-34bd-5242-9e59-95f59b14bfef with scrape type 1
2026-03-28 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea302e3b-34bd-5242-9e59-95f59b14bfef
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F77%252Faf770e1de58013740aa3bab393c879c3%252Fpa%252FGX79735_344b06019d8a5d0af38788418640ac81.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_344b06019d8a5d0af38788418640ac81.jpg already downloaded
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F77%252Faf770e1de58013740aa3bab393c879c3%252Fpa%252FGX79735_002553fc237e51381d7adbdace575954.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_002553fc237e51381d7adbdace575954.jpg already downloaded
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F77%252Faf770e1de58013740aa3bab393c879c3%252Fpa%252FGX79735_f1b3254fd51f7d2a8d1a7da3ea83f669.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_f1b3254fd51f7d2a8d1a7da3ea83f669.jpg already downloaded
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F77%252Faf770e1de58013740aa3bab393c879c3%252Fpa%252FGX79735_646474e5da88214dee7f1873c2c8019d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_646474e5da88214dee7f1873c2c8019d.jpg already downloaded
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F77%252Faf770e1de58013740aa3bab393c879c3%252Fpa%252FGX79735_aa106b3e65d10ea3f929ddf4ad5f8dd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_aa106b3e65d10ea3f929ddf4ad5f8dd5.jpg already downloaded
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F77%252Faf770e1de58013740aa3bab393c879c3%252Fpa%252FGX79735_449d73fb7554fefb006034c66ebd6b79.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_449d73fb7554fefb006034c66ebd6b79.jpg already downloaded
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F77%252Faf770e1de58013740aa3bab393c879c3%252Fpa%252FGX79735_e3fb8b01e0a32986eb5137fd0fa53840.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_e3fb8b01e0a32986eb5137fd0fa53840.jpg already downloaded
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F77%252Faf770e1de58013740aa3bab393c879c3%252Fpa%252FGX79735_5df46e0dec8f32e3b63aebe4743213b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_5df46e0dec8f32e3b63aebe4743213b7.jpg already downloaded
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F77%252Faf770e1de58013740aa3bab393c879c3%252Fpa%252FGX79735_bd449001d14535dfdd65d065e2b9bf9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_bd449001d14535dfdd65d065e2b9bf9f.jpg already downloaded
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F77%252Faf770e1de58013740aa3bab393c879c3%252Fpa%252FGX79735_285c0c7d5289bd3eb3b9efe334b6b4b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_285c0c7d5289bd3eb3b9efe334b6b4b1.jpg already downloaded
2026-03-28 18:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea302e3b-34bd-5242-9e59-95f59b14bfef, identifier: GX79735
2026-03-28 18:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea302e3b-34bd-5242-9e59-95f59b14bfef with identifier: GX79735
2026-03-28 18:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea302e3b-34bd-5242-9e59-95f59b14bfef with identifier: GX79735
2026-03-28 18:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea302e3b-34bd-5242-9e59-95f59b14bfef with identifier: GX79735 to the API
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GX79735>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:43:31Z',
 'fuel_type': 'diesel',
 'id': 'ea302e3b-34bd-5242-9e59-95f59b14bfef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX79735',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 167481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_344b06019d8a5d0af38788418640ac81.jpg',
                'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_002553fc237e51381d7adbdace575954.jpg',
                'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_f1b3254fd51f7d2a8d1a7da3ea83f669.jpg',
                'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_646474e5da88214dee7f1873c2c8019d.jpg',
                'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_aa106b3e65d10ea3f929ddf4ad5f8dd5.jpg',
                'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_449d73fb7554fefb006034c66ebd6b79.jpg',
                'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_e3fb8b01e0a32986eb5137fd0fa53840.jpg',
                'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_5df46e0dec8f32e3b63aebe4743213b7.jpg',
                'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_bd449001d14535dfdd65d065e2b9bf9f.jpg',
                'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_285c0c7d5289bd3eb3b9efe334b6b4b1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea302e3b-34bd-5242-9e59-95f59b14bfef/ea302e3b-34bd-5242-9e59-95f59b14bfef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2682418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_344b06019d8a5d0af38788418640ac81.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea302e3b-34bd-5242-9e59-95f59b14bfef/ea302e3b-34bd-5242-9e59-95f59b14bfef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2680505,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_002553fc237e51381d7adbdace575954.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea302e3b-34bd-5242-9e59-95f59b14bfef/ea302e3b-34bd-5242-9e59-95f59b14bfef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2752896,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_f1b3254fd51f7d2a8d1a7da3ea83f669.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea302e3b-34bd-5242-9e59-95f59b14bfef/ea302e3b-34bd-5242-9e59-95f59b14bfef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2579170,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_646474e5da88214dee7f1873c2c8019d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea302e3b-34bd-5242-9e59-95f59b14bfef/ea302e3b-34bd-5242-9e59-95f59b14bfef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_aa106b3e65d10ea3f929ddf4ad5f8dd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea302e3b-34bd-5242-9e59-95f59b14bfef/ea302e3b-34bd-5242-9e59-95f59b14bfef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_449d73fb7554fefb006034c66ebd6b79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea302e3b-34bd-5242-9e59-95f59b14bfef/ea302e3b-34bd-5242-9e59-95f59b14bfef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2605365,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_e3fb8b01e0a32986eb5137fd0fa53840.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea302e3b-34bd-5242-9e59-95f59b14bfef/ea302e3b-34bd-5242-9e59-95f59b14bfef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_5df46e0dec8f32e3b63aebe4743213b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea302e3b-34bd-5242-9e59-95f59b14bfef/ea302e3b-34bd-5242-9e59-95f59b14bfef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2538761,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_bd449001d14535dfdd65d065e2b9bf9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea302e3b-34bd-5242-9e59-95f59b14bfef/ea302e3b-34bd-5242-9e59-95f59b14bfef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2768250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/77/af770e1de58013740aa3bab393c879c3/pa/GX79735_285c0c7d5289bd3eb3b9efe334b6b4b1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX79735%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [auto1.de] INFO: Saving data for GX79735: {'created_time': 1774722958.996304, 'last_price_update_time': 1774722958.996315, 'auction_closing_time': 1774885411.0}
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX79735') HTTP/1.1" 204 0
2026-03-28 18:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HJ42862> (referer: https://www.auto1.com/v1/car-details-view/HJ42862/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE55111> (referer: https://www.auto1.com/v1/car-details-view/BE55111/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB49809> (referer: https://www.auto1.com/v1/car-details-view/GB49809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB31619/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:59 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04147%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for UV04147: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN93492%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for JN93492: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08614%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for AJ08614: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH31418%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for KH31418: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: UY73943
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS27718%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for XS27718: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ86247%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for KJ86247: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF22062%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for AF22062: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH59067%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for FH59067: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ30839%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for YJ30839: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD68188%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for BD68188: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: FA27220
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA27220%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for FA27220: 2
2026-03-28 18:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 770609e7-6336-5339-920b-77f2f21ffbdd with identifier: FA27220
2026-03-28 18:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770609e7-6336-5339-920b-77f2f21ffbdd with scrape type 2
2026-03-28 18:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 770609e7-6336-5339-920b-77f2f21ffbdd with scrape type 2
2026-03-28 18:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 770609e7-6336-5339-920b-77f2f21ffbdd, identifier: FA27220
2026-03-28 18:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 770609e7-6336-5339-920b-77f2f21ffbdd with identifier: FA27220
2026-03-28 18:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 770609e7-6336-5339-920b-77f2f21ffbdd with identifier: FA27220
2026-03-28 18:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 770609e7-6336-5339-920b-77f2f21ffbdd with identifier: FA27220 to the API
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:00Z',
 'fuel_type': 'petrol',
 'id': '770609e7-6336-5339-920b-77f2f21ffbdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA27220',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 73489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-12',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2020}
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA27220%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Saving data for FA27220: {'auction_closing_time': 1774884540.0, 'created_time': 1773382486.4619, 'last_price_update_time': 1774722959.6489}
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA27220') HTTP/1.1" 204 0
2026-03-28 18:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83359%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for MU83359: 2
2026-03-28 18:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bf13c1a-e5d8-506a-a482-caba11daa539 with identifier: MU83359
2026-03-28 18:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf13c1a-e5d8-506a-a482-caba11daa539 with scrape type 2
2026-03-28 18:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bf13c1a-e5d8-506a-a482-caba11daa539 with scrape type 2
2026-03-28 18:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bf13c1a-e5d8-506a-a482-caba11daa539, identifier: MU83359
2026-03-28 18:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bf13c1a-e5d8-506a-a482-caba11daa539 with identifier: MU83359
2026-03-28 18:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bf13c1a-e5d8-506a-a482-caba11daa539 with identifier: MU83359
2026-03-28 18:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bf13c1a-e5d8-506a-a482-caba11daa539 with identifier: MU83359 to the API
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:50Z',
 'fuel_type': 'diesel',
 'id': '8bf13c1a-e5d8-506a-a482-caba11daa539',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU83359',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 201828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83359%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [auto1.de] INFO: Saving data for MU83359: {'auction_closing_time': 1774882970.0, 'created_time': 1774521888.655067, 'last_price_update_time': 1774722960.234485}
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU83359') HTTP/1.1" 204 0
2026-03-28 18:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL16151> (referer: https://www.auto1.com/v1/car-details-view/PL16151/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e49de2ea-4454-579e-a7eb-920e66b1cc41 with identifier: HJ42862
2026-03-28 18:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e49de2ea-4454-579e-a7eb-920e66b1cc41 with scrape type 1
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e49de2ea-4454-579e-a7eb-920e66b1cc41
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F41%252Fc24156a2328f8c7d89f5a06f5ac8cc47%252Fpa%252FHJ42862_6b83aa6d544076b6bd50cbb2e2676d71.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_6b83aa6d544076b6bd50cbb2e2676d71.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F41%252Fc24156a2328f8c7d89f5a06f5ac8cc47%252Fpa%252FHJ42862_ca976e43a6c7f503276219a8c6fdf804.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_ca976e43a6c7f503276219a8c6fdf804.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F41%252Fc24156a2328f8c7d89f5a06f5ac8cc47%252Fpa%252FHJ42862_b01b4406da9c7e91c1cc63f58be29f90.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_b01b4406da9c7e91c1cc63f58be29f90.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F41%252Fc24156a2328f8c7d89f5a06f5ac8cc47%252Fpa%252FHJ42862_e50f6368cc49c2a03941cbcbf04e38cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_e50f6368cc49c2a03941cbcbf04e38cc.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F41%252Fc24156a2328f8c7d89f5a06f5ac8cc47%252Fpa%252FHJ42862_dea7f23a393ebe742370797ca16c2fea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_dea7f23a393ebe742370797ca16c2fea.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F41%252Fc24156a2328f8c7d89f5a06f5ac8cc47%252Fpa%252FHJ42862_8d8d8feb3d6141f8c439c8b3e0e0f087.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_8d8d8feb3d6141f8c439c8b3e0e0f087.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F41%252Fc24156a2328f8c7d89f5a06f5ac8cc47%252Fpa%252FHJ42862_07466f47a86c8d5315d459619b007306.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_07466f47a86c8d5315d459619b007306.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F41%252Fc24156a2328f8c7d89f5a06f5ac8cc47%252Fpa%252FHJ42862_190974221a83a2324dae3d81dc467169.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_190974221a83a2324dae3d81dc467169.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F41%252Fc24156a2328f8c7d89f5a06f5ac8cc47%252Fpa%252FHJ42862_f5fbdba01b5439b4ee38d802487f8b57.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_f5fbdba01b5439b4ee38d802487f8b57.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F41%252Fc24156a2328f8c7d89f5a06f5ac8cc47%252Fpa%252FHJ42862_7a4732fc2aab0a2fe4d1fdd7cf42c082.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_7a4732fc2aab0a2fe4d1fdd7cf42c082.jpg already downloaded
2026-03-28 18:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e49de2ea-4454-579e-a7eb-920e66b1cc41, identifier: HJ42862
2026-03-28 18:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8d41f31-fbd5-5bc4-ada8-e31cdc15669f with identifier: BE55111
2026-03-28 18:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8d41f31-fbd5-5bc4-ada8-e31cdc15669f with scrape type 1
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8d41f31-fbd5-5bc4-ada8-e31cdc15669f
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F26%252Fa726ff1b89ae09bb52c0a06d1365c07e%252Fpa%252FBE55111_e3964ab58d7b90269a3c07a756024e28.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_e3964ab58d7b90269a3c07a756024e28.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F26%252Fa726ff1b89ae09bb52c0a06d1365c07e%252Fpa%252FBE55111_ac1fc5b11d3e00fd9c16fadf8d1cbac0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_ac1fc5b11d3e00fd9c16fadf8d1cbac0.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F26%252Fa726ff1b89ae09bb52c0a06d1365c07e%252Fpa%252FBE55111_fffc8e3ce14cc1cad04fcbeaeb0ea3c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_fffc8e3ce14cc1cad04fcbeaeb0ea3c9.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F26%252Fa726ff1b89ae09bb52c0a06d1365c07e%252Fpa%252FBE55111_a7a7707948b56427d0517bc21f96fc58.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_a7a7707948b56427d0517bc21f96fc58.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F26%252Fa726ff1b89ae09bb52c0a06d1365c07e%252Fpa%252FBE55111_785db27424a39f095b6fd7edc766d393.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_785db27424a39f095b6fd7edc766d393.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F26%252Fa726ff1b89ae09bb52c0a06d1365c07e%252Fpa%252FBE55111_77c6532026d28f1da874f1f8296850b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_77c6532026d28f1da874f1f8296850b7.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F26%252Fa726ff1b89ae09bb52c0a06d1365c07e%252Fpa%252FBE55111_45b0c0480169eed78cc0444f5fe0b490.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_45b0c0480169eed78cc0444f5fe0b490.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F26%252Fa726ff1b89ae09bb52c0a06d1365c07e%252Fpa%252FBE55111_330cf15d7993e9c1665d4d300ce8cd16.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_330cf15d7993e9c1665d4d300ce8cd16.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F26%252Fa726ff1b89ae09bb52c0a06d1365c07e%252Fpa%252FBE55111_a1d339d9072546edf975a87e8fba1a0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_a1d339d9072546edf975a87e8fba1a0a.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F26%252Fa726ff1b89ae09bb52c0a06d1365c07e%252Fpa%252FBE55111_b916077d3ce8cd0b44c9af51fc7d48ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_b916077d3ce8cd0b44c9af51fc7d48ae.jpg already downloaded
2026-03-28 18:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8d41f31-fbd5-5bc4-ada8-e31cdc15669f, identifier: BE55111
2026-03-28 18:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85bd1837-1010-5eb8-a287-61670badb2b4 with identifier: GB49809
2026-03-28 18:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85bd1837-1010-5eb8-a287-61670badb2b4 with scrape type 1
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85bd1837-1010-5eb8-a287-61670badb2b4
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fec%252F71ec06170e313f6ae0534309192bd457%252Fpa%252FGB49809_44b2d164b754d32b6ad1071a2038c5d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_44b2d164b754d32b6ad1071a2038c5d2.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fec%252F71ec06170e313f6ae0534309192bd457%252Fpa%252FGB49809_62ea8d97e099e0cfd9dd4220ed6885bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_62ea8d97e099e0cfd9dd4220ed6885bb.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fec%252F71ec06170e313f6ae0534309192bd457%252Fpa%252FGB49809_e1ce61056a86ad9aacdeda97fd0e976c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_e1ce61056a86ad9aacdeda97fd0e976c.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fec%252F71ec06170e313f6ae0534309192bd457%252Fpa%252FGB49809_1c58d4a411b4a04291de3ab6f88f2999.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_1c58d4a411b4a04291de3ab6f88f2999.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fec%252F71ec06170e313f6ae0534309192bd457%252Fpa%252FGB49809_bc7b380f5e323248866131ccd89bd4e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_bc7b380f5e323248866131ccd89bd4e4.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fec%252F71ec06170e313f6ae0534309192bd457%252Fpa%252FGB49809_3f90d5e952f286d0fc79486a43e60aa2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_3f90d5e952f286d0fc79486a43e60aa2.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fec%252F71ec06170e313f6ae0534309192bd457%252Fpa%252FGB49809_d80672f5985cfdaaadacbae6ff649aca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_d80672f5985cfdaaadacbae6ff649aca.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fec%252F71ec06170e313f6ae0534309192bd457%252Fpa%252FGB49809_ae82874419a5c6281ae4cde55661cfda.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_ae82874419a5c6281ae4cde55661cfda.jpg already downloaded
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fec%252F71ec06170e313f6ae0534309192bd457%252Fpa%252FGB49809_de87aa5316fc1cad42406d1dc58a4cfa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_de87aa5316fc1cad42406d1dc58a4cfa.jpg already downloaded
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fec%252F71ec06170e313f6ae0534309192bd457%252Fpa%252FGB49809_d01cdbf77b0a77f71159cdc31f4bbe7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_d01cdbf77b0a77f71159cdc31f4bbe7d.jpg already downloaded
2026-03-28 18:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85bd1837-1010-5eb8-a287-61670badb2b4, identifier: GB49809
2026-03-28 18:36:01 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU87810%27 HTTP/1.1" 200 None
2026-03-28 18:36:01 [auto1.de] INFO: Scrape type for VU87810: 0
2026-03-28 18:36:01 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81106%27 HTTP/1.1" 200 None
2026-03-28 18:36:01 [auto1.de] INFO: Scrape type for YS81106: 0
2026-03-28 18:36:01 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN35762%27 HTTP/1.1" 200 None
2026-03-28 18:36:01 [auto1.de] INFO: Scrape type for HN35762: 0
2026-03-28 18:36:01 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-28 18:36:01 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD63054%27 HTTP/1.1" 200 None
2026-03-28 18:36:01 [auto1.de] INFO: Scrape type for TD63054: 0
2026-03-28 18:36:01 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-28 18:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e49de2ea-4454-579e-a7eb-920e66b1cc41 with identifier: HJ42862
2026-03-28 18:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e49de2ea-4454-579e-a7eb-920e66b1cc41 with identifier: HJ42862
2026-03-28 18:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e49de2ea-4454-579e-a7eb-920e66b1cc41 with identifier: HJ42862 to the API
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HJ42862>
{'auction_title': '',
 'c_o_2_emission_value': 214,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 354,
 'expiration_date': '2026-03-30T15:36:55Z',
 'fuel_type': 'petrol',
 'id': 'e49de2ea-4454-579e-a7eb-920e66b1cc41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ42862',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Audi',
 'model': 'S5',
 'odometer': 61872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_6b83aa6d544076b6bd50cbb2e2676d71.jpg',
                'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_ca976e43a6c7f503276219a8c6fdf804.jpg',
                'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_b01b4406da9c7e91c1cc63f58be29f90.jpg',
                'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_e50f6368cc49c2a03941cbcbf04e38cc.jpg',
                'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_dea7f23a393ebe742370797ca16c2fea.jpg',
                'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_8d8d8feb3d6141f8c439c8b3e0e0f087.jpg',
                'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_07466f47a86c8d5315d459619b007306.jpg',
                'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_190974221a83a2324dae3d81dc467169.jpg',
                'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_f5fbdba01b5439b4ee38d802487f8b57.jpg',
                'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_7a4732fc2aab0a2fe4d1fdd7cf42c082.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49de2ea-4454-579e-a7eb-920e66b1cc41/e49de2ea-4454-579e-a7eb-920e66b1cc41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_6b83aa6d544076b6bd50cbb2e2676d71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49de2ea-4454-579e-a7eb-920e66b1cc41/e49de2ea-4454-579e-a7eb-920e66b1cc41_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_ca976e43a6c7f503276219a8c6fdf804.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49de2ea-4454-579e-a7eb-920e66b1cc41/e49de2ea-4454-579e-a7eb-920e66b1cc41_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_b01b4406da9c7e91c1cc63f58be29f90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49de2ea-4454-579e-a7eb-920e66b1cc41/e49de2ea-4454-579e-a7eb-920e66b1cc41_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_e50f6368cc49c2a03941cbcbf04e38cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49de2ea-4454-579e-a7eb-920e66b1cc41/e49de2ea-4454-579e-a7eb-920e66b1cc41_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_dea7f23a393ebe742370797ca16c2fea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49de2ea-4454-579e-a7eb-920e66b1cc41/e49de2ea-4454-579e-a7eb-920e66b1cc41_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_8d8d8feb3d6141f8c439c8b3e0e0f087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49de2ea-4454-579e-a7eb-920e66b1cc41/e49de2ea-4454-579e-a7eb-920e66b1cc41_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_07466f47a86c8d5315d459619b007306.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49de2ea-4454-579e-a7eb-920e66b1cc41/e49de2ea-4454-579e-a7eb-920e66b1cc41_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_190974221a83a2324dae3d81dc467169.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49de2ea-4454-579e-a7eb-920e66b1cc41/e49de2ea-4454-579e-a7eb-920e66b1cc41_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_f5fbdba01b5439b4ee38d802487f8b57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49de2ea-4454-579e-a7eb-920e66b1cc41/e49de2ea-4454-579e-a7eb-920e66b1cc41_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/41/c24156a2328f8c7d89f5a06f5ac8cc47/pa/HJ42862_7a4732fc2aab0a2fe4d1fdd7cf42c082.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi S5 3.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ42862%27 HTTP/1.1" 200 None
2026-03-28 18:36:01 [auto1.de] INFO: Saving data for HJ42862: {'created_time': 1774722961.527501, 'last_price_update_time': 1774722961.527514, 'auction_closing_time': 1774885015.0}
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ42862') HTTP/1.1" 204 0
2026-03-28 18:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8d41f31-fbd5-5bc4-ada8-e31cdc15669f with identifier: BE55111
2026-03-28 18:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8d41f31-fbd5-5bc4-ada8-e31cdc15669f with identifier: BE55111
2026-03-28 18:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8d41f31-fbd5-5bc4-ada8-e31cdc15669f with identifier: BE55111 to the API
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BE55111>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:43:38Z',
 'fuel_type': 'petrol',
 'id': 'e8d41f31-fbd5-5bc4-ada8-e31cdc15669f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE55111',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 128581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_e3964ab58d7b90269a3c07a756024e28.jpg',
                'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_ac1fc5b11d3e00fd9c16fadf8d1cbac0.jpg',
                'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_fffc8e3ce14cc1cad04fcbeaeb0ea3c9.jpg',
                'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_a7a7707948b56427d0517bc21f96fc58.jpg',
                'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_785db27424a39f095b6fd7edc766d393.jpg',
                'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_77c6532026d28f1da874f1f8296850b7.jpg',
                'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_45b0c0480169eed78cc0444f5fe0b490.jpg',
                'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_330cf15d7993e9c1665d4d300ce8cd16.jpg',
                'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_a1d339d9072546edf975a87e8fba1a0a.jpg',
                'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_b916077d3ce8cd0b44c9af51fc7d48ae.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d41f31-fbd5-5bc4-ada8-e31cdc15669f/e8d41f31-fbd5-5bc4-ada8-e31cdc15669f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2954258,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_e3964ab58d7b90269a3c07a756024e28.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d41f31-fbd5-5bc4-ada8-e31cdc15669f/e8d41f31-fbd5-5bc4-ada8-e31cdc15669f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_ac1fc5b11d3e00fd9c16fadf8d1cbac0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d41f31-fbd5-5bc4-ada8-e31cdc15669f/e8d41f31-fbd5-5bc4-ada8-e31cdc15669f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2988899,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_fffc8e3ce14cc1cad04fcbeaeb0ea3c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d41f31-fbd5-5bc4-ada8-e31cdc15669f/e8d41f31-fbd5-5bc4-ada8-e31cdc15669f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2848434,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_a7a7707948b56427d0517bc21f96fc58.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d41f31-fbd5-5bc4-ada8-e31cdc15669f/e8d41f31-fbd5-5bc4-ada8-e31cdc15669f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2932518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_785db27424a39f095b6fd7edc766d393.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d41f31-fbd5-5bc4-ada8-e31cdc15669f/e8d41f31-fbd5-5bc4-ada8-e31cdc15669f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_77c6532026d28f1da874f1f8296850b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d41f31-fbd5-5bc4-ada8-e31cdc15669f/e8d41f31-fbd5-5bc4-ada8-e31cdc15669f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_45b0c0480169eed78cc0444f5fe0b490.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d41f31-fbd5-5bc4-ada8-e31cdc15669f/e8d41f31-fbd5-5bc4-ada8-e31cdc15669f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2976695,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_330cf15d7993e9c1665d4d300ce8cd16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d41f31-fbd5-5bc4-ada8-e31cdc15669f/e8d41f31-fbd5-5bc4-ada8-e31cdc15669f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2899449,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_a1d339d9072546edf975a87e8fba1a0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d41f31-fbd5-5bc4-ada8-e31cdc15669f/e8d41f31-fbd5-5bc4-ada8-e31cdc15669f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2870010,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/26/a726ff1b89ae09bb52c0a06d1365c07e/pa/BE55111_b916077d3ce8cd0b44c9af51fc7d48ae.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X',
 'transmission': 'manual',
 'trim': 'X',
 'year': 2018}
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE55111%27 HTTP/1.1" 200 None
2026-03-28 18:36:01 [auto1.de] INFO: Saving data for BE55111: {'created_time': 1774722961.893238, 'last_price_update_time': 1774722961.893254, 'auction_closing_time': 1774885418.0}
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE55111') HTTP/1.1" 204 0
2026-03-28 18:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85bd1837-1010-5eb8-a287-61670badb2b4 with identifier: GB49809
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 18:36:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85bd1837-1010-5eb8-a287-61670badb2b4 with identifier: GB49809
2026-03-28 18:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85bd1837-1010-5eb8-a287-61670badb2b4 with identifier: GB49809 to the API
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GB49809>
{'auction_title': '',
 'c_o_2_emission_value': 259,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:56:28Z',
 'fuel_type': 'diesel',
 'id': '85bd1837-1010-5eb8-a287-61670badb2b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB49809',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 81218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_44b2d164b754d32b6ad1071a2038c5d2.jpg',
                'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_62ea8d97e099e0cfd9dd4220ed6885bb.jpg',
                'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_e1ce61056a86ad9aacdeda97fd0e976c.jpg',
                'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_1c58d4a411b4a04291de3ab6f88f2999.jpg',
                'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_bc7b380f5e323248866131ccd89bd4e4.jpg',
                'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_3f90d5e952f286d0fc79486a43e60aa2.jpg',
                'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_d80672f5985cfdaaadacbae6ff649aca.jpg',
                'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_ae82874419a5c6281ae4cde55661cfda.jpg',
                'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_de87aa5316fc1cad42406d1dc58a4cfa.jpg',
                'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_d01cdbf77b0a77f71159cdc31f4bbe7d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85bd1837-1010-5eb8-a287-61670badb2b4/85bd1837-1010-5eb8-a287-61670badb2b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_44b2d164b754d32b6ad1071a2038c5d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85bd1837-1010-5eb8-a287-61670badb2b4/85bd1837-1010-5eb8-a287-61670badb2b4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_62ea8d97e099e0cfd9dd4220ed6885bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85bd1837-1010-5eb8-a287-61670badb2b4/85bd1837-1010-5eb8-a287-61670badb2b4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_e1ce61056a86ad9aacdeda97fd0e976c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85bd1837-1010-5eb8-a287-61670badb2b4/85bd1837-1010-5eb8-a287-61670badb2b4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_1c58d4a411b4a04291de3ab6f88f2999.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85bd1837-1010-5eb8-a287-61670badb2b4/85bd1837-1010-5eb8-a287-61670badb2b4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_bc7b380f5e323248866131ccd89bd4e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85bd1837-1010-5eb8-a287-61670badb2b4/85bd1837-1010-5eb8-a287-61670badb2b4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_3f90d5e952f286d0fc79486a43e60aa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85bd1837-1010-5eb8-a287-61670badb2b4/85bd1837-1010-5eb8-a287-61670badb2b4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_d80672f5985cfdaaadacbae6ff649aca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85bd1837-1010-5eb8-a287-61670badb2b4/85bd1837-1010-5eb8-a287-61670badb2b4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_ae82874419a5c6281ae4cde55661cfda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85bd1837-1010-5eb8-a287-61670badb2b4/85bd1837-1010-5eb8-a287-61670badb2b4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_de87aa5316fc1cad42406d1dc58a4cfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85bd1837-1010-5eb8-a287-61670badb2b4/85bd1837-1010-5eb8-a287-61670badb2b4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/ec/71ec06170e313f6ae0534309192bd457/pa/GB49809_d01cdbf77b0a77f71159cdc31f4bbe7d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-05',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid 320 L1 Tourneo Titanium X',
 'transmission': 'manual',
 'trim': '320 L1 Tourneo Titanium X',
 'year': 2021}
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB49809%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [auto1.de] INFO: Saving data for GB49809: {'created_time': 1774722962.388067, 'last_price_update_time': 1774722962.388081, 'auction_closing_time': 1774886188.0}
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB49809') HTTP/1.1" 204 0
2026-03-28 18:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS91998> (referer: https://www.auto1.com/v1/car-details-view/BS91998/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY57331> (referer: https://www.auto1.com/v1/car-details-view/FY57331/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb54893d-3b8b-5cf8-b3c2-799c8944a550 with identifier: PL16151
2026-03-28 18:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb54893d-3b8b-5cf8-b3c2-799c8944a550 with scrape type 1
2026-03-28 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb54893d-3b8b-5cf8-b3c2-799c8944a550
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F04%252Fc204aa29ddd38686e601dda0b8627f20%252Fpa%252FPL16151_ef2298d5c31eecf52f2a294753609297.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_ef2298d5c31eecf52f2a294753609297.jpg already downloaded
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F04%252Fc204aa29ddd38686e601dda0b8627f20%252Fpa%252FPL16151_d91df70d2ef8ac7cf8ba39d77c423369.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_d91df70d2ef8ac7cf8ba39d77c423369.jpg already downloaded
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F04%252Fc204aa29ddd38686e601dda0b8627f20%252Fpa%252FPL16151_ef8681b22585b31a0d84acf52679f82a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_ef8681b22585b31a0d84acf52679f82a.jpg already downloaded
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F04%252Fc204aa29ddd38686e601dda0b8627f20%252Fpa%252FPL16151_e21c66619c9d96483182b119d4307297.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_e21c66619c9d96483182b119d4307297.jpg already downloaded
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F04%252Fc204aa29ddd38686e601dda0b8627f20%252Fpa%252FPL16151_eca518d6160419f66ea0ce095c181bd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_eca518d6160419f66ea0ce095c181bd3.jpg already downloaded
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F04%252Fc204aa29ddd38686e601dda0b8627f20%252Fpa%252FPL16151_637749198e8e31fdf722e95735a5afe3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_637749198e8e31fdf722e95735a5afe3.jpg already downloaded
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F04%252Fc204aa29ddd38686e601dda0b8627f20%252Fpa%252FPL16151_9813222514ee3510166d77528b1c442d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_9813222514ee3510166d77528b1c442d.jpg already downloaded
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F04%252Fc204aa29ddd38686e601dda0b8627f20%252Fpa%252FPL16151_3f0352dd1a16b578fe3d4a40cc236730.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_3f0352dd1a16b578fe3d4a40cc236730.jpg already downloaded
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F04%252Fc204aa29ddd38686e601dda0b8627f20%252Fpa%252FPL16151_aec4a8ce6ad89cca16aee79f0148c80a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_aec4a8ce6ad89cca16aee79f0148c80a.jpg already downloaded
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F04%252Fc204aa29ddd38686e601dda0b8627f20%252Fpa%252FPL16151_af85c6c55f41a4f8a9e085272ff28d64.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_af85c6c55f41a4f8a9e085272ff28d64.jpg already downloaded
2026-03-28 18:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb54893d-3b8b-5cf8-b3c2-799c8944a550, identifier: PL16151
2026-03-28 18:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb54893d-3b8b-5cf8-b3c2-799c8944a550 with identifier: PL16151
2026-03-28 18:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb54893d-3b8b-5cf8-b3c2-799c8944a550 with identifier: PL16151
2026-03-28 18:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb54893d-3b8b-5cf8-b3c2-799c8944a550 with identifier: PL16151 to the API
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PL16151>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:50:46Z',
 'fuel_type': 'diesel',
 'id': 'bb54893d-3b8b-5cf8-b3c2-799c8944a550',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL16151',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'BMW',
 'model': '5er',
 'odometer': 247052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_ef2298d5c31eecf52f2a294753609297.jpg',
                'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_d91df70d2ef8ac7cf8ba39d77c423369.jpg',
                'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_ef8681b22585b31a0d84acf52679f82a.jpg',
                'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_e21c66619c9d96483182b119d4307297.jpg',
                'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_eca518d6160419f66ea0ce095c181bd3.jpg',
                'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_637749198e8e31fdf722e95735a5afe3.jpg',
                'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_9813222514ee3510166d77528b1c442d.jpg',
                'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_3f0352dd1a16b578fe3d4a40cc236730.jpg',
                'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_aec4a8ce6ad89cca16aee79f0148c80a.jpg',
                'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_af85c6c55f41a4f8a9e085272ff28d64.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb54893d-3b8b-5cf8-b3c2-799c8944a550/bb54893d-3b8b-5cf8-b3c2-799c8944a550_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2746511,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_ef2298d5c31eecf52f2a294753609297.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb54893d-3b8b-5cf8-b3c2-799c8944a550/bb54893d-3b8b-5cf8-b3c2-799c8944a550_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2792086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_d91df70d2ef8ac7cf8ba39d77c423369.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb54893d-3b8b-5cf8-b3c2-799c8944a550/bb54893d-3b8b-5cf8-b3c2-799c8944a550_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_ef8681b22585b31a0d84acf52679f82a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb54893d-3b8b-5cf8-b3c2-799c8944a550/bb54893d-3b8b-5cf8-b3c2-799c8944a550_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2754984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_e21c66619c9d96483182b119d4307297.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb54893d-3b8b-5cf8-b3c2-799c8944a550/bb54893d-3b8b-5cf8-b3c2-799c8944a550_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2768106,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_eca518d6160419f66ea0ce095c181bd3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb54893d-3b8b-5cf8-b3c2-799c8944a550/bb54893d-3b8b-5cf8-b3c2-799c8944a550_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2809265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_637749198e8e31fdf722e95735a5afe3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb54893d-3b8b-5cf8-b3c2-799c8944a550/bb54893d-3b8b-5cf8-b3c2-799c8944a550_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2644163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_9813222514ee3510166d77528b1c442d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb54893d-3b8b-5cf8-b3c2-799c8944a550/bb54893d-3b8b-5cf8-b3c2-799c8944a550_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_3f0352dd1a16b578fe3d4a40cc236730.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb54893d-3b8b-5cf8-b3c2-799c8944a550/bb54893d-3b8b-5cf8-b3c2-799c8944a550_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2523562,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_aec4a8ce6ad89cca16aee79f0148c80a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb54893d-3b8b-5cf8-b3c2-799c8944a550/bb54893d-3b8b-5cf8-b3c2-799c8944a550_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2825555,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/04/c204aa29ddd38686e601dda0b8627f20/pa/PL16151_af85c6c55f41a4f8a9e085272ff28d64.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 535d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL16151%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [auto1.de] INFO: Saving data for PL16151: {'created_time': 1774722963.04941, 'last_price_update_time': 1774722963.049424, 'auction_closing_time': 1774885846.0}
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL16151') HTTP/1.1" 204 0
2026-03-28 18:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e with identifier: BS91998
2026-03-28 18:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e with scrape type 1
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F15%252F3115ffc4e4b0a9ddf666bb750a6d866f%252Fpa%252FBS91998_5bf9b144f16324c65c472f70c4300b78.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_5bf9b144f16324c65c472f70c4300b78.jpg already downloaded
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F15%252F3115ffc4e4b0a9ddf666bb750a6d866f%252Fpa%252FBS91998_f57d44be8ffe6655eb957ee4d1ba938f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_f57d44be8ffe6655eb957ee4d1ba938f.jpg already downloaded
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F15%252F3115ffc4e4b0a9ddf666bb750a6d866f%252Fpa%252FBS91998_f2d50c0273ac0db2dcf537df6f672c3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_f2d50c0273ac0db2dcf537df6f672c3f.jpg already downloaded
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F15%252F3115ffc4e4b0a9ddf666bb750a6d866f%252Fpa%252FBS91998_e729907124f0b853613d161e3a0b557e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_e729907124f0b853613d161e3a0b557e.jpg already downloaded
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F15%252F3115ffc4e4b0a9ddf666bb750a6d866f%252Fpa%252FBS91998_ec915b67810e242bcb2e90607509453f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_ec915b67810e242bcb2e90607509453f.jpg already downloaded
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F15%252F3115ffc4e4b0a9ddf666bb750a6d866f%252Fpa%252FBS91998_8076d6f0195bf708176193266c9e1657.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_8076d6f0195bf708176193266c9e1657.jpg already downloaded
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F15%252F3115ffc4e4b0a9ddf666bb750a6d866f%252Fpa%252FBS91998_c4bd1b9aeca9f22c040c706f13aece7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_c4bd1b9aeca9f22c040c706f13aece7d.jpg already downloaded
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F15%252F3115ffc4e4b0a9ddf666bb750a6d866f%252Fpa%252FBS91998_e2c95bfca3bf735191ac90bd12b705f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_e2c95bfca3bf735191ac90bd12b705f1.jpg already downloaded
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F15%252F3115ffc4e4b0a9ddf666bb750a6d866f%252Fpa%252FBS91998_05c0835af91f736875c2bdba50a6e4cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_05c0835af91f736875c2bdba50a6e4cd.jpg already downloaded
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F15%252F3115ffc4e4b0a9ddf666bb750a6d866f%252Fpa%252FBS91998_e8f5269af0661fe61d92b4dde88730d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_e8f5269af0661fe61d92b4dde88730d7.jpg already downloaded
2026-03-28 18:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e, identifier: BS91998
2026-03-28 18:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d237a50-1c88-5565-a2a7-c77a816988be with identifier: FY57331
2026-03-28 18:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d237a50-1c88-5565-a2a7-c77a816988be with scrape type 1
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6d237a50-1c88-5565-a2a7-c77a816988be
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fad%252F84ad76a2e9633a04ad03a944b59b6633%252Fpa%252FFY57331_aa2f3c073ba9f3eb8969b9b3eaa06554.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_aa2f3c073ba9f3eb8969b9b3eaa06554.jpg already downloaded
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fad%252F84ad76a2e9633a04ad03a944b59b6633%252Fpa%252FFY57331_41913d79c199d09dd49f7674b62362a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_41913d79c199d09dd49f7674b62362a2.jpg already downloaded
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fad%252F84ad76a2e9633a04ad03a944b59b6633%252Fpa%252FFY57331_89191571386dc58fd69c80025fb283d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_89191571386dc58fd69c80025fb283d5.jpg already downloaded
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fad%252F84ad76a2e9633a04ad03a944b59b6633%252Fpa%252FFY57331_70017628985a263bafec7d010461b717.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_70017628985a263bafec7d010461b717.jpg already downloaded
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fad%252F84ad76a2e9633a04ad03a944b59b6633%252Fpa%252FFY57331_c66be2986e5f6cd1aa9cd79d3f8e63f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_c66be2986e5f6cd1aa9cd79d3f8e63f3.jpg already downloaded
2026-03-28 18:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d237a50-1c88-5565-a2a7-c77a816988be, identifier: FY57331
2026-03-28 18:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT85175> (referer: https://www.auto1.com/v1/car-details-view/LT85175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e with identifier: BS91998
2026-03-28 18:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e with identifier: BS91998
2026-03-28 18:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e with identifier: BS91998 to the API
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BS91998>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:08:54Z',
 'fuel_type': 'diesel',
 'id': '221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS91998',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 85922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_5bf9b144f16324c65c472f70c4300b78.jpg',
                'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_f57d44be8ffe6655eb957ee4d1ba938f.jpg',
                'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_f2d50c0273ac0db2dcf537df6f672c3f.jpg',
                'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_e729907124f0b853613d161e3a0b557e.jpg',
                'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_ec915b67810e242bcb2e90607509453f.jpg',
                'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_8076d6f0195bf708176193266c9e1657.jpg',
                'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_c4bd1b9aeca9f22c040c706f13aece7d.jpg',
                'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_e2c95bfca3bf735191ac90bd12b705f1.jpg',
                'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_05c0835af91f736875c2bdba50a6e4cd.jpg',
                'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_e8f5269af0661fe61d92b4dde88730d7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e/221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578275,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_5bf9b144f16324c65c472f70c4300b78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e/221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_f57d44be8ffe6655eb957ee4d1ba938f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e/221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_f2d50c0273ac0db2dcf537df6f672c3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e/221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2003190,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_e729907124f0b853613d161e3a0b557e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e/221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_ec915b67810e242bcb2e90607509453f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e/221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2274455,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_8076d6f0195bf708176193266c9e1657.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e/221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2203866,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_c4bd1b9aeca9f22c040c706f13aece7d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e/221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2339590,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_e2c95bfca3bf735191ac90bd12b705f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e/221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_05c0835af91f736875c2bdba50a6e4cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e/221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/15/3115ffc4e4b0a9ddf666bb750a6d866f/pa/BS91998_e8f5269af0661fe61d92b4dde88730d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2015}
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS91998%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [auto1.de] INFO: Saving data for BS91998: {'created_time': 1774722964.012114, 'last_price_update_time': 1774722964.01213, 'auction_closing_time': 1774883334.0}
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS91998') HTTP/1.1" 204 0
2026-03-28 18:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d237a50-1c88-5565-a2a7-c77a816988be with identifier: FY57331
2026-03-28 18:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d237a50-1c88-5565-a2a7-c77a816988be with identifier: FY57331
2026-03-28 18:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d237a50-1c88-5565-a2a7-c77a816988be with identifier: FY57331 to the API
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FY57331>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': 'Rental',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:29:39Z',
 'fuel_type': 'petrol',
 'id': '6d237a50-1c88-5565-a2a7-c77a816988be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY57331',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 334384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_aa2f3c073ba9f3eb8969b9b3eaa06554.jpg',
                'https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_41913d79c199d09dd49f7674b62362a2.jpg',
                'https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_89191571386dc58fd69c80025fb283d5.jpg',
                'https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_70017628985a263bafec7d010461b717.jpg',
                'https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_c66be2986e5f6cd1aa9cd79d3f8e63f3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d237a50-1c88-5565-a2a7-c77a816988be/6d237a50-1c88-5565-a2a7-c77a816988be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_aa2f3c073ba9f3eb8969b9b3eaa06554.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d237a50-1c88-5565-a2a7-c77a816988be/6d237a50-1c88-5565-a2a7-c77a816988be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_41913d79c199d09dd49f7674b62362a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d237a50-1c88-5565-a2a7-c77a816988be/6d237a50-1c88-5565-a2a7-c77a816988be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_89191571386dc58fd69c80025fb283d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d237a50-1c88-5565-a2a7-c77a816988be/6d237a50-1c88-5565-a2a7-c77a816988be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_70017628985a263bafec7d010461b717.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d237a50-1c88-5565-a2a7-c77a816988be/6d237a50-1c88-5565-a2a7-c77a816988be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/ad/84ad76a2e9633a04ad03a944b59b6633/pa/FY57331_c66be2986e5f6cd1aa9cd79d3f8e63f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2008}
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57331%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [auto1.de] INFO: Saving data for FY57331: {'created_time': 1774722964.40495, 'last_price_update_time': 1774722964.404963, 'auction_closing_time': 1774884579.0}
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY57331') HTTP/1.1" 204 0
2026-03-28 18:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd6f1c8c-cee5-5659-828f-7dc4be9827a2 with identifier: LT85175
2026-03-28 18:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd6f1c8c-cee5-5659-828f-7dc4be9827a2 with scrape type 1
2026-03-28 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd6f1c8c-cee5-5659-828f-7dc4be9827a2
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F3f%252F573f310f22ea6cd736fff2d37118d4ec%252Fpa%252FLT85175_895339736aa4cf4ced547c6b3c1677b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_895339736aa4cf4ced547c6b3c1677b2.jpg already downloaded
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F3f%252F573f310f22ea6cd736fff2d37118d4ec%252Fpa%252FLT85175_3df98626ee3795a2bfa29b5357eddf0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_3df98626ee3795a2bfa29b5357eddf0a.jpg already downloaded
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F3f%252F573f310f22ea6cd736fff2d37118d4ec%252Fpa%252FLT85175_52f2c7cf57453c6808dab2492abf2a6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_52f2c7cf57453c6808dab2492abf2a6d.jpg already downloaded
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F3f%252F573f310f22ea6cd736fff2d37118d4ec%252Fpa%252FLT85175_e1f8000f102a2f42176b8e1b51dda926.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_e1f8000f102a2f42176b8e1b51dda926.jpg already downloaded
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F3f%252F573f310f22ea6cd736fff2d37118d4ec%252Fpa%252FLT85175_7300da36dc14191e65e37383aad6ad0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_7300da36dc14191e65e37383aad6ad0f.jpg already downloaded
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F3f%252F573f310f22ea6cd736fff2d37118d4ec%252Fpa%252FLT85175_a1e60f8134d3788eb574220e25259ceb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_a1e60f8134d3788eb574220e25259ceb.jpg already downloaded
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F3f%252F573f310f22ea6cd736fff2d37118d4ec%252Fpa%252FLT85175_e795126c5943fe3d198c4f206cb6c383.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_e795126c5943fe3d198c4f206cb6c383.jpg already downloaded
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F3f%252F573f310f22ea6cd736fff2d37118d4ec%252Fpa%252FLT85175_2321f4eac6cc47be2e333bbc5d455cd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_2321f4eac6cc47be2e333bbc5d455cd3.jpg already downloaded
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F3f%252F573f310f22ea6cd736fff2d37118d4ec%252Fpa%252FLT85175_47633c3c8c8265fe6f4a61736d346529.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_47633c3c8c8265fe6f4a61736d346529.jpg already downloaded
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F3f%252F573f310f22ea6cd736fff2d37118d4ec%252Fpa%252FLT85175_80c183b307ff4ede66c0a4dae2966583.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_80c183b307ff4ede66c0a4dae2966583.jpg already downloaded
2026-03-28 18:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd6f1c8c-cee5-5659-828f-7dc4be9827a2, identifier: LT85175
2026-03-28 18:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd6f1c8c-cee5-5659-828f-7dc4be9827a2 with identifier: LT85175
2026-03-28 18:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd6f1c8c-cee5-5659-828f-7dc4be9827a2 with identifier: LT85175
2026-03-28 18:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd6f1c8c-cee5-5659-828f-7dc4be9827a2 with identifier: LT85175 to the API
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LT85175>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:02:14Z',
 'fuel_type': 'petrol',
 'id': 'dd6f1c8c-cee5-5659-828f-7dc4be9827a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT85175',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 62229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_895339736aa4cf4ced547c6b3c1677b2.jpg',
                'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_3df98626ee3795a2bfa29b5357eddf0a.jpg',
                'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_52f2c7cf57453c6808dab2492abf2a6d.jpg',
                'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_e1f8000f102a2f42176b8e1b51dda926.jpg',
                'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_7300da36dc14191e65e37383aad6ad0f.jpg',
                'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_a1e60f8134d3788eb574220e25259ceb.jpg',
                'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_e795126c5943fe3d198c4f206cb6c383.jpg',
                'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_2321f4eac6cc47be2e333bbc5d455cd3.jpg',
                'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_47633c3c8c8265fe6f4a61736d346529.jpg',
                'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_80c183b307ff4ede66c0a4dae2966583.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6f1c8c-cee5-5659-828f-7dc4be9827a2/dd6f1c8c-cee5-5659-828f-7dc4be9827a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_895339736aa4cf4ced547c6b3c1677b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6f1c8c-cee5-5659-828f-7dc4be9827a2/dd6f1c8c-cee5-5659-828f-7dc4be9827a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_3df98626ee3795a2bfa29b5357eddf0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6f1c8c-cee5-5659-828f-7dc4be9827a2/dd6f1c8c-cee5-5659-828f-7dc4be9827a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_52f2c7cf57453c6808dab2492abf2a6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6f1c8c-cee5-5659-828f-7dc4be9827a2/dd6f1c8c-cee5-5659-828f-7dc4be9827a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_e1f8000f102a2f42176b8e1b51dda926.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6f1c8c-cee5-5659-828f-7dc4be9827a2/dd6f1c8c-cee5-5659-828f-7dc4be9827a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_7300da36dc14191e65e37383aad6ad0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6f1c8c-cee5-5659-828f-7dc4be9827a2/dd6f1c8c-cee5-5659-828f-7dc4be9827a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_a1e60f8134d3788eb574220e25259ceb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6f1c8c-cee5-5659-828f-7dc4be9827a2/dd6f1c8c-cee5-5659-828f-7dc4be9827a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_e795126c5943fe3d198c4f206cb6c383.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6f1c8c-cee5-5659-828f-7dc4be9827a2/dd6f1c8c-cee5-5659-828f-7dc4be9827a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_2321f4eac6cc47be2e333bbc5d455cd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6f1c8c-cee5-5659-828f-7dc4be9827a2/dd6f1c8c-cee5-5659-828f-7dc4be9827a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_47633c3c8c8265fe6f4a61736d346529.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6f1c8c-cee5-5659-828f-7dc4be9827a2/dd6f1c8c-cee5-5659-828f-7dc4be9827a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/3f/573f310f22ea6cd736fff2d37118d4ec/pa/LT85175_80c183b307ff4ede66c0a4dae2966583.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Celebration',
 'transmission': 'manual',
 'trim': 'Stepway Celebration',
 'year': 2017}
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT85175%27 HTTP/1.1" 200 None
2026-03-28 18:36:05 [auto1.de] INFO: Saving data for LT85175: {'created_time': 1774722965.120889, 'last_price_update_time': 1774722965.120899, 'auction_closing_time': 1774882934.0}
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT85175') HTTP/1.1" 204 0
2026-03-28 18:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB31619> (referer: https://www.auto1.com/v1/car-details-view/XB31619/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8b67f3-82be-5fff-a8e8-17f57bef89e9 with identifier: XB31619
2026-03-28 18:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8b67f3-82be-5fff-a8e8-17f57bef89e9 with scrape type 1
2026-03-28 18:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac8b67f3-82be-5fff-a8e8-17f57bef89e9
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F03%252F550352b22e6b015f129eb094db9041b6%252Fpa%252FXB31619_1396f236668b6da726bd86ac52e7b639.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_1396f236668b6da726bd86ac52e7b639.jpg already downloaded
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F03%252F550352b22e6b015f129eb094db9041b6%252Fpa%252FXB31619_f64545e15f19cf30799bd0158586687c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_f64545e15f19cf30799bd0158586687c.jpg already downloaded
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F03%252F550352b22e6b015f129eb094db9041b6%252Fpa%252FXB31619_aa5d93c6d5388448d94aae0b37a80f48.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_aa5d93c6d5388448d94aae0b37a80f48.jpg already downloaded
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F03%252F550352b22e6b015f129eb094db9041b6%252Fpa%252FXB31619_9276fd0d8189d84f83a40e6ab5961f45.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_9276fd0d8189d84f83a40e6ab5961f45.jpg already downloaded
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F03%252F550352b22e6b015f129eb094db9041b6%252Fpa%252FXB31619_b79268968ba3559adb9df2307dde68f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_b79268968ba3559adb9df2307dde68f6.jpg already downloaded
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F03%252F550352b22e6b015f129eb094db9041b6%252Fpa%252FXB31619_00d2b62f3ad030de5f518c637a018b29.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_00d2b62f3ad030de5f518c637a018b29.jpg already downloaded
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F03%252F550352b22e6b015f129eb094db9041b6%252Fpa%252FXB31619_60724da90f49805a73b37d0aa4c20c9b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_60724da90f49805a73b37d0aa4c20c9b.jpg already downloaded
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F03%252F550352b22e6b015f129eb094db9041b6%252Fpa%252FXB31619_efd929d5a989efe23e5a48c1002819de.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_efd929d5a989efe23e5a48c1002819de.jpg already downloaded
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F03%252F550352b22e6b015f129eb094db9041b6%252Fpa%252FXB31619_27cb745c77da2d0e2eca3e1acf8ba67a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_27cb745c77da2d0e2eca3e1acf8ba67a.jpg already downloaded
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F03%252F550352b22e6b015f129eb094db9041b6%252Fpa%252FXB31619_cf31240abde5169f7bb8c7afd3c16c92.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_cf31240abde5169f7bb8c7afd3c16c92.jpg already downloaded
2026-03-28 18:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac8b67f3-82be-5fff-a8e8-17f57bef89e9, identifier: XB31619
2026-03-28 18:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac8b67f3-82be-5fff-a8e8-17f57bef89e9 with identifier: XB31619
2026-03-28 18:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac8b67f3-82be-5fff-a8e8-17f57bef89e9 with identifier: XB31619
2026-03-28 18:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac8b67f3-82be-5fff-a8e8-17f57bef89e9 with identifier: XB31619 to the API
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XB31619>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:13:25Z',
 'fuel_type': 'petrol',
 'id': 'ac8b67f3-82be-5fff-a8e8-17f57bef89e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB31619',
 'listing': 'auction',
 'location': 'DE, Kitzingen',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 91246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_1396f236668b6da726bd86ac52e7b639.jpg',
                'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_f64545e15f19cf30799bd0158586687c.jpg',
                'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_aa5d93c6d5388448d94aae0b37a80f48.jpg',
                'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_9276fd0d8189d84f83a40e6ab5961f45.jpg',
                'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_b79268968ba3559adb9df2307dde68f6.jpg',
                'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_00d2b62f3ad030de5f518c637a018b29.jpg',
                'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_60724da90f49805a73b37d0aa4c20c9b.jpg',
                'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_efd929d5a989efe23e5a48c1002819de.jpg',
                'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_27cb745c77da2d0e2eca3e1acf8ba67a.jpg',
                'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_cf31240abde5169f7bb8c7afd3c16c92.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b67f3-82be-5fff-a8e8-17f57bef89e9/ac8b67f3-82be-5fff-a8e8-17f57bef89e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2635499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_1396f236668b6da726bd86ac52e7b639.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b67f3-82be-5fff-a8e8-17f57bef89e9/ac8b67f3-82be-5fff-a8e8-17f57bef89e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2544977,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_f64545e15f19cf30799bd0158586687c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b67f3-82be-5fff-a8e8-17f57bef89e9/ac8b67f3-82be-5fff-a8e8-17f57bef89e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570198,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_aa5d93c6d5388448d94aae0b37a80f48.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b67f3-82be-5fff-a8e8-17f57bef89e9/ac8b67f3-82be-5fff-a8e8-17f57bef89e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2326938,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_9276fd0d8189d84f83a40e6ab5961f45.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b67f3-82be-5fff-a8e8-17f57bef89e9/ac8b67f3-82be-5fff-a8e8-17f57bef89e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577790,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_b79268968ba3559adb9df2307dde68f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b67f3-82be-5fff-a8e8-17f57bef89e9/ac8b67f3-82be-5fff-a8e8-17f57bef89e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_00d2b62f3ad030de5f518c637a018b29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b67f3-82be-5fff-a8e8-17f57bef89e9/ac8b67f3-82be-5fff-a8e8-17f57bef89e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_60724da90f49805a73b37d0aa4c20c9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b67f3-82be-5fff-a8e8-17f57bef89e9/ac8b67f3-82be-5fff-a8e8-17f57bef89e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2000912,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_efd929d5a989efe23e5a48c1002819de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b67f3-82be-5fff-a8e8-17f57bef89e9/ac8b67f3-82be-5fff-a8e8-17f57bef89e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2354708,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_27cb745c77da2d0e2eca3e1acf8ba67a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8b67f3-82be-5fff-a8e8-17f57bef89e9/ac8b67f3-82be-5fff-a8e8-17f57bef89e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829346,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/03/550352b22e6b015f129eb094db9041b6/pa/XB31619_cf31240abde5169f7bb8c7afd3c16c92.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2021}
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB31619%27 HTTP/1.1" 200 None
2026-03-28 18:36:06 [auto1.de] INFO: Saving data for XB31619: {'created_time': 1774722966.799481, 'last_price_update_time': 1774722966.799493, 'auction_closing_time': 1774883605.0}
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB31619') HTTP/1.1" 204 0
2026-03-28 18:36:06 [scrapy.extensions.logstats] INFO: Crawled 42 pages (at 42 pages/min), scraped 84 items (at 84 items/min)
2026-03-28 18:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-28 18:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:14 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:14 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-28 18:36:14 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-28 18:36:14 [auto1.de] INFO: Found listing with ID: NR54362
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR54362%27 HTTP/1.1" 200 None
2026-03-28 18:36:14 [auto1.de] INFO: Scrape type for NR54362: 1
2026-03-28 18:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:14 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA55761%27 HTTP/1.1" 200 None
2026-03-28 18:36:14 [auto1.de] INFO: Scrape type for BA55761: 0
2026-03-28 18:36:14 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-28 18:36:14 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU72162%27 HTTP/1.1" 200 None
2026-03-28 18:36:14 [auto1.de] INFO: Scrape type for PU72162: 0
2026-03-28 18:36:14 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS51511%27 HTTP/1.1" 200 None
2026-03-28 18:36:14 [auto1.de] INFO: Scrape type for WS51511: 0
2026-03-28 18:36:14 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48993%27 HTTP/1.1" 200 None
2026-03-28 18:36:14 [auto1.de] INFO: Scrape type for WP48993: 2
2026-03-28 18:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49459b97-75bf-558e-9c7e-010c02ad240e with identifier: WP48993
2026-03-28 18:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49459b97-75bf-558e-9c7e-010c02ad240e with scrape type 2
2026-03-28 18:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49459b97-75bf-558e-9c7e-010c02ad240e with scrape type 2
2026-03-28 18:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49459b97-75bf-558e-9c7e-010c02ad240e, identifier: WP48993
2026-03-28 18:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49459b97-75bf-558e-9c7e-010c02ad240e with identifier: WP48993
2026-03-28 18:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49459b97-75bf-558e-9c7e-010c02ad240e with identifier: WP48993
2026-03-28 18:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49459b97-75bf-558e-9c7e-010c02ad240e with identifier: WP48993 to the API
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:37:21Z',
 'fuel_type': 'hybrid',
 'id': '49459b97-75bf-558e-9c7e-010c02ad240e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP48993',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 82247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-04',
 'seller_name': None,
 'title': 'BMW 5er 530e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48993%27 HTTP/1.1" 200 None
2026-03-28 18:36:14 [auto1.de] INFO: Saving data for WP48993: {'auction_closing_time': 1774885041.0, 'created_time': 1774522244.533686, 'last_price_update_time': 1774722974.778861}
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP48993') HTTP/1.1" 204 0
2026-03-28 18:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:14 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ26621%27 HTTP/1.1" 200 None
2026-03-28 18:36:14 [auto1.de] INFO: Scrape type for GJ26621: 2
2026-03-28 18:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 319f1e69-4a71-5eb0-ba79-cf27219264b2 with identifier: GJ26621
2026-03-28 18:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 319f1e69-4a71-5eb0-ba79-cf27219264b2 with scrape type 2
2026-03-28 18:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 319f1e69-4a71-5eb0-ba79-cf27219264b2 with scrape type 2
2026-03-28 18:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 319f1e69-4a71-5eb0-ba79-cf27219264b2, identifier: GJ26621
2026-03-28 18:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 319f1e69-4a71-5eb0-ba79-cf27219264b2 with identifier: GJ26621
2026-03-28 18:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 319f1e69-4a71-5eb0-ba79-cf27219264b2 with identifier: GJ26621
2026-03-28 18:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 319f1e69-4a71-5eb0-ba79-cf27219264b2 with identifier: GJ26621 to the API
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:11:49Z',
 'fuel_type': 'petrol',
 'id': '319f1e69-4a71-5eb0-ba79-cf27219264b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ26621',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 158933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-04',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Rip Curl',
 'transmission': 'manual',
 'trim': 'Rip Curl',
 'year': 2007}
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ26621%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Saving data for GJ26621: {'auction_closing_time': 1774883509.0, 'created_time': 1773428533.767207, 'last_price_update_time': 1774722975.343232}
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ26621') HTTP/1.1" 204 0
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS95970%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Scrape type for LS95970: 0
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU40538%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Scrape type for BU40538: 0
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT21278%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Scrape type for KT21278: 2
2026-03-28 18:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa19068a-47ae-5428-a87d-12588a51a103 with identifier: KT21278
2026-03-28 18:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa19068a-47ae-5428-a87d-12588a51a103 with scrape type 2
2026-03-28 18:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa19068a-47ae-5428-a87d-12588a51a103 with scrape type 2
2026-03-28 18:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa19068a-47ae-5428-a87d-12588a51a103, identifier: KT21278
2026-03-28 18:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa19068a-47ae-5428-a87d-12588a51a103 with identifier: KT21278
2026-03-28 18:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa19068a-47ae-5428-a87d-12588a51a103 with identifier: KT21278
2026-03-28 18:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa19068a-47ae-5428-a87d-12588a51a103 with identifier: KT21278 to the API
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:45:18Z',
 'fuel_type': 'diesel',
 'id': 'fa19068a-47ae-5428-a87d-12588a51a103',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT21278',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 240033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-12',
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 DDiS Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2015}
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT21278%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Saving data for KT21278: {'auction_closing_time': 1774885518.0, 'created_time': 1774522481.556691, 'last_price_update_time': 1774722975.784702}
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT21278') HTTP/1.1" 204 0
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ75608%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Scrape type for ZZ75608: 0
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42521%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Scrape type for BZ42521: 0
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB76223%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Scrape type for NB76223: 0
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86421%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Scrape type for PC86421: 0
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT11127%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Scrape type for WT11127: 0
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY81856%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Scrape type for NY81856: 0
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55546%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Scrape type for SY55546: 0
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10723%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Scrape type for PA10723: 0
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-28 18:36:15 [auto1.de] INFO: Found listing with ID: UV10868
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV10868%27 HTTP/1.1" 200 None
2026-03-28 18:36:15 [auto1.de] INFO: Scrape type for UV10868: 2
2026-03-28 18:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b with identifier: UV10868
2026-03-28 18:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b with scrape type 2
2026-03-28 18:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b with scrape type 2
2026-03-28 18:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b, identifier: UV10868
2026-03-28 18:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b with identifier: UV10868
2026-03-28 18:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b with identifier: UV10868
2026-03-28 18:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b with identifier: UV10868 to the API
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:21:45Z',
 'fuel_type': 'diesel',
 'id': 'a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV10868',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 154362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-24',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 250 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2012}
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV10868%27 HTTP/1.1" 200 None
2026-03-28 18:36:16 [auto1.de] INFO: Saving data for UV10868: {'auction_closing_time': 1774884105.0, 'created_time': 1774031937.953908, 'last_price_update_time': 1774722976.38678}
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV10868') HTTP/1.1" 204 0
2026-03-28 18:36:16 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-28 18:36:16 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ74816%27 HTTP/1.1" 200 None
2026-03-28 18:36:16 [auto1.de] INFO: Scrape type for ZZ74816: 2
2026-03-28 18:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d8ee31-fc06-59bb-b40e-9cd0dca274ae with identifier: ZZ74816
2026-03-28 18:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d8ee31-fc06-59bb-b40e-9cd0dca274ae with scrape type 2
2026-03-28 18:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6d8ee31-fc06-59bb-b40e-9cd0dca274ae with scrape type 2
2026-03-28 18:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6d8ee31-fc06-59bb-b40e-9cd0dca274ae, identifier: ZZ74816
2026-03-28 18:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6d8ee31-fc06-59bb-b40e-9cd0dca274ae with identifier: ZZ74816
2026-03-28 18:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6d8ee31-fc06-59bb-b40e-9cd0dca274ae with identifier: ZZ74816
2026-03-28 18:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6d8ee31-fc06-59bb-b40e-9cd0dca274ae with identifier: ZZ74816 to the API
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:33:30Z',
 'fuel_type': 'diesel',
 'id': 'e6d8ee31-fc06-59bb-b40e-9cd0dca274ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ74816',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 315136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-14',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 319 CDI RWD L2',
 'transmission': 'automatic',
 'trim': 'RWD L2',
 'year': 2021}
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ74816%27 HTTP/1.1" 200 None
2026-03-28 18:36:16 [auto1.de] INFO: Saving data for ZZ74816: {'auction_closing_time': 1774884810.0, 'created_time': 1773305968.883548, 'last_price_update_time': 1774722976.928985}
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ74816') HTTP/1.1" 204 0
2026-03-28 18:36:16 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-28 18:36:16 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-28 18:36:16 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-28 18:36:16 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-28 18:36:16 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP43844%27 HTTP/1.1" 200 None
2026-03-28 18:36:16 [auto1.de] INFO: Scrape type for RP43844: 2
2026-03-28 18:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 088df3e3-9235-5b9d-a75d-1adfcfabf07a with identifier: RP43844
2026-03-28 18:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 088df3e3-9235-5b9d-a75d-1adfcfabf07a with scrape type 2
2026-03-28 18:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 088df3e3-9235-5b9d-a75d-1adfcfabf07a with scrape type 2
2026-03-28 18:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 088df3e3-9235-5b9d-a75d-1adfcfabf07a, identifier: RP43844
2026-03-28 18:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 088df3e3-9235-5b9d-a75d-1adfcfabf07a with identifier: RP43844
2026-03-28 18:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 088df3e3-9235-5b9d-a75d-1adfcfabf07a with identifier: RP43844
2026-03-28 18:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 088df3e3-9235-5b9d-a75d-1adfcfabf07a with identifier: RP43844 to the API
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:44:37Z',
 'fuel_type': 'diesel',
 'id': '088df3e3-9235-5b9d-a75d-1adfcfabf07a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP43844',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 242153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-26',
 'seller_name': None,
 'title': 'Ford S-Max 2.2 TDCi Titanium S',
 'transmission': 'manual',
 'trim': 'Titanium S',
 'year': 2009}
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP43844%27 HTTP/1.1" 200 None
2026-03-28 18:36:17 [auto1.de] INFO: Saving data for RP43844: {'auction_closing_time': 1774885477.0, 'created_time': 1774521789.034606, 'last_price_update_time': 1774722977.369772}
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP43844') HTTP/1.1" 204 0
2026-03-28 18:36:17 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-28 18:36:17 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT27249%27 HTTP/1.1" 200 None
2026-03-28 18:36:17 [auto1.de] INFO: Scrape type for UT27249: 0
2026-03-28 18:36:17 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-28 18:36:17 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD55328%27 HTTP/1.1" 200 None
2026-03-28 18:36:17 [auto1.de] INFO: Scrape type for YD55328: 0
2026-03-28 18:36:17 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG27498%27 HTTP/1.1" 200 None
2026-03-28 18:36:17 [auto1.de] INFO: Scrape type for WG27498: 2
2026-03-28 18:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab57346c-902d-5270-9bcf-0bc1117b2856 with identifier: WG27498
2026-03-28 18:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab57346c-902d-5270-9bcf-0bc1117b2856 with scrape type 2
2026-03-28 18:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab57346c-902d-5270-9bcf-0bc1117b2856 with scrape type 2
2026-03-28 18:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab57346c-902d-5270-9bcf-0bc1117b2856, identifier: WG27498
2026-03-28 18:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab57346c-902d-5270-9bcf-0bc1117b2856 with identifier: WG27498
2026-03-28 18:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab57346c-902d-5270-9bcf-0bc1117b2856 with identifier: WG27498
2026-03-28 18:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab57346c-902d-5270-9bcf-0bc1117b2856 with identifier: WG27498 to the API
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:36:51Z',
 'fuel_type': 'petrol',
 'id': 'ab57346c-902d-5270-9bcf-0bc1117b2856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG27498',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 107790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2004}
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG27498%27 HTTP/1.1" 200 None
2026-03-28 18:36:17 [auto1.de] INFO: Saving data for WG27498: {'auction_closing_time': 1774885011.0, 'created_time': 1774522478.641982, 'last_price_update_time': 1774722977.868074}
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG27498') HTTP/1.1" 204 0
2026-03-28 18:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:18 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: JV22464
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: GY48177
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC88789%27 HTTP/1.1" 200 None
2026-03-28 18:36:18 [auto1.de] INFO: Scrape type for HC88789: 0
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC14398%27 HTTP/1.1" 200 None
2026-03-28 18:36:18 [auto1.de] INFO: Scrape type for JC14398: 2
2026-03-28 18:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with identifier: JC14398
2026-03-28 18:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with scrape type 2
2026-03-28 18:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with scrape type 2
2026-03-28 18:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f, identifier: JC14398
2026-03-28 18:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with identifier: JC14398
2026-03-28 18:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with identifier: JC14398
2026-03-28 18:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with identifier: JC14398 to the API
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:20:58Z',
 'fuel_type': 'diesel',
 'id': 'aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC14398',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 125673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC14398%27 HTTP/1.1" 200 None
2026-03-28 18:36:18 [auto1.de] INFO: Saving data for JC14398: {'auction_closing_time': 1774884058.0, 'created_time': 1773861772.827467, 'last_price_update_time': 1774722978.713961}
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC14398') HTTP/1.1" 204 0
2026-03-28 18:36:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS56228%27 HTTP/1.1" 200 None
2026-03-28 18:36:18 [auto1.de] INFO: Scrape type for LS56228: 0
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ71304%27 HTTP/1.1" 200 None
2026-03-28 18:36:18 [auto1.de] INFO: Scrape type for ZZ71304: 0
2026-03-28 18:36:18 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN76006%27 HTTP/1.1" 200 None
2026-03-28 18:36:18 [auto1.de] INFO: Scrape type for LN76006: 2
2026-03-28 18:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 827e53f6-71f1-56d4-836d-e4df1f3968a1 with identifier: LN76006
2026-03-28 18:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 827e53f6-71f1-56d4-836d-e4df1f3968a1 with scrape type 2
2026-03-28 18:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 827e53f6-71f1-56d4-836d-e4df1f3968a1 with scrape type 2
2026-03-28 18:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 827e53f6-71f1-56d4-836d-e4df1f3968a1, identifier: LN76006
2026-03-28 18:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 827e53f6-71f1-56d4-836d-e4df1f3968a1 with identifier: LN76006
2026-03-28 18:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 827e53f6-71f1-56d4-836d-e4df1f3968a1 with identifier: LN76006
2026-03-28 18:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 827e53f6-71f1-56d4-836d-e4df1f3968a1 with identifier: LN76006 to the API
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:29:41Z',
 'fuel_type': 'petrol',
 'id': '827e53f6-71f1-56d4-836d-e4df1f3968a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN76006',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 42146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-05',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN76006%27 HTTP/1.1" 200 None
2026-03-28 18:36:19 [auto1.de] INFO: Saving data for LN76006: {'auction_closing_time': 1774884581.0, 'created_time': 1774522260.039164, 'last_price_update_time': 1774722979.293877}
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN76006') HTTP/1.1" 204 0
2026-03-28 18:36:19 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU86908%27 HTTP/1.1" 200 None
2026-03-28 18:36:19 [auto1.de] INFO: Scrape type for CU86908: 0
2026-03-28 18:36:19 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM14062%27 HTTP/1.1" 200 None
2026-03-28 18:36:19 [auto1.de] INFO: Scrape type for JM14062: 0
2026-03-28 18:36:19 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-28 18:36:19 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-28 18:36:19 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-28 18:36:19 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA96746%27 HTTP/1.1" 200 None
2026-03-28 18:36:19 [auto1.de] INFO: Scrape type for SA96746: 0
2026-03-28 18:36:19 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-28 18:36:19 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36621%27 HTTP/1.1" 200 None
2026-03-28 18:36:19 [auto1.de] INFO: Scrape type for ZE36621: 2
2026-03-28 18:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e609153-b640-5eba-a52a-66dc06e6e251 with identifier: ZE36621
2026-03-28 18:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e609153-b640-5eba-a52a-66dc06e6e251 with scrape type 2
2026-03-28 18:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e609153-b640-5eba-a52a-66dc06e6e251 with scrape type 2
2026-03-28 18:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e609153-b640-5eba-a52a-66dc06e6e251, identifier: ZE36621
2026-03-28 18:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR54362/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e609153-b640-5eba-a52a-66dc06e6e251 with identifier: ZE36621
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 18:36:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e609153-b640-5eba-a52a-66dc06e6e251 with identifier: ZE36621
2026-03-28 18:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e609153-b640-5eba-a52a-66dc06e6e251 with identifier: ZE36621 to the API
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 381,
 'expiration_date': '2026-03-30T15:01:54Z',
 'fuel_type': 'hybrid',
 'id': '3e609153-b640-5eba-a52a-66dc06e6e251',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE36621',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 9299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-02',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2023}
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36621%27 HTTP/1.1" 200 None
2026-03-28 18:36:20 [auto1.de] INFO: Saving data for ZE36621: {'auction_closing_time': 1774882914.0, 'created_time': 1774522255.372006, 'last_price_update_time': 1774722980.088682}
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE36621') HTTP/1.1" 204 0
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ79355%27 HTTP/1.1" 200 None
2026-03-28 18:36:20 [auto1.de] INFO: Scrape type for HJ79355: 0
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB27474%27 HTTP/1.1" 200 None
2026-03-28 18:36:20 [auto1.de] INFO: Scrape type for HB27474: 0
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ86499%27 HTTP/1.1" 200 None
2026-03-28 18:36:20 [auto1.de] INFO: Scrape type for BZ86499: 0
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ46710%27 HTTP/1.1" 200 None
2026-03-28 18:36:20 [auto1.de] INFO: Scrape type for XZ46710: 0
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR69964%27 HTTP/1.1" 200 None
2026-03-28 18:36:20 [auto1.de] INFO: Scrape type for XR69964: 0
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY45109%27 HTTP/1.1" 200 None
2026-03-28 18:36:20 [auto1.de] INFO: Scrape type for EY45109: 0
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ72675%27 HTTP/1.1" 200 None
2026-03-28 18:36:20 [auto1.de] INFO: Scrape type for NZ72675: 0
2026-03-28 18:36:20 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG31023%27 HTTP/1.1" 200 None
2026-03-28 18:36:20 [auto1.de] INFO: Scrape type for EG31023: 2
2026-03-28 18:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2d629e-f7bd-5759-a148-41bc07909644 with identifier: EG31023
2026-03-28 18:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2d629e-f7bd-5759-a148-41bc07909644 with scrape type 2
2026-03-28 18:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d2d629e-f7bd-5759-a148-41bc07909644 with scrape type 2
2026-03-28 18:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d2d629e-f7bd-5759-a148-41bc07909644, identifier: EG31023
2026-03-28 18:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d2d629e-f7bd-5759-a148-41bc07909644 with identifier: EG31023
2026-03-28 18:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d2d629e-f7bd-5759-a148-41bc07909644 with identifier: EG31023
2026-03-28 18:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d2d629e-f7bd-5759-a148-41bc07909644 with identifier: EG31023 to the API
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 389,
 'expiration_date': '2026-03-30T15:48:59Z',
 'fuel_type': 'petrol',
 'id': '3d2d629e-f7bd-5759-a148-41bc07909644',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG31023',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 145862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-14',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 450 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG31023%27 HTTP/1.1" 200 None
2026-03-28 18:36:20 [auto1.de] INFO: Saving data for EG31023: {'auction_closing_time': 1774885739.0, 'created_time': 1773686325.407926, 'last_price_update_time': 1774722980.768163}
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG31023') HTTP/1.1" 204 0
2026-03-28 18:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR54362> (referer: https://www.auto1.com/v1/car-details-view/NR54362/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec0656b6-591f-56f2-b658-d83dbc88acae with identifier: NR54362
2026-03-28 18:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec0656b6-591f-56f2-b658-d83dbc88acae with scrape type 1
2026-03-28 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec0656b6-591f-56f2-b658-d83dbc88acae
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F13%252F01139feedc0296d543f866fafb30d44a%252Fpa%252FNR54362_fed5fd9e236ca762dcfe01781137eed7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_fed5fd9e236ca762dcfe01781137eed7.jpg already downloaded
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F13%252F01139feedc0296d543f866fafb30d44a%252Fpa%252FNR54362_745c21cec4f1db0b5b30100f0b44fa1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_745c21cec4f1db0b5b30100f0b44fa1b.jpg already downloaded
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F13%252F01139feedc0296d543f866fafb30d44a%252Fpa%252FNR54362_9dbaac0318b142471472f0457d70b177.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_9dbaac0318b142471472f0457d70b177.jpg already downloaded
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F13%252F01139feedc0296d543f866fafb30d44a%252Fpa%252FNR54362_d5f9bf80fe6406e997b0c41a377ab730.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_d5f9bf80fe6406e997b0c41a377ab730.jpg already downloaded
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F13%252F01139feedc0296d543f866fafb30d44a%252Fpa%252FNR54362_f86a23e515d6667901e0b7732e83aac0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_f86a23e515d6667901e0b7732e83aac0.jpg already downloaded
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F13%252F01139feedc0296d543f866fafb30d44a%252Fpa%252FNR54362_66e3b2321466222e0fae0e4a5b8dc14f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_66e3b2321466222e0fae0e4a5b8dc14f.jpg already downloaded
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F13%252F01139feedc0296d543f866fafb30d44a%252Fpa%252FNR54362_3f61df42a5cf1f1fa00fe8399fc6fdb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_3f61df42a5cf1f1fa00fe8399fc6fdb6.jpg already downloaded
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F13%252F01139feedc0296d543f866fafb30d44a%252Fpa%252FNR54362_7fa7f473e682c09eb982e0aacc93d7be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_7fa7f473e682c09eb982e0aacc93d7be.jpg already downloaded
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F13%252F01139feedc0296d543f866fafb30d44a%252Fpa%252FNR54362_c4d76c9b30355836af4e728c0e1b72d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_c4d76c9b30355836af4e728c0e1b72d9.jpg already downloaded
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F13%252F01139feedc0296d543f866fafb30d44a%252Fpa%252FNR54362_2d17b575629ea6245a6fbbfe968b135c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_2d17b575629ea6245a6fbbfe968b135c.jpg already downloaded
2026-03-28 18:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec0656b6-591f-56f2-b658-d83dbc88acae, identifier: NR54362
2026-03-28 18:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec0656b6-591f-56f2-b658-d83dbc88acae with identifier: NR54362
2026-03-28 18:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec0656b6-591f-56f2-b658-d83dbc88acae with identifier: NR54362
2026-03-28 18:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec0656b6-591f-56f2-b658-d83dbc88acae with identifier: NR54362 to the API
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NR54362>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:23:43Z',
 'fuel_type': 'petrol',
 'id': 'ec0656b6-591f-56f2-b658-d83dbc88acae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR54362',
 'listing': 'auction',
 'location': 'DE, Lüdenscheid',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 33886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_fed5fd9e236ca762dcfe01781137eed7.jpg',
                'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_745c21cec4f1db0b5b30100f0b44fa1b.jpg',
                'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_9dbaac0318b142471472f0457d70b177.jpg',
                'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_d5f9bf80fe6406e997b0c41a377ab730.jpg',
                'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_f86a23e515d6667901e0b7732e83aac0.jpg',
                'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_66e3b2321466222e0fae0e4a5b8dc14f.jpg',
                'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_3f61df42a5cf1f1fa00fe8399fc6fdb6.jpg',
                'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_7fa7f473e682c09eb982e0aacc93d7be.jpg',
                'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_c4d76c9b30355836af4e728c0e1b72d9.jpg',
                'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_2d17b575629ea6245a6fbbfe968b135c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec0656b6-591f-56f2-b658-d83dbc88acae/ec0656b6-591f-56f2-b658-d83dbc88acae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3434923,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_fed5fd9e236ca762dcfe01781137eed7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec0656b6-591f-56f2-b658-d83dbc88acae/ec0656b6-591f-56f2-b658-d83dbc88acae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3165848,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_745c21cec4f1db0b5b30100f0b44fa1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec0656b6-591f-56f2-b658-d83dbc88acae/ec0656b6-591f-56f2-b658-d83dbc88acae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3280216,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_9dbaac0318b142471472f0457d70b177.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec0656b6-591f-56f2-b658-d83dbc88acae/ec0656b6-591f-56f2-b658-d83dbc88acae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3217999,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_d5f9bf80fe6406e997b0c41a377ab730.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec0656b6-591f-56f2-b658-d83dbc88acae/ec0656b6-591f-56f2-b658-d83dbc88acae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3123398,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_f86a23e515d6667901e0b7732e83aac0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec0656b6-591f-56f2-b658-d83dbc88acae/ec0656b6-591f-56f2-b658-d83dbc88acae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3173407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_66e3b2321466222e0fae0e4a5b8dc14f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec0656b6-591f-56f2-b658-d83dbc88acae/ec0656b6-591f-56f2-b658-d83dbc88acae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2899110,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_3f61df42a5cf1f1fa00fe8399fc6fdb6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec0656b6-591f-56f2-b658-d83dbc88acae/ec0656b6-591f-56f2-b658-d83dbc88acae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_7fa7f473e682c09eb982e0aacc93d7be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec0656b6-591f-56f2-b658-d83dbc88acae/ec0656b6-591f-56f2-b658-d83dbc88acae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3322449,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_c4d76c9b30355836af4e728c0e1b72d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec0656b6-591f-56f2-b658-d83dbc88acae/ec0656b6-591f-56f2-b658-d83dbc88acae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/13/01139feedc0296d543f866fafb30d44a/pa/NR54362_2d17b575629ea6245a6fbbfe968b135c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR54362%27 HTTP/1.1" 200 None
2026-03-28 18:36:22 [auto1.de] INFO: Saving data for NR54362: {'created_time': 1774722982.60619, 'last_price_update_time': 1774722982.606202, 'auction_closing_time': 1774884223.0}
2026-03-28 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR54362') HTTP/1.1" 204 0
2026-03-28 18:36:23 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB93098%27 HTTP/1.1" 200 None
2026-03-28 18:36:23 [auto1.de] INFO: Scrape type for WB93098: 0
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27175%27 HTTP/1.1" 200 None
2026-03-28 18:36:23 [auto1.de] INFO: Scrape type for PE27175: 0
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN86054%27 HTTP/1.1" 200 None
2026-03-28 18:36:23 [auto1.de] INFO: Scrape type for TN86054: 0
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ26330%27 HTTP/1.1" 200 None
2026-03-28 18:36:23 [auto1.de] INFO: Scrape type for LZ26330: 0
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL70058%27 HTTP/1.1" 200 None
2026-03-28 18:36:23 [auto1.de] INFO: Scrape type for KL70058: 0
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ80434%27 HTTP/1.1" 200 None
2026-03-28 18:36:23 [auto1.de] INFO: Scrape type for DJ80434: 0
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS56497%27 HTTP/1.1" 200 None
2026-03-28 18:36:23 [auto1.de] INFO: Scrape type for CS56497: 0
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ01082%27 HTTP/1.1" 200 None
2026-03-28 18:36:23 [auto1.de] INFO: Scrape type for ZZ01082: 2
2026-03-28 18:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with identifier: ZZ01082
2026-03-28 18:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with scrape type 2
2026-03-28 18:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with scrape type 2
2026-03-28 18:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a, identifier: ZZ01082
2026-03-28 18:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with identifier: ZZ01082
2026-03-28 18:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with identifier: ZZ01082
2026-03-28 18:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with identifier: ZZ01082 to the API
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:11:32Z',
 'fuel_type': 'petrol',
 'id': 'dcee49b7-5e93-5ce3-84c1-f6fb6b73291a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ01082',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 54025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-28',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Cool Plus',
 'transmission': 'manual',
 'trim': 'Cool Plus',
 'year': 2021}
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ01082%27 HTTP/1.1" 200 None
2026-03-28 18:36:23 [auto1.de] INFO: Saving data for ZZ01082: {'auction_closing_time': 1774883492.0, 'created_time': 1774521718.402582, 'last_price_update_time': 1774722983.806164}
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ01082') HTTP/1.1" 204 0
2026-03-28 18:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB97674%27 HTTP/1.1" 200 None
2026-03-28 18:36:23 [auto1.de] INFO: Scrape type for ZB97674: 0
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB83489%27 HTTP/1.1" 200 None
2026-03-28 18:36:23 [auto1.de] INFO: Scrape type for MB83489: 0
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV51967%27 HTTP/1.1" 200 None
2026-03-28 18:36:23 [auto1.de] INFO: Scrape type for DV51967: 0
2026-03-28 18:36:23 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-28 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD26953%27 HTTP/1.1" 200 None
2026-03-28 18:36:24 [auto1.de] INFO: Scrape type for TD26953: 0
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM98978%27 HTTP/1.1" 200 None
2026-03-28 18:36:24 [auto1.de] INFO: Scrape type for TM98978: 0
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: BS44912
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS44912%27 HTTP/1.1" 200 None
2026-03-28 18:36:24 [auto1.de] INFO: Scrape type for BS44912: 1
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC85459%27 HTTP/1.1" 200 None
2026-03-28 18:36:24 [auto1.de] INFO: Scrape type for AC85459: 0
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98993%27 HTTP/1.1" 200 None
2026-03-28 18:36:24 [auto1.de] INFO: Scrape type for HA98993: 0
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU76337%27 HTTP/1.1" 200 None
2026-03-28 18:36:24 [auto1.de] INFO: Scrape type for NU76337: 0
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN23533%27 HTTP/1.1" 200 None
2026-03-28 18:36:24 [auto1.de] INFO: Scrape type for BN23533: 0
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC67993%27 HTTP/1.1" 200 None
2026-03-28 18:36:24 [auto1.de] INFO: Scrape type for PC67993: 2
2026-03-28 18:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with identifier: PC67993
2026-03-28 18:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with scrape type 2
2026-03-28 18:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with scrape type 2
2026-03-28 18:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a9dd63b-601b-58b1-8d37-652a2b0e1343, identifier: PC67993
2026-03-28 18:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with identifier: PC67993
2026-03-28 18:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with identifier: PC67993
2026-03-28 18:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with identifier: PC67993 to the API
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:26Z',
 'fuel_type': 'petrol',
 'id': '4a9dd63b-601b-58b1-8d37-652a2b0e1343',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC67993',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 122839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-22',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC67993%27 HTTP/1.1" 200 None
2026-03-28 18:36:24 [auto1.de] INFO: Saving data for PC67993: {'auction_closing_time': 1774885646.0, 'created_time': 1773426946.145049, 'last_price_update_time': 1774722984.541938}
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC67993') HTTP/1.1" 204 0
2026-03-28 18:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS38799%27 HTTP/1.1" 200 None
2026-03-28 18:36:24 [auto1.de] INFO: Scrape type for GS38799: 0
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82708%27 HTTP/1.1" 200 None
2026-03-28 18:36:24 [auto1.de] INFO: Scrape type for SA82708: 0
2026-03-28 18:36:24 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT50939%27 HTTP/1.1" 200 None
2026-03-28 18:36:24 [auto1.de] INFO: Scrape type for XT50939: 0
2026-03-28 18:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS44912/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:26 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13254%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for ZC13254: 0
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA25299%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for JA25299: 0
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW51915%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for WW51915: 0
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: ZM17001
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85650%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for FN85650: 0
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU54451%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for CU54451: 0
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA80165%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for SA80165: 0
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV09122%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for FV09122: 0
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN32284%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for NN32284: 0
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD36706%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for HD36706: 0
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU29030%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for RU29030: 0
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY49734%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for XY49734: 0
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU43264%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for RU43264: 0
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33078%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for MM33078: 2
2026-03-28 18:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with identifier: MM33078
2026-03-28 18:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with scrape type 2
2026-03-28 18:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with scrape type 2
2026-03-28 18:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0, identifier: MM33078
2026-03-28 18:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with identifier: MM33078
2026-03-28 18:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with identifier: MM33078
2026-03-28 18:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with identifier: MM33078 to the API
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:32Z',
 'fuel_type': 'diesel',
 'id': 'bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM33078',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 174518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-21',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2013}
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33078%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Saving data for MM33078: {'auction_closing_time': 1774885112.0, 'created_time': 1774522279.14601, 'last_price_update_time': 1774722986.687305}
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM33078') HTTP/1.1" 204 0
2026-03-28 18:36:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD01626%27 HTTP/1.1" 200 None
2026-03-28 18:36:26 [auto1.de] INFO: Scrape type for LD01626: 0
2026-03-28 18:36:26 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-28 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG21922%27 HTTP/1.1" 200 None
2026-03-28 18:36:27 [auto1.de] INFO: Scrape type for FG21922: 0
2026-03-28 18:36:27 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-28 18:36:27 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-28 18:36:27 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP54704%27 HTTP/1.1" 200 None
2026-03-28 18:36:27 [auto1.de] INFO: Scrape type for CP54704: 0
2026-03-28 18:36:27 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF70690%27 HTTP/1.1" 200 None
2026-03-28 18:36:27 [auto1.de] INFO: Scrape type for VF70690: 2
2026-03-28 18:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c95265d7-e0e8-536b-a6d8-884c28214667 with identifier: VF70690
2026-03-28 18:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c95265d7-e0e8-536b-a6d8-884c28214667 with scrape type 2
2026-03-28 18:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c95265d7-e0e8-536b-a6d8-884c28214667 with scrape type 2
2026-03-28 18:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c95265d7-e0e8-536b-a6d8-884c28214667, identifier: VF70690
2026-03-28 18:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c95265d7-e0e8-536b-a6d8-884c28214667 with identifier: VF70690
2026-03-28 18:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c95265d7-e0e8-536b-a6d8-884c28214667 with identifier: VF70690
2026-03-28 18:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c95265d7-e0e8-536b-a6d8-884c28214667 with identifier: VF70690 to the API
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:58:59Z',
 'fuel_type': 'petrol',
 'id': 'c95265d7-e0e8-536b-a6d8-884c28214667',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF70690',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 194587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-25',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2008}
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF70690%27 HTTP/1.1" 200 None
2026-03-28 18:36:27 [auto1.de] INFO: Saving data for VF70690: {'auction_closing_time': 1774886339.0, 'created_time': 1774033917.359593, 'last_price_update_time': 1774722987.427892}
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF70690') HTTP/1.1" 204 0
2026-03-28 18:36:27 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE90361%27 HTTP/1.1" 200 None
2026-03-28 18:36:27 [auto1.de] INFO: Scrape type for SE90361: 0
2026-03-28 18:36:27 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB35967%27 HTTP/1.1" 200 None
2026-03-28 18:36:27 [auto1.de] INFO: Scrape type for JB35967: 0
2026-03-28 18:36:27 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-28 18:36:27 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-28 18:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:28 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:28 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-28 18:36:28 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-28 18:36:28 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-28 18:36:28 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-28 18:36:28 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-28 18:36:28 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-28 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV72489%27 HTTP/1.1" 200 None
2026-03-28 18:36:28 [auto1.de] INFO: Scrape type for EV72489: 2
2026-03-28 18:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83963d0e-2d9c-545a-9406-f116e26815a7 with identifier: EV72489
2026-03-28 18:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83963d0e-2d9c-545a-9406-f116e26815a7 with scrape type 2
2026-03-28 18:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83963d0e-2d9c-545a-9406-f116e26815a7 with scrape type 2
2026-03-28 18:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83963d0e-2d9c-545a-9406-f116e26815a7, identifier: EV72489
2026-03-28 18:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83963d0e-2d9c-545a-9406-f116e26815a7 with identifier: EV72489
2026-03-28 18:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83963d0e-2d9c-545a-9406-f116e26815a7 with identifier: EV72489
2026-03-28 18:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83963d0e-2d9c-545a-9406-f116e26815a7 with identifier: EV72489 to the API
2026-03-28 18:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:59:07Z',
 'fuel_type': 'diesel',
 'id': '83963d0e-2d9c-545a-9406-f116e26815a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV72489',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 200824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-26',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Individual',
 'transmission': 'automatic',
 'trim': 'Individual',
 'year': 2016}
2026-03-28 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV72489%27 HTTP/1.1" 200 None
2026-03-28 18:36:28 [auto1.de] INFO: Saving data for EV72489: {'auction_closing_time': 1774886347.0, 'created_time': 1774521576.00924, 'last_price_update_time': 1774722988.917803}
2026-03-28 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV72489') HTTP/1.1" 204 0
2026-03-28 18:36:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS56665%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for ZS56665: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF89653%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for CF89653: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM40569%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for YM40569: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET31330%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for ET31330: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB04317%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for WB04317: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63454%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for SJ63454: 2
2026-03-28 18:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with identifier: SJ63454
2026-03-28 18:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with scrape type 2
2026-03-28 18:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with scrape type 2
2026-03-28 18:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3, identifier: SJ63454
2026-03-28 18:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with identifier: SJ63454
2026-03-28 18:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with identifier: SJ63454
2026-03-28 18:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with identifier: SJ63454 to the API
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:17:47Z',
 'fuel_type': 'petrol',
 'id': '5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ63454',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 182944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-23',
 'seller_name': None,
 'title': 'BMW 2er 220i Gran Tourer Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63454%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Saving data for SJ63454: {'auction_closing_time': 1774883867.0, 'created_time': 1773946199.319927, 'last_price_update_time': 1774722989.675043}
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ63454') HTTP/1.1" 204 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC50586%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for RC50586: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR19685%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for AR19685: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78025%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for LD78025: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD83134%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for HD83134: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN44804%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for ZN44804: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG28413%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for NG28413: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM73266%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for JM73266: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP33481%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for BP33481: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP19687%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for SP19687: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68298%27 HTTP/1.1" 200 None
2026-03-28 18:36:29 [auto1.de] INFO: Scrape type for JV68298: 0
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-28 18:36:29 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-28 18:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS44912> (referer: https://www.auto1.com/v1/car-details-view/BS44912/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba with identifier: BS44912
2026-03-28 18:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba with scrape type 1
2026-03-28 18:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9f%252Fbb9f5ed6a9cae7b4f61b1b24cd1146a3%252Fpa%252FBS44912_ee0e7059839e24900b9024d14fbfea1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_ee0e7059839e24900b9024d14fbfea1e.jpg already downloaded
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9f%252Fbb9f5ed6a9cae7b4f61b1b24cd1146a3%252Fpa%252FBS44912_0329922fa37593546d9c2995d6ef4360.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_0329922fa37593546d9c2995d6ef4360.jpg already downloaded
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9f%252Fbb9f5ed6a9cae7b4f61b1b24cd1146a3%252Fpa%252FBS44912_7c81ef60d8121318e85f63a86bff0d49.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_7c81ef60d8121318e85f63a86bff0d49.jpg already downloaded
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9f%252Fbb9f5ed6a9cae7b4f61b1b24cd1146a3%252Fpa%252FBS44912_5863d9cbe7a6f885cfe1d7906cad525a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_5863d9cbe7a6f885cfe1d7906cad525a.jpg already downloaded
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9f%252Fbb9f5ed6a9cae7b4f61b1b24cd1146a3%252Fpa%252FBS44912_3c3ffd7a9218e2fba22cc060f7a67d6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_3c3ffd7a9218e2fba22cc060f7a67d6d.jpg already downloaded
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9f%252Fbb9f5ed6a9cae7b4f61b1b24cd1146a3%252Fpa%252FBS44912_27d6e3327031ca9720e6c52593ac7b0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_27d6e3327031ca9720e6c52593ac7b0d.jpg already downloaded
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9f%252Fbb9f5ed6a9cae7b4f61b1b24cd1146a3%252Fpa%252FBS44912_3e753aa2215e2e16c032dd385d4d2edf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_3e753aa2215e2e16c032dd385d4d2edf.jpg already downloaded
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9f%252Fbb9f5ed6a9cae7b4f61b1b24cd1146a3%252Fpa%252FBS44912_e4c0329ca3abe9f175e14f5b6c83eaf8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_e4c0329ca3abe9f175e14f5b6c83eaf8.jpg already downloaded
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9f%252Fbb9f5ed6a9cae7b4f61b1b24cd1146a3%252Fpa%252FBS44912_373a3e5779066951ae0071e7abb57836.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_373a3e5779066951ae0071e7abb57836.jpg already downloaded
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F9f%252Fbb9f5ed6a9cae7b4f61b1b24cd1146a3%252Fpa%252FBS44912_de36a390154da5a4587aa819c1e716b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_de36a390154da5a4587aa819c1e716b3.jpg already downloaded
2026-03-28 18:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba, identifier: BS44912
2026-03-28 18:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba with identifier: BS44912
2026-03-28 18:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba with identifier: BS44912
2026-03-28 18:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba with identifier: BS44912 to the API
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BS44912>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:58:34Z',
 'fuel_type': 'petrol',
 'id': '5c0393b9-8a7c-5d97-a435-7a1c125fc4ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS44912',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 76891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_ee0e7059839e24900b9024d14fbfea1e.jpg',
                'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_0329922fa37593546d9c2995d6ef4360.jpg',
                'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_7c81ef60d8121318e85f63a86bff0d49.jpg',
                'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_5863d9cbe7a6f885cfe1d7906cad525a.jpg',
                'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_3c3ffd7a9218e2fba22cc060f7a67d6d.jpg',
                'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_27d6e3327031ca9720e6c52593ac7b0d.jpg',
                'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_3e753aa2215e2e16c032dd385d4d2edf.jpg',
                'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_e4c0329ca3abe9f175e14f5b6c83eaf8.jpg',
                'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_373a3e5779066951ae0071e7abb57836.jpg',
                'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_de36a390154da5a4587aa819c1e716b3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c0393b9-8a7c-5d97-a435-7a1c125fc4ba/5c0393b9-8a7c-5d97-a435-7a1c125fc4ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_ee0e7059839e24900b9024d14fbfea1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c0393b9-8a7c-5d97-a435-7a1c125fc4ba/5c0393b9-8a7c-5d97-a435-7a1c125fc4ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_0329922fa37593546d9c2995d6ef4360.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c0393b9-8a7c-5d97-a435-7a1c125fc4ba/5c0393b9-8a7c-5d97-a435-7a1c125fc4ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_7c81ef60d8121318e85f63a86bff0d49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c0393b9-8a7c-5d97-a435-7a1c125fc4ba/5c0393b9-8a7c-5d97-a435-7a1c125fc4ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_5863d9cbe7a6f885cfe1d7906cad525a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c0393b9-8a7c-5d97-a435-7a1c125fc4ba/5c0393b9-8a7c-5d97-a435-7a1c125fc4ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_3c3ffd7a9218e2fba22cc060f7a67d6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c0393b9-8a7c-5d97-a435-7a1c125fc4ba/5c0393b9-8a7c-5d97-a435-7a1c125fc4ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_27d6e3327031ca9720e6c52593ac7b0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c0393b9-8a7c-5d97-a435-7a1c125fc4ba/5c0393b9-8a7c-5d97-a435-7a1c125fc4ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_3e753aa2215e2e16c032dd385d4d2edf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c0393b9-8a7c-5d97-a435-7a1c125fc4ba/5c0393b9-8a7c-5d97-a435-7a1c125fc4ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_e4c0329ca3abe9f175e14f5b6c83eaf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c0393b9-8a7c-5d97-a435-7a1c125fc4ba/5c0393b9-8a7c-5d97-a435-7a1c125fc4ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2924841,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_373a3e5779066951ae0071e7abb57836.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c0393b9-8a7c-5d97-a435-7a1c125fc4ba/5c0393b9-8a7c-5d97-a435-7a1c125fc4ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/9f/bb9f5ed6a9cae7b4f61b1b24cd1146a3/pa/BS44912_de36a390154da5a4587aa819c1e716b3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS44912%27 HTTP/1.1" 200 None
2026-03-28 18:36:30 [auto1.de] INFO: Saving data for BS44912: {'created_time': 1774722990.791097, 'last_price_update_time': 1774722990.791108, 'auction_closing_time': 1774886314.0}
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS44912') HTTP/1.1" 204 0
2026-03-28 18:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:31 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:31 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-28 18:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB09285%27 HTTP/1.1" 200 None
2026-03-28 18:36:31 [auto1.de] INFO: Scrape type for LB09285: 2
2026-03-28 18:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with identifier: LB09285
2026-03-28 18:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with scrape type 2
2026-03-28 18:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with scrape type 2
2026-03-28 18:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5, identifier: LB09285
2026-03-28 18:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with identifier: LB09285
2026-03-28 18:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with identifier: LB09285
2026-03-28 18:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with identifier: LB09285 to the API
2026-03-28 18:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:39:44Z',
 'fuel_type': 'diesel',
 'id': '94ff4c94-711f-5ae2-a959-4f29f4edd9c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB09285',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 147747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-13',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2017}
2026-03-28 18:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB09285%27 HTTP/1.1" 200 None
2026-03-28 18:36:31 [auto1.de] INFO: Saving data for LB09285: {'auction_closing_time': 1774885184.0, 'created_time': 1773429571.823721, 'last_price_update_time': 1774722991.896527}
2026-03-28 18:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB09285') HTTP/1.1" 204 0
2026-03-28 18:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM50859%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for CM50859: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME09470%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for ME09470: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26352%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for AW26352: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW45885%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for WW45885: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG36618%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for GG36618: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM40239%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for RM40239: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU23510%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for BU23510: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: JL88490
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL88490%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for JL88490: 2
2026-03-28 18:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67a87cd1-5bab-5a01-89c0-c8cd02e170db with identifier: JL88490
2026-03-28 18:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a87cd1-5bab-5a01-89c0-c8cd02e170db with scrape type 2
2026-03-28 18:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67a87cd1-5bab-5a01-89c0-c8cd02e170db with scrape type 2
2026-03-28 18:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67a87cd1-5bab-5a01-89c0-c8cd02e170db, identifier: JL88490
2026-03-28 18:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67a87cd1-5bab-5a01-89c0-c8cd02e170db with identifier: JL88490
2026-03-28 18:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67a87cd1-5bab-5a01-89c0-c8cd02e170db with identifier: JL88490
2026-03-28 18:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67a87cd1-5bab-5a01-89c0-c8cd02e170db with identifier: JL88490 to the API
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:30:03Z',
 'fuel_type': 'petrol',
 'id': '67a87cd1-5bab-5a01-89c0-c8cd02e170db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL88490',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 163870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-12',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2006}
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL88490%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Saving data for JL88490: {'auction_closing_time': 1774884603.0, 'created_time': 1774350350.695678, 'last_price_update_time': 1774722992.603337}
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL88490') HTTP/1.1" 204 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH48180%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for PH48180: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE53759%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for RE53759: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV31897%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for NV31897: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW42745%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for VW42745: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89563%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for ZT89563: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ99770%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for YJ99770: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW77910%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for PW77910: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE93454%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for TE93454: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU00921%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for PU00921: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR37276%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for MR37276: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH45720%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for FH45720: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH88741%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for PH88741: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY72197%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for UY72197: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10648%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for VY10648: 0
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-28 18:36:32 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF07638%27 HTTP/1.1" 200 None
2026-03-28 18:36:32 [auto1.de] INFO: Scrape type for HF07638: 0
2026-03-28 18:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:33 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:33 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-28 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF26414%27 HTTP/1.1" 200 None
2026-03-28 18:36:33 [auto1.de] INFO: Scrape type for BF26414: 0
2026-03-28 18:36:33 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-28 18:36:33 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-28 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91836%27 HTTP/1.1" 200 None
2026-03-28 18:36:33 [auto1.de] INFO: Scrape type for FY91836: 0
2026-03-28 18:36:33 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-28 18:36:33 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-28 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK44645%27 HTTP/1.1" 200 None
2026-03-28 18:36:33 [auto1.de] INFO: Scrape type for VK44645: 0
2026-03-28 18:36:33 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-28 18:36:33 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-28 18:36:33 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-28 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF53394%27 HTTP/1.1" 200 None
2026-03-28 18:36:33 [auto1.de] INFO: Scrape type for CF53394: 2
2026-03-28 18:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c9e92d-56fb-5e73-b357-ae329b705d99 with identifier: CF53394
2026-03-28 18:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c9e92d-56fb-5e73-b357-ae329b705d99 with scrape type 2
2026-03-28 18:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c9e92d-56fb-5e73-b357-ae329b705d99 with scrape type 2
2026-03-28 18:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63c9e92d-56fb-5e73-b357-ae329b705d99, identifier: CF53394
2026-03-28 18:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63c9e92d-56fb-5e73-b357-ae329b705d99 with identifier: CF53394
2026-03-28 18:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63c9e92d-56fb-5e73-b357-ae329b705d99 with identifier: CF53394
2026-03-28 18:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63c9e92d-56fb-5e73-b357-ae329b705d99 with identifier: CF53394 to the API
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:14:09Z',
 'fuel_type': 'petrol',
 'id': '63c9e92d-56fb-5e73-b357-ae329b705d99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF53394',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 115619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-16',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF53394%27 HTTP/1.1" 200 None
2026-03-28 18:36:34 [auto1.de] INFO: Saving data for CF53394: {'auction_closing_time': 1774883649.0, 'created_time': 1774521597.440524, 'last_price_update_time': 1774722994.408467}
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF53394') HTTP/1.1" 204 0
2026-03-28 18:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:34 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-28 18:36:34 [auto1.de] INFO: Found listing with ID: KV36004
2026-03-28 18:36:34 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP46416%27 HTTP/1.1" 200 None
2026-03-28 18:36:34 [auto1.de] INFO: Scrape type for VP46416: 0
2026-03-28 18:36:34 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ47669%27 HTTP/1.1" 200 None
2026-03-28 18:36:34 [auto1.de] INFO: Scrape type for RJ47669: 0
2026-03-28 18:36:34 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW15848%27 HTTP/1.1" 200 None
2026-03-28 18:36:34 [auto1.de] INFO: Scrape type for TW15848: 2
2026-03-28 18:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-03-28 18:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8097b80-dd32-5c15-9311-e37f7ab126b1 with scrape type 2
2026-03-28 18:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8097b80-dd32-5c15-9311-e37f7ab126b1 with scrape type 2
2026-03-28 18:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8097b80-dd32-5c15-9311-e37f7ab126b1, identifier: TW15848
2026-03-28 18:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-03-28 18:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-03-28 18:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848 to the API
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:31:17Z',
 'fuel_type': 'diesel',
 'id': 'e8097b80-dd32-5c15-9311-e37f7ab126b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW15848',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 192905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-30',
 'seller_name': None,
 'title': 'BMW 5er 535d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW15848%27 HTTP/1.1" 200 None
2026-03-28 18:36:34 [auto1.de] INFO: Saving data for TW15848: {'auction_closing_time': 1774884677.0, 'created_time': 1774521829.629072, 'last_price_update_time': 1774722994.96549}
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW15848') HTTP/1.1" 204 0
2026-03-28 18:36:34 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV55154%27 HTTP/1.1" 200 None
2026-03-28 18:36:34 [auto1.de] INFO: Scrape type for MV55154: 0
2026-03-28 18:36:34 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ38880%27 HTTP/1.1" 200 None
2026-03-28 18:36:35 [auto1.de] INFO: Scrape type for WZ38880: 2
2026-03-28 18:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 363faf73-5150-5013-84e6-228bffc04801 with identifier: WZ38880
2026-03-28 18:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 363faf73-5150-5013-84e6-228bffc04801 with scrape type 2
2026-03-28 18:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 363faf73-5150-5013-84e6-228bffc04801 with scrape type 2
2026-03-28 18:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 363faf73-5150-5013-84e6-228bffc04801, identifier: WZ38880
2026-03-28 18:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 363faf73-5150-5013-84e6-228bffc04801 with identifier: WZ38880
2026-03-28 18:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 363faf73-5150-5013-84e6-228bffc04801 with identifier: WZ38880
2026-03-28 18:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 363faf73-5150-5013-84e6-228bffc04801 with identifier: WZ38880 to the API
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:26:54Z',
 'fuel_type': 'petrol',
 'id': '363faf73-5150-5013-84e6-228bffc04801',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ38880',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 79015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI R BlueMotion 4Motion',
 'transmission': 'automatic',
 'trim': 'R BlueMotion 4Motion',
 'year': 2019}
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ38880%27 HTTP/1.1" 200 None
2026-03-28 18:36:35 [auto1.de] INFO: Saving data for WZ38880: {'auction_closing_time': 1774884414.0, 'created_time': 1774522388.823202, 'last_price_update_time': 1774722995.404369}
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ38880') HTTP/1.1" 204 0
2026-03-28 18:36:35 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73559%27 HTTP/1.1" 200 None
2026-03-28 18:36:35 [auto1.de] INFO: Scrape type for CZ73559: 0
2026-03-28 18:36:35 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-28 18:36:35 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK64805%27 HTTP/1.1" 200 None
2026-03-28 18:36:35 [auto1.de] INFO: Scrape type for AK64805: 0
2026-03-28 18:36:35 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31373%27 HTTP/1.1" 200 None
2026-03-28 18:36:35 [auto1.de] INFO: Scrape type for GA31373: 0
2026-03-28 18:36:35 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-28 18:36:35 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41165%27 HTTP/1.1" 200 None
2026-03-28 18:36:35 [auto1.de] INFO: Scrape type for DV41165: 2
2026-03-28 18:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c203b7fd-e636-5306-ad1a-d5d21fa78650 with identifier: DV41165
2026-03-28 18:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c203b7fd-e636-5306-ad1a-d5d21fa78650 with scrape type 2
2026-03-28 18:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c203b7fd-e636-5306-ad1a-d5d21fa78650 with scrape type 2
2026-03-28 18:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c203b7fd-e636-5306-ad1a-d5d21fa78650, identifier: DV41165
2026-03-28 18:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c203b7fd-e636-5306-ad1a-d5d21fa78650 with identifier: DV41165
2026-03-28 18:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c203b7fd-e636-5306-ad1a-d5d21fa78650 with identifier: DV41165
2026-03-28 18:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c203b7fd-e636-5306-ad1a-d5d21fa78650 with identifier: DV41165 to the API
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:05:07Z',
 'fuel_type': 'petrol',
 'id': 'c203b7fd-e636-5306-ad1a-d5d21fa78650',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV41165',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 48581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-04',
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Roadster',
 'transmission': 'manual',
 'trim': 'Roadster',
 'year': 2007}
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41165%27 HTTP/1.1" 200 None
2026-03-28 18:36:35 [auto1.de] INFO: Saving data for DV41165: {'auction_closing_time': 1774883107.0, 'created_time': 1774522080.573693, 'last_price_update_time': 1774722995.921859}
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV41165') HTTP/1.1" 204 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP44160%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for EP44160: 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC06569%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for TC06569: 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC98855%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for JC98855: 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP44310%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for LP44310: 2
2026-03-28 18:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with identifier: LP44310
2026-03-28 18:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with scrape type 2
2026-03-28 18:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with scrape type 2
2026-03-28 18:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4, identifier: LP44310
2026-03-28 18:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with identifier: LP44310
2026-03-28 18:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with identifier: LP44310
2026-03-28 18:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with identifier: LP44310 to the API
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:33:46Z',
 'fuel_type': 'petrol',
 'id': 'e1255ff5-d6df-5a6d-bb47-e7a0ead192d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP44310',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 137678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-17',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2006}
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP44310%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Saving data for LP44310: {'auction_closing_time': 1774884826.0, 'created_time': 1774521858.018781, 'last_price_update_time': 1774722996.534343}
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP44310') HTTP/1.1" 204 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: TH33543
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH33543%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for TH33543: 2
2026-03-28 18:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f136cace-eadb-5ae7-a3f6-dde8f5af96d5 with identifier: TH33543
2026-03-28 18:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f136cace-eadb-5ae7-a3f6-dde8f5af96d5 with scrape type 2
2026-03-28 18:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f136cace-eadb-5ae7-a3f6-dde8f5af96d5 with scrape type 2
2026-03-28 18:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f136cace-eadb-5ae7-a3f6-dde8f5af96d5, identifier: TH33543
2026-03-28 18:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f136cace-eadb-5ae7-a3f6-dde8f5af96d5 with identifier: TH33543
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 18:36:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f136cace-eadb-5ae7-a3f6-dde8f5af96d5 with identifier: TH33543
2026-03-28 18:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f136cace-eadb-5ae7-a3f6-dde8f5af96d5 with identifier: TH33543 to the API
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:47:44Z',
 'fuel_type': 'petrol',
 'id': 'f136cace-eadb-5ae7-a3f6-dde8f5af96d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH33543',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 156270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH33543%27 HTTP/1.1" 200 None
2026-03-28 18:36:37 [auto1.de] INFO: Saving data for TH33543: {'auction_closing_time': 1774885664.0, 'created_time': 1773427277.414123, 'last_price_update_time': 1774722997.931764}
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH33543') HTTP/1.1" 204 0
2026-03-28 18:36:37 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97465%27 HTTP/1.1" 200 None
2026-03-28 18:36:37 [auto1.de] INFO: Scrape type for BP97465: 0
2026-03-28 18:36:37 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL90320%27 HTTP/1.1" 200 None
2026-03-28 18:36:37 [auto1.de] INFO: Scrape type for CL90320: 0
2026-03-28 18:36:37 [auto1.de] INFO: Found listing with ID: TD06456
2026-03-28 18:36:37 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-28 18:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:38 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS65332%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for LS65332: 2
2026-03-28 18:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with identifier: LS65332
2026-03-28 18:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with scrape type 2
2026-03-28 18:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with scrape type 2
2026-03-28 18:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f, identifier: LS65332
2026-03-28 18:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with identifier: LS65332
2026-03-28 18:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with identifier: LS65332
2026-03-28 18:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with identifier: LS65332 to the API
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:55:00Z',
 'fuel_type': 'petrol',
 'id': '47fe9947-cd6a-512d-b2d3-1ca5bb936c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS65332',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 93833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-05',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.6 Comfort 4x2',
 'transmission': 'manual',
 'trim': 'Comfort 4x2',
 'year': 2017}
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS65332%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Saving data for LS65332: {'auction_closing_time': 1774886100.0, 'created_time': 1774522154.803756, 'last_price_update_time': 1774722998.542163}
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS65332') HTTP/1.1" 204 0
2026-03-28 18:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND38532%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for ND38532: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL79897%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for PL79897: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: US43373
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US43373%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for US43373: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW65541%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for PW65541: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98956%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for VV98956: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP82440%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for XP82440: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY33546%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for HY33546: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS48399%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for CS48399: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM08350%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for FM08350: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ92700%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for WZ92700: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF77212%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for PF77212: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ29098%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for BJ29098: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN28121%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for NN28121: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: FP11362
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP11362%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for FP11362: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA80529%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for PA80529: 2
2026-03-28 18:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with identifier: PA80529
2026-03-28 18:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with scrape type 2
2026-03-28 18:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with scrape type 2
2026-03-28 18:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1, identifier: PA80529
2026-03-28 18:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with identifier: PA80529
2026-03-28 18:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with identifier: PA80529
2026-03-28 18:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with identifier: PA80529 to the API
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:59:51Z',
 'fuel_type': 'petrol',
 'id': '0b7b4436-b416-58bd-b4d1-2ec5f70e65e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA80529',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 113105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-06',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA80529%27 HTTP/1.1" 200 None
2026-03-28 18:36:39 [auto1.de] INFO: Saving data for PA80529: {'auction_closing_time': 1774886391.0, 'created_time': 1773429674.845522, 'last_price_update_time': 1774722999.216581}
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA80529') HTTP/1.1" 204 0
2026-03-28 18:36:39 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD93722%27 HTTP/1.1" 200 None
2026-03-28 18:36:39 [auto1.de] INFO: Scrape type for FD93722: 2
2026-03-28 18:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667e67f9-2345-593f-8877-e7b6129f7d00 with identifier: FD93722
2026-03-28 18:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667e67f9-2345-593f-8877-e7b6129f7d00 with scrape type 2
2026-03-28 18:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667e67f9-2345-593f-8877-e7b6129f7d00 with scrape type 2
2026-03-28 18:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 667e67f9-2345-593f-8877-e7b6129f7d00, identifier: FD93722
2026-03-28 18:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 667e67f9-2345-593f-8877-e7b6129f7d00 with identifier: FD93722
2026-03-28 18:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 667e67f9-2345-593f-8877-e7b6129f7d00 with identifier: FD93722
2026-03-28 18:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 667e67f9-2345-593f-8877-e7b6129f7d00 with identifier: FD93722 to the API
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:48:38Z',
 'fuel_type': 'petrol',
 'id': '667e67f9-2345-593f-8877-e7b6129f7d00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD93722',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 153238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-26',
 'seller_name': None,
 'title': 'BMW 1er 118i Edition M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'Edition M Sport Shadow',
 'year': 2017}
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD93722%27 HTTP/1.1" 200 None
2026-03-28 18:36:39 [auto1.de] INFO: Saving data for FD93722: {'auction_closing_time': 1774885718.0, 'created_time': 1774119122.962841, 'last_price_update_time': 1774722999.800657}
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD93722') HTTP/1.1" 204 0
2026-03-28 18:36:39 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-28 18:36:39 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU03053%27 HTTP/1.1" 200 None
2026-03-28 18:36:39 [auto1.de] INFO: Scrape type for ZU03053: 0
2026-03-28 18:36:39 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35105%27 HTTP/1.1" 200 None
2026-03-28 18:36:39 [auto1.de] INFO: Scrape type for RD35105: 2
2026-03-28 18:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f4cd017-9eb1-5923-8313-23b0ba090ccd with identifier: RD35105
2026-03-28 18:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f4cd017-9eb1-5923-8313-23b0ba090ccd with scrape type 2
2026-03-28 18:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f4cd017-9eb1-5923-8313-23b0ba090ccd with scrape type 2
2026-03-28 18:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f4cd017-9eb1-5923-8313-23b0ba090ccd, identifier: RD35105
2026-03-28 18:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f4cd017-9eb1-5923-8313-23b0ba090ccd with identifier: RD35105
2026-03-28 18:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f4cd017-9eb1-5923-8313-23b0ba090ccd with identifier: RD35105
2026-03-28 18:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f4cd017-9eb1-5923-8313-23b0ba090ccd with identifier: RD35105 to the API
2026-03-28 18:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:03:23Z',
 'fuel_type': 'petrol',
 'id': '1f4cd017-9eb1-5923-8313-23b0ba090ccd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD35105',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595C',
 'odometer': 70202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-26',
 'seller_name': None,
 'title': 'Abarth 595C 1.4 Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2014}
2026-03-28 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35105%27 HTTP/1.1" 200 None
2026-03-28 18:36:40 [auto1.de] INFO: Saving data for RD35105: {'auction_closing_time': 1774883003.0, 'created_time': 1774521700.736752, 'last_price_update_time': 1774723000.262913}
2026-03-28 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD35105') HTTP/1.1" 204 0
2026-03-28 18:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:41 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG69866%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for WG69866: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV21910%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for ZV21910: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA65327%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for BA65327: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72681%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for SJ72681: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS48100%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for KS48100: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW52920%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for GW52920: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX14499%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for SX14499: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA56984%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for TA56984: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC04825%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for ZC04825: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS17953%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for CS17953: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ38627%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for VJ38627: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH53134%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for BH53134: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK71622%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for WK71622: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE48308%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for ZE48308: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46424%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for XP46424: 2
2026-03-28 18:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fa0a3de-1deb-55a6-8945-192640326273 with identifier: XP46424
2026-03-28 18:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fa0a3de-1deb-55a6-8945-192640326273 with scrape type 2
2026-03-28 18:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fa0a3de-1deb-55a6-8945-192640326273 with scrape type 2
2026-03-28 18:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fa0a3de-1deb-55a6-8945-192640326273, identifier: XP46424
2026-03-28 18:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fa0a3de-1deb-55a6-8945-192640326273 with identifier: XP46424
2026-03-28 18:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fa0a3de-1deb-55a6-8945-192640326273 with identifier: XP46424
2026-03-28 18:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fa0a3de-1deb-55a6-8945-192640326273 with identifier: XP46424 to the API
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:35:51Z',
 'fuel_type': 'petrol',
 'id': '6fa0a3de-1deb-55a6-8945-192640326273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP46424',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 257574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-02',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Active Plus Edition',
 'transmission': 'manual',
 'trim': 'Active Plus Edition',
 'year': 2012}
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46424%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Saving data for XP46424: {'auction_closing_time': 1774884951.0, 'created_time': 1774522233.907532, 'last_price_update_time': 1774723002.10935}
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP46424') HTTP/1.1" 204 0
2026-03-28 18:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY55773%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Scrape type for BY55773: 0
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY49191%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Scrape type for TY49191: 2
2026-03-28 18:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f2b5721-2072-52e6-b19a-ea3eafd23440 with identifier: TY49191
2026-03-28 18:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f2b5721-2072-52e6-b19a-ea3eafd23440 with scrape type 2
2026-03-28 18:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f2b5721-2072-52e6-b19a-ea3eafd23440 with scrape type 2
2026-03-28 18:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f2b5721-2072-52e6-b19a-ea3eafd23440, identifier: TY49191
2026-03-28 18:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f2b5721-2072-52e6-b19a-ea3eafd23440 with identifier: TY49191
2026-03-28 18:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f2b5721-2072-52e6-b19a-ea3eafd23440 with identifier: TY49191
2026-03-28 18:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f2b5721-2072-52e6-b19a-ea3eafd23440 with identifier: TY49191 to the API
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:03:42Z',
 'fuel_type': 'diesel',
 'id': '8f2b5721-2072-52e6-b19a-ea3eafd23440',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY49191',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 116897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-04',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2019}
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY49191%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Saving data for TY49191: {'auction_closing_time': 1774883022.0, 'created_time': 1774522553.177865, 'last_price_update_time': 1774723002.673306}
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY49191') HTTP/1.1" 204 0
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH96912%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Scrape type for UH96912: 0
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61703%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Scrape type for KZ61703: 0
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV25811%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Scrape type for HV25811: 0
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY92722%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Scrape type for MY92722: 0
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-28 18:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:43 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:43 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-28 18:36:43 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00039%27 HTTP/1.1" 200 None
2026-03-28 18:36:43 [auto1.de] INFO: Scrape type for UH00039: 0
2026-03-28 18:36:43 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA28860%27 HTTP/1.1" 200 None
2026-03-28 18:36:43 [auto1.de] INFO: Scrape type for GA28860: 0
2026-03-28 18:36:43 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-28 18:36:43 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH35819%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for JH35819: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF22787%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for RF22787: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG25993%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for HG25993: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45337%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for UF45337: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM43288%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for HM43288: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR95726%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for PR95726: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB66833%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for LB66833: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ12111%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for BZ12111: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG70959%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for MG70959: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ14237%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for DJ14237: 2
2026-03-28 18:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b72472a-09ec-5538-8394-2400d67a0d06 with identifier: DJ14237
2026-03-28 18:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b72472a-09ec-5538-8394-2400d67a0d06 with scrape type 2
2026-03-28 18:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b72472a-09ec-5538-8394-2400d67a0d06 with scrape type 2
2026-03-28 18:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b72472a-09ec-5538-8394-2400d67a0d06, identifier: DJ14237
2026-03-28 18:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b72472a-09ec-5538-8394-2400d67a0d06 with identifier: DJ14237
2026-03-28 18:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b72472a-09ec-5538-8394-2400d67a0d06 with identifier: DJ14237
2026-03-28 18:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b72472a-09ec-5538-8394-2400d67a0d06 with identifier: DJ14237 to the API
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:14:39Z',
 'fuel_type': 'petrol',
 'id': '7b72472a-09ec-5538-8394-2400d67a0d06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ14237',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 131630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2019}
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ14237%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Saving data for DJ14237: {'auction_closing_time': 1774883679.0, 'created_time': 1774636529.649199, 'last_price_update_time': 1774723004.578101}
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ14237') HTTP/1.1" 204 0
2026-03-28 18:36:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF28924%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for ZF28924: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN88860%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for LN88860: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN01043%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for VN01043: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV58982%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for EV58982: 2
2026-03-28 18:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f041308b-b69d-588e-a783-26d901994d59 with identifier: EV58982
2026-03-28 18:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f041308b-b69d-588e-a783-26d901994d59 with scrape type 2
2026-03-28 18:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f041308b-b69d-588e-a783-26d901994d59 with scrape type 2
2026-03-28 18:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f041308b-b69d-588e-a783-26d901994d59, identifier: EV58982
2026-03-28 18:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f041308b-b69d-588e-a783-26d901994d59 with identifier: EV58982
2026-03-28 18:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f041308b-b69d-588e-a783-26d901994d59 with identifier: EV58982
2026-03-28 18:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f041308b-b69d-588e-a783-26d901994d59 with identifier: EV58982 to the API
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:41:54Z',
 'fuel_type': 'diesel',
 'id': 'f041308b-b69d-588e-a783-26d901994d59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV58982',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 277114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-15',
 'seller_name': None,
 'title': 'Volkswagen Golf V 2.0 TDI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2005}
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV58982%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Saving data for EV58982: {'auction_closing_time': 1774885314.0, 'created_time': 1772543116.931886, 'last_price_update_time': 1774723005.132397}
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV58982') HTTP/1.1" 204 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN56757%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for PN56757: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: PC60624
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ54145%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for PJ54145: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21217%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for NY21217: 2
2026-03-28 18:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5354c06-711e-5a00-aef7-3de8a7d627d6 with identifier: NY21217
2026-03-28 18:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5354c06-711e-5a00-aef7-3de8a7d627d6 with scrape type 2
2026-03-28 18:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5354c06-711e-5a00-aef7-3de8a7d627d6 with scrape type 2
2026-03-28 18:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5354c06-711e-5a00-aef7-3de8a7d627d6, identifier: NY21217
2026-03-28 18:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5354c06-711e-5a00-aef7-3de8a7d627d6 with identifier: NY21217
2026-03-28 18:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5354c06-711e-5a00-aef7-3de8a7d627d6 with identifier: NY21217
2026-03-28 18:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5354c06-711e-5a00-aef7-3de8a7d627d6 with identifier: NY21217 to the API
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-30T15:07:26Z',
 'fuel_type': 'diesel',
 'id': 'c5354c06-711e-5a00-aef7-3de8a7d627d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY21217',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 131661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-25',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2021}
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21217%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Saving data for NY21217: {'auction_closing_time': 1774883246.0, 'created_time': 1774521415.441809, 'last_price_update_time': 1774723005.604034}
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY21217') HTTP/1.1" 204 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH75769%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for CH75769: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH48904%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for BH48904: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV61779%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for ZV61779: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM02183%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for YM02183: 0
2026-03-28 18:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:46 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:46 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-28 18:36:46 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-28 18:36:46 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV15803%27 HTTP/1.1" 200 None
2026-03-28 18:36:46 [auto1.de] INFO: Scrape type for WV15803: 0
2026-03-28 18:36:46 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM75653%27 HTTP/1.1" 200 None
2026-03-28 18:36:46 [auto1.de] INFO: Scrape type for HM75653: 0
2026-03-28 18:36:46 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE20511%27 HTTP/1.1" 200 None
2026-03-28 18:36:46 [auto1.de] INFO: Scrape type for AE20511: 0
2026-03-28 18:36:46 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-28 18:36:46 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ67975%27 HTTP/1.1" 200 None
2026-03-28 18:36:46 [auto1.de] INFO: Scrape type for TZ67975: 0
2026-03-28 18:36:46 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF14640%27 HTTP/1.1" 200 None
2026-03-28 18:36:46 [auto1.de] INFO: Scrape type for PF14640: 2
2026-03-28 18:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a4f48d8-75d2-53b5-8676-10b07587cd4e with identifier: PF14640
2026-03-28 18:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a4f48d8-75d2-53b5-8676-10b07587cd4e with scrape type 2
2026-03-28 18:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a4f48d8-75d2-53b5-8676-10b07587cd4e with scrape type 2
2026-03-28 18:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a4f48d8-75d2-53b5-8676-10b07587cd4e, identifier: PF14640
2026-03-28 18:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a4f48d8-75d2-53b5-8676-10b07587cd4e with identifier: PF14640
2026-03-28 18:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a4f48d8-75d2-53b5-8676-10b07587cd4e with identifier: PF14640
2026-03-28 18:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a4f48d8-75d2-53b5-8676-10b07587cd4e with identifier: PF14640 to the API
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:08:54Z',
 'fuel_type': 'petrol',
 'id': '6a4f48d8-75d2-53b5-8676-10b07587cd4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF14640',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 100907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF14640%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Saving data for PF14640: {'auction_closing_time': 1774883334.0, 'created_time': 1774521608.428813, 'last_price_update_time': 1774723007.044462}
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF14640') HTTP/1.1" 204 0
2026-03-28 18:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF94308%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for DF94308: 2
2026-03-28 18:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with identifier: DF94308
2026-03-28 18:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with scrape type 2
2026-03-28 18:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with scrape type 2
2026-03-28 18:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f, identifier: DF94308
2026-03-28 18:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with identifier: DF94308
2026-03-28 18:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with identifier: DF94308
2026-03-28 18:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with identifier: DF94308 to the API
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:15:15Z',
 'fuel_type': 'petrol',
 'id': 'a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF94308',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 135320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF94308%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Saving data for DF94308: {'auction_closing_time': 1774883715.0, 'created_time': 1774521856.722234, 'last_price_update_time': 1774723007.570476}
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF94308') HTTP/1.1" 204 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE00996%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for EE00996: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT28876%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for NT28876: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS83332%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for PS83332: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS00408%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for FS00408: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE65713%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for WE65713: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX50338%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for CX50338: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT83472%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for TT83472: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR04951%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for AR04951: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM36828%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for HM36828: 2
2026-03-28 18:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdd0b695-89da-5fec-9f8a-0f89bf536b3e with identifier: HM36828
2026-03-28 18:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdd0b695-89da-5fec-9f8a-0f89bf536b3e with scrape type 2
2026-03-28 18:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdd0b695-89da-5fec-9f8a-0f89bf536b3e with scrape type 2
2026-03-28 18:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdd0b695-89da-5fec-9f8a-0f89bf536b3e, identifier: HM36828
2026-03-28 18:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdd0b695-89da-5fec-9f8a-0f89bf536b3e with identifier: HM36828
2026-03-28 18:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdd0b695-89da-5fec-9f8a-0f89bf536b3e with identifier: HM36828
2026-03-28 18:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdd0b695-89da-5fec-9f8a-0f89bf536b3e with identifier: HM36828 to the API
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:09:21Z',
 'fuel_type': 'diesel',
 'id': 'bdd0b695-89da-5fec-9f8a-0f89bf536b3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM36828',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 119372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-16',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 119 CDI lang 4Matic',
 'transmission': 'automatic',
 'trim': 'lang 4Matic',
 'year': 2017}
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM36828%27 HTTP/1.1" 200 None
2026-03-28 18:36:48 [auto1.de] INFO: Saving data for HM36828: {'auction_closing_time': 1774883361.0, 'created_time': 1773861769.99404, 'last_price_update_time': 1774723008.171178}
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM36828') HTTP/1.1" 204 0
2026-03-28 18:36:48 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-28 18:36:48 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN75673%27 HTTP/1.1" 200 None
2026-03-28 18:36:48 [auto1.de] INFO: Scrape type for LN75673: 0
2026-03-28 18:36:48 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-28 18:36:48 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM10671%27 HTTP/1.1" 200 None
2026-03-28 18:36:48 [auto1.de] INFO: Scrape type for UM10671: 0
2026-03-28 18:36:48 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-28 18:36:48 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-28 18:36:48 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD05825%27 HTTP/1.1" 200 None
2026-03-28 18:36:48 [auto1.de] INFO: Scrape type for CD05825: 0
2026-03-28 18:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:49 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD48040%27 HTTP/1.1" 200 None
2026-03-28 18:36:49 [auto1.de] INFO: Scrape type for RD48040: 0
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV89856%27 HTTP/1.1" 200 None
2026-03-28 18:36:49 [auto1.de] INFO: Scrape type for JV89856: 0
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL21282%27 HTTP/1.1" 200 None
2026-03-28 18:36:49 [auto1.de] INFO: Scrape type for BL21282: 2
2026-03-28 18:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b10da27-c2e5-5c37-a066-a925fbd813c8 with identifier: BL21282
2026-03-28 18:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b10da27-c2e5-5c37-a066-a925fbd813c8 with scrape type 2
2026-03-28 18:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b10da27-c2e5-5c37-a066-a925fbd813c8 with scrape type 2
2026-03-28 18:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b10da27-c2e5-5c37-a066-a925fbd813c8, identifier: BL21282
2026-03-28 18:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b10da27-c2e5-5c37-a066-a925fbd813c8 with identifier: BL21282
2026-03-28 18:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b10da27-c2e5-5c37-a066-a925fbd813c8 with identifier: BL21282
2026-03-28 18:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b10da27-c2e5-5c37-a066-a925fbd813c8 with identifier: BL21282 to the API
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:06:26Z',
 'fuel_type': 'diesel',
 'id': '9b10da27-c2e5-5c37-a066-a925fbd813c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL21282',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 123482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-21',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2015}
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL21282%27 HTTP/1.1" 200 None
2026-03-28 18:36:49 [auto1.de] INFO: Saving data for BL21282: {'auction_closing_time': 1774883186.0, 'created_time': 1773341511.72998, 'last_price_update_time': 1774723009.97877}
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL21282') HTTP/1.1" 204 0
2026-03-28 18:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX08405%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for GX08405: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD41373%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for HD41373: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU58060%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for KU58060: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT07597%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for GT07597: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH55749%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for SH55749: 2
2026-03-28 18:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab9f9e7-a1eb-5729-9ab1-396819cdb262 with identifier: SH55749
2026-03-28 18:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab9f9e7-a1eb-5729-9ab1-396819cdb262 with scrape type 2
2026-03-28 18:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ab9f9e7-a1eb-5729-9ab1-396819cdb262 with scrape type 2
2026-03-28 18:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ab9f9e7-a1eb-5729-9ab1-396819cdb262, identifier: SH55749
2026-03-28 18:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ab9f9e7-a1eb-5729-9ab1-396819cdb262 with identifier: SH55749
2026-03-28 18:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ab9f9e7-a1eb-5729-9ab1-396819cdb262 with identifier: SH55749
2026-03-28 18:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ab9f9e7-a1eb-5729-9ab1-396819cdb262 with identifier: SH55749 to the API
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:51:34Z',
 'fuel_type': 'petrol',
 'id': '4ab9f9e7-a1eb-5729-9ab1-396819cdb262',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH55749',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 22125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-02',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2016}
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH55749%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Saving data for SH55749: {'auction_closing_time': 1774885894.0, 'created_time': 1773947026.48262, 'last_price_update_time': 1774723010.614544}
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH55749') HTTP/1.1" 204 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47138%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for VU47138: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79904%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for MY79904: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ40865%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for AZ40865: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG62181%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for SG62181: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41921%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for SP41921: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD57805%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for TD57805: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC03765%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for BC03765: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB35938%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for AB35938: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB58662%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for XB58662: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR74432%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for YR74432: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66874%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for SG66874: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT34315%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for BT34315: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ05672%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for CZ05672: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL44411%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for SL44411: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK53036%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for BK53036: 0
2026-03-28 18:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:51 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL77544%27 HTTP/1.1" 200 None
2026-03-28 18:36:51 [auto1.de] INFO: Scrape type for DL77544: 0
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU90865%27 HTTP/1.1" 200 None
2026-03-28 18:36:51 [auto1.de] INFO: Scrape type for CU90865: 0
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU04580%27 HTTP/1.1" 200 None
2026-03-28 18:36:51 [auto1.de] INFO: Scrape type for NU04580: 2
2026-03-28 18:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 515d0a17-cd83-5781-b362-9ea184b1f5df with identifier: NU04580
2026-03-28 18:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 515d0a17-cd83-5781-b362-9ea184b1f5df with scrape type 2
2026-03-28 18:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 515d0a17-cd83-5781-b362-9ea184b1f5df with scrape type 2
2026-03-28 18:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 515d0a17-cd83-5781-b362-9ea184b1f5df, identifier: NU04580
2026-03-28 18:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 515d0a17-cd83-5781-b362-9ea184b1f5df with identifier: NU04580
2026-03-28 18:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 515d0a17-cd83-5781-b362-9ea184b1f5df with identifier: NU04580
2026-03-28 18:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 515d0a17-cd83-5781-b362-9ea184b1f5df with identifier: NU04580 to the API
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:45:28Z',
 'fuel_type': 'diesel',
 'id': '515d0a17-cd83-5781-b362-9ea184b1f5df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU04580',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 243220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
 'transmission': 'manual',
 'trim': 'T BlueTEC',
 'year': 2016}
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU04580%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Saving data for NU04580: {'auction_closing_time': 1774885528.0, 'created_time': 1773341063.311142, 'last_price_update_time': 1774723012.400642}
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU04580') HTTP/1.1" 204 0
2026-03-28 18:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF43434%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for CF43434: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB26744%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for GB26744: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH74255%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for KH74255: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL23560%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for TL23560: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE47693%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for BE47693: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA82816%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for KA82816: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ25719%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for VZ25719: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT22988%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for UT22988: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ97003%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for BJ97003: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP76245%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for LP76245: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP14042%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for WP14042: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33750%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for EC33750: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH70992%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for MH70992: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB91647%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for AB91647: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB27737%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for AB27737: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC28332%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for JC28332: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN44091%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for HN44091: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM15816%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for AM15816: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-28 18:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:53 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM57840%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for HM57840: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF52928%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for MF52928: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE15667%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for YE15667: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX08023%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for AX08023: 2
2026-03-28 18:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a12a14e-b05d-5016-a566-77e4c8abff50 with identifier: AX08023
2026-03-28 18:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a12a14e-b05d-5016-a566-77e4c8abff50 with scrape type 2
2026-03-28 18:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a12a14e-b05d-5016-a566-77e4c8abff50 with scrape type 2
2026-03-28 18:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a12a14e-b05d-5016-a566-77e4c8abff50, identifier: AX08023
2026-03-28 18:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a12a14e-b05d-5016-a566-77e4c8abff50 with identifier: AX08023
2026-03-28 18:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a12a14e-b05d-5016-a566-77e4c8abff50 with identifier: AX08023
2026-03-28 18:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a12a14e-b05d-5016-a566-77e4c8abff50 with identifier: AX08023 to the API
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:17:42Z',
 'fuel_type': 'diesel',
 'id': '4a12a14e-b05d-5016-a566-77e4c8abff50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX08023',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque Cabriolet',
 'odometer': 99243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Land Rover Evoque Cabriolet 2.0 Td4 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2017}
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX08023%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Saving data for AX08023: {'auction_closing_time': 1774883862.0, 'created_time': 1774522440.648222, 'last_price_update_time': 1774723014.261575}
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX08023') HTTP/1.1" 204 0
2026-03-28 18:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV16003%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for NV16003: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH75951%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for VH75951: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ81913%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for XZ81913: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP35673%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for ZP35673: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ76409%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for EZ76409: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ97529%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for NZ97529: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE98094%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for DE98094: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47676%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for EJ47676: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE90376%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for ZE90376: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC90935%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for SC90935: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR56411%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for PR56411: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK09609%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for NK09609: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL75790%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for UL75790: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: US49854
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US49854%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for US49854: 2
2026-03-28 18:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40912591-fd9c-5901-963e-8427a3878932 with identifier: US49854
2026-03-28 18:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40912591-fd9c-5901-963e-8427a3878932 with scrape type 2
2026-03-28 18:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40912591-fd9c-5901-963e-8427a3878932 with scrape type 2
2026-03-28 18:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40912591-fd9c-5901-963e-8427a3878932, identifier: US49854
2026-03-28 18:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40912591-fd9c-5901-963e-8427a3878932 with identifier: US49854
2026-03-28 18:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40912591-fd9c-5901-963e-8427a3878932 with identifier: US49854
2026-03-28 18:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40912591-fd9c-5901-963e-8427a3878932 with identifier: US49854 to the API
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:03:51Z',
 'fuel_type': 'diesel',
 'id': '40912591-fd9c-5901-963e-8427a3878932',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US49854',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 73325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi Bi-Turbo Titanium 4x4',
 'transmission': 'automatic',
 'trim': 'Titanium 4x4',
 'year': 2017}
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US49854%27 HTTP/1.1" 200 None
2026-03-28 18:36:55 [auto1.de] INFO: Saving data for US49854: {'auction_closing_time': 1774883031.0, 'created_time': 1773429518.74195, 'last_price_update_time': 1774723015.287563}
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US49854') HTTP/1.1" 204 0
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC97863%27 HTTP/1.1" 200 None
2026-03-28 18:36:55 [auto1.de] INFO: Scrape type for FC97863: 2
2026-03-28 18:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61cfaff5-319c-5618-9753-1facae6b8c7e with identifier: FC97863
2026-03-28 18:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61cfaff5-319c-5618-9753-1facae6b8c7e with scrape type 2
2026-03-28 18:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61cfaff5-319c-5618-9753-1facae6b8c7e with scrape type 2
2026-03-28 18:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61cfaff5-319c-5618-9753-1facae6b8c7e, identifier: FC97863
2026-03-28 18:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61cfaff5-319c-5618-9753-1facae6b8c7e with identifier: FC97863
2026-03-28 18:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61cfaff5-319c-5618-9753-1facae6b8c7e with identifier: FC97863
2026-03-28 18:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61cfaff5-319c-5618-9753-1facae6b8c7e with identifier: FC97863 to the API
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:56:24Z',
 'fuel_type': 'petrol',
 'id': '61cfaff5-319c-5618-9753-1facae6b8c7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC97863',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 190144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seller_name': None,
 'title': 'BMW 3er 330i GT xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2017}
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC97863%27 HTTP/1.1" 200 None
2026-03-28 18:36:55 [auto1.de] INFO: Saving data for FC97863: {'auction_closing_time': 1774886184.0, 'created_time': 1774521949.92873, 'last_price_update_time': 1774723015.816863}
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC97863') HTTP/1.1" 204 0
2026-03-28 18:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:56 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 6002 | hits on page: 40
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC97863%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for FC97863: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE14691%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for BE14691: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: NG35588
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE15038%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for CE15038: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR34714%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for MR34714: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG49246%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for RG49246: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64041%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for SJ64041: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91998%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for XT91998: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET94101%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for ET94101: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR49989%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for LR49989: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: VU33733
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95738%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for DL95738: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46959%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for WA46959: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ97715%27 HTTP/1.1" 200 None
2026-03-28 18:36:57 [auto1.de] INFO: Scrape type for SZ97715: 2
2026-03-28 18:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 187f86de-8f64-53d7-bed2-200c880b6ccd with identifier: SZ97715
2026-03-28 18:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 187f86de-8f64-53d7-bed2-200c880b6ccd with scrape type 2
2026-03-28 18:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 187f86de-8f64-53d7-bed2-200c880b6ccd with scrape type 2
2026-03-28 18:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 187f86de-8f64-53d7-bed2-200c880b6ccd, identifier: SZ97715
2026-03-28 18:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 187f86de-8f64-53d7-bed2-200c880b6ccd with identifier: SZ97715
2026-03-28 18:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 187f86de-8f64-53d7-bed2-200c880b6ccd with identifier: SZ97715
2026-03-28 18:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 187f86de-8f64-53d7-bed2-200c880b6ccd with identifier: SZ97715 to the API
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:39:13Z',
 'fuel_type': 'petrol',
 'id': '187f86de-8f64-53d7-bed2-200c880b6ccd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ97715',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 175981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-28',
 'seller_name': None,
 'title': 'Toyota Corolla 1.6 Compact Edition',
 'transmission': 'manual',
 'trim': 'Compact Edition',
 'year': 2007}
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ97715%27 HTTP/1.1" 200 None
2026-03-28 18:36:57 [auto1.de] INFO: Saving data for SZ97715: {'auction_closing_time': 1774885153.0, 'created_time': 1774636600.917641, 'last_price_update_time': 1774723017.401517}
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ97715') HTTP/1.1" 204 0
2026-03-28 18:36:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:57 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39068%27 HTTP/1.1" 200 None
2026-03-28 18:36:57 [auto1.de] INFO: Scrape type for BP39068: 0
2026-03-28 18:36:57 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-28 18:36:57 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV03143%27 HTTP/1.1" 200 None
2026-03-28 18:36:57 [auto1.de] INFO: Scrape type for YV03143: 0
2026-03-28 18:36:57 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-28 18:36:57 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ34801%27 HTTP/1.1" 200 None
2026-03-28 18:36:57 [auto1.de] INFO: Scrape type for BJ34801: 0
2026-03-28 18:36:57 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57746%27 HTTP/1.1" 200 None
2026-03-28 18:36:57 [auto1.de] INFO: Scrape type for VJ57746: 2
2026-03-28 18:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 156d4b01-0253-5152-be00-3ba89d411dd7 with identifier: VJ57746
2026-03-28 18:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 156d4b01-0253-5152-be00-3ba89d411dd7 with scrape type 2
2026-03-28 18:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 156d4b01-0253-5152-be00-3ba89d411dd7 with scrape type 2
2026-03-28 18:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 156d4b01-0253-5152-be00-3ba89d411dd7, identifier: VJ57746
2026-03-28 18:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 156d4b01-0253-5152-be00-3ba89d411dd7 with identifier: VJ57746
2026-03-28 18:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 156d4b01-0253-5152-be00-3ba89d411dd7 with identifier: VJ57746
2026-03-28 18:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 156d4b01-0253-5152-be00-3ba89d411dd7 with identifier: VJ57746 to the API
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:56Z',
 'fuel_type': 'diesel',
 'id': '156d4b01-0253-5152-be00-3ba89d411dd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ57746',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 111995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-06',
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2016}
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57746%27 HTTP/1.1" 200 None
2026-03-28 18:36:57 [auto1.de] INFO: Saving data for VJ57746: {'auction_closing_time': 1774884056.0, 'created_time': 1774522496.847732, 'last_price_update_time': 1774723017.990135}
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ57746') HTTP/1.1" 204 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: TU08005
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61695%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for VH61695: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK66887%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for MK66887: 0
2026-03-28 18:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:06 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD51611%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for BD51611: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ42176%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for AZ42176: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG37163%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for BG37163: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ89642%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for NZ89642: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK98725%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for YK98725: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96010%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for KF96010: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM79272%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for JM79272: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP83297%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for PP83297: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA99950%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for UA99950: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT53198%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for VT53198: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12981%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for RK12981: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL92267%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for EL92267: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN95479%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for JN95479: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES37621%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for ES37621: 2
2026-03-28 18:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b424181-86cc-5c82-b76f-1526ec122d63 with identifier: ES37621
2026-03-28 18:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b424181-86cc-5c82-b76f-1526ec122d63 with scrape type 2
2026-03-28 18:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b424181-86cc-5c82-b76f-1526ec122d63 with scrape type 2
2026-03-28 18:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b424181-86cc-5c82-b76f-1526ec122d63, identifier: ES37621
2026-03-28 18:37:06 [scrapy.extensions.logstats] INFO: Crawled 62 pages (at 20 pages/min), scraped 131 items (at 47 items/min)
2026-03-28 18:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-28 18:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b424181-86cc-5c82-b76f-1526ec122d63 with identifier: ES37621
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=other HTTP/1.1" 200 None
2026-03-28 18:37:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b424181-86cc-5c82-b76f-1526ec122d63 with identifier: ES37621
2026-03-28 18:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b424181-86cc-5c82-b76f-1526ec122d63 with identifier: ES37621 to the API
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'other',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:53:36Z',
 'fuel_type': 'hybrid',
 'id': '1b424181-86cc-5c82-b76f-1526ec122d63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES37621',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 53726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350de 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2022}
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES37621%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Saving data for ES37621: {'auction_closing_time': 1774886016.0, 'created_time': 1773345295.451001, 'last_price_update_time': 1774723026.862308}
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES37621') HTTP/1.1" 204 0
2026-03-28 18:37:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV67492%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Scrape type for FV67492: 0
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC77687%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Scrape type for HC77687: 0
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC64340%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Scrape type for VC64340: 0
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT94754%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Scrape type for DT94754: 0
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX63688%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Scrape type for TX63688: 0
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: PW12132
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB36710%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Scrape type for DB36710: 0
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR65343%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Scrape type for MR65343: 0
2026-03-28 18:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:08 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK50070%27 HTTP/1.1" 200 None
2026-03-28 18:37:08 [auto1.de] INFO: Scrape type for HK50070: 2
2026-03-28 18:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64126f43-58fa-512c-b655-e4dc8bdb427f with identifier: HK50070
2026-03-28 18:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64126f43-58fa-512c-b655-e4dc8bdb427f with scrape type 2
2026-03-28 18:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64126f43-58fa-512c-b655-e4dc8bdb427f with scrape type 2
2026-03-28 18:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64126f43-58fa-512c-b655-e4dc8bdb427f, identifier: HK50070
2026-03-28 18:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64126f43-58fa-512c-b655-e4dc8bdb427f with identifier: HK50070
2026-03-28 18:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64126f43-58fa-512c-b655-e4dc8bdb427f with identifier: HK50070
2026-03-28 18:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64126f43-58fa-512c-b655-e4dc8bdb427f with identifier: HK50070 to the API
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:23:55Z',
 'fuel_type': 'diesel',
 'id': '64126f43-58fa-512c-b655-e4dc8bdb427f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK50070',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix55',
 'odometer': 294582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-04',
 'seller_name': None,
 'title': 'Hyundai ix55 3.0 V6 CRDi Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2009}
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK50070%27 HTTP/1.1" 200 None
2026-03-28 18:37:08 [auto1.de] INFO: Saving data for HK50070: {'auction_closing_time': 1774884235.0, 'created_time': 1773228108.430564, 'last_price_update_time': 1774723028.616333}
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK50070') HTTP/1.1" 204 0
2026-03-28 18:37:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14525%27 HTTP/1.1" 200 None
2026-03-28 18:37:08 [auto1.de] INFO: Scrape type for SU14525: 0
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD56647%27 HTTP/1.1" 200 None
2026-03-28 18:37:08 [auto1.de] INFO: Scrape type for CD56647: 0
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP48554%27 HTTP/1.1" 200 None
2026-03-28 18:37:08 [auto1.de] INFO: Scrape type for KP48554: 0
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ83769%27 HTTP/1.1" 200 None
2026-03-28 18:37:08 [auto1.de] INFO: Scrape type for JJ83769: 0
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY74749%27 HTTP/1.1" 200 None
2026-03-28 18:37:08 [auto1.de] INFO: Scrape type for AY74749: 0
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD32112%27 HTTP/1.1" 200 None
2026-03-28 18:37:08 [auto1.de] INFO: Scrape type for SD32112: 2
2026-03-28 18:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with identifier: SD32112
2026-03-28 18:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with scrape type 2
2026-03-28 18:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with scrape type 2
2026-03-28 18:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4, identifier: SD32112
2026-03-28 18:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with identifier: SD32112
2026-03-28 18:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with identifier: SD32112
2026-03-28 18:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with identifier: SD32112 to the API
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:22:40Z',
 'fuel_type': 'petrol',
 'id': 'ba08164a-5096-5f5d-9ef4-a1ab7885dfc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD32112',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 95218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Active Colourline',
 'transmission': 'manual',
 'trim': 'Active Colourline',
 'year': 2019}
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD32112%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Saving data for SD32112: {'auction_closing_time': 1774884160.0, 'created_time': 1773945524.213484, 'last_price_update_time': 1774723029.264433}
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD32112') HTTP/1.1" 204 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ99970%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for RZ99970: 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM07006%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for DM07006: 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR96195%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for HR96195: 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU35390%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for AU35390: 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA74334%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for EA74334: 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH59538%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for YH59538: 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10355%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for VH10355: 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA54991%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for RA54991: 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED74506%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for ED74506: 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ60689%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for MJ60689: 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-28 18:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:10 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP29257%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for DP29257: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ12211%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for UJ12211: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG80154%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for NG80154: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64599%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for PN64599: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY44920%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for CY44920: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP37775%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for NP37775: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14264%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for UR14264: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC69838%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for AC69838: 2
2026-03-28 18:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with identifier: AC69838
2026-03-28 18:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with scrape type 2
2026-03-28 18:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with scrape type 2
2026-03-28 18:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae, identifier: AC69838
2026-03-28 18:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with identifier: AC69838
2026-03-28 18:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with identifier: AC69838
2026-03-28 18:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with identifier: AC69838 to the API
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:16:24Z',
 'fuel_type': 'petrol',
 'id': '4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC69838',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 201671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-30',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2011}
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC69838%27 HTTP/1.1" 200 None
2026-03-28 18:37:11 [auto1.de] INFO: Saving data for AC69838: {'auction_closing_time': 1774883784.0, 'created_time': 1774522242.16, 'last_price_update_time': 1774723031.118831}
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC69838') HTTP/1.1" 204 0
2026-03-28 18:37:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE16712%27 HTTP/1.1" 200 None
2026-03-28 18:37:11 [auto1.de] INFO: Scrape type for VE16712: 0
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64336%27 HTTP/1.1" 200 None
2026-03-28 18:37:11 [auto1.de] INFO: Scrape type for FT64336: 0
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35367%27 HTTP/1.1" 200 None
2026-03-28 18:37:11 [auto1.de] INFO: Scrape type for JG35367: 2
2026-03-28 18:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ada5c644-2419-50f4-b949-34d24b688f4a with identifier: JG35367
2026-03-28 18:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ada5c644-2419-50f4-b949-34d24b688f4a with scrape type 2
2026-03-28 18:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ada5c644-2419-50f4-b949-34d24b688f4a with scrape type 2
2026-03-28 18:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ada5c644-2419-50f4-b949-34d24b688f4a, identifier: JG35367
2026-03-28 18:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ada5c644-2419-50f4-b949-34d24b688f4a with identifier: JG35367
2026-03-28 18:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ada5c644-2419-50f4-b949-34d24b688f4a with identifier: JG35367
2026-03-28 18:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ada5c644-2419-50f4-b949-34d24b688f4a with identifier: JG35367 to the API
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:34:25Z',
 'fuel_type': 'diesel',
 'id': 'ada5c644-2419-50f4-b949-34d24b688f4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG35367',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 94727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35367%27 HTTP/1.1" 200 None
2026-03-28 18:37:11 [auto1.de] INFO: Saving data for JG35367: {'auction_closing_time': 1774884865.0, 'created_time': 1774522444.803613, 'last_price_update_time': 1774723031.694622}
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG35367') HTTP/1.1" 204 0
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM07569%27 HTTP/1.1" 200 None
2026-03-28 18:37:11 [auto1.de] INFO: Scrape type for JM07569: 2
2026-03-28 18:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee199af2-c46c-5adc-95f4-dc8e250ec1a6 with identifier: JM07569
2026-03-28 18:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee199af2-c46c-5adc-95f4-dc8e250ec1a6 with scrape type 2
2026-03-28 18:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee199af2-c46c-5adc-95f4-dc8e250ec1a6 with scrape type 2
2026-03-28 18:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee199af2-c46c-5adc-95f4-dc8e250ec1a6, identifier: JM07569
2026-03-28 18:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee199af2-c46c-5adc-95f4-dc8e250ec1a6 with identifier: JM07569
2026-03-28 18:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee199af2-c46c-5adc-95f4-dc8e250ec1a6 with identifier: JM07569
2026-03-28 18:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee199af2-c46c-5adc-95f4-dc8e250ec1a6 with identifier: JM07569 to the API
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:51:18Z',
 'fuel_type': 'diesel',
 'id': 'ee199af2-c46c-5adc-95f4-dc8e250ec1a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM07569',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 233291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM07569%27 HTTP/1.1" 200 None
2026-03-28 18:37:12 [auto1.de] INFO: Saving data for JM07569: {'auction_closing_time': 1774885878.0, 'created_time': 1774636610.829249, 'last_price_update_time': 1774723032.142275}
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM07569') HTTP/1.1" 204 0
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU30537%27 HTTP/1.1" 200 None
2026-03-28 18:37:12 [auto1.de] INFO: Scrape type for GU30537: 0
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ52823%27 HTTP/1.1" 200 None
2026-03-28 18:37:12 [auto1.de] INFO: Scrape type for XJ52823: 0
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98494%27 HTTP/1.1" 200 None
2026-03-28 18:37:12 [auto1.de] INFO: Scrape type for UR98494: 0
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: RU25678
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC57472%27 HTTP/1.1" 200 None
2026-03-28 18:37:12 [auto1.de] INFO: Scrape type for CC57472: 0
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13521%27 HTTP/1.1" 200 None
2026-03-28 18:37:12 [auto1.de] INFO: Scrape type for YY13521: 0
2026-03-28 18:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:13 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00695%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for BU00695: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH30720%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for GH30720: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER31380%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for ER31380: 2
2026-03-28 18:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8133f888-b442-5585-8cfd-404b082ecf78 with identifier: ER31380
2026-03-28 18:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8133f888-b442-5585-8cfd-404b082ecf78 with scrape type 2
2026-03-28 18:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8133f888-b442-5585-8cfd-404b082ecf78 with scrape type 2
2026-03-28 18:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8133f888-b442-5585-8cfd-404b082ecf78, identifier: ER31380
2026-03-28 18:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8133f888-b442-5585-8cfd-404b082ecf78 with identifier: ER31380
2026-03-28 18:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8133f888-b442-5585-8cfd-404b082ecf78 with identifier: ER31380
2026-03-28 18:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8133f888-b442-5585-8cfd-404b082ecf78 with identifier: ER31380 to the API
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:36:18Z',
 'fuel_type': 'petrol',
 'id': '8133f888-b442-5585-8cfd-404b082ecf78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER31380',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 98889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-11',
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2016}
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER31380%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Saving data for ER31380: {'auction_closing_time': 1774884978.0, 'created_time': 1774636595.897083, 'last_price_update_time': 1774723033.552609}
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER31380') HTTP/1.1" 204 0
2026-03-28 18:37:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94642%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for CJ94642: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF16745%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for WF16745: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP86837%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for ZP86837: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL07964%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for TL07964: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW57264%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for SW57264: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR15436%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for SR15436: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC84662%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for UC84662: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF45808%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for DF45808: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT91695%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for FT91695: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ58710%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for LZ58710: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46432%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for VV46432: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH27110%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for PH27110: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ26339%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for SJ26339: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM44288%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for RM44288: 2
2026-03-28 18:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7dadd69-4268-5386-bb11-a9fc32343992 with identifier: RM44288
2026-03-28 18:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7dadd69-4268-5386-bb11-a9fc32343992 with scrape type 2
2026-03-28 18:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7dadd69-4268-5386-bb11-a9fc32343992 with scrape type 2
2026-03-28 18:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7dadd69-4268-5386-bb11-a9fc32343992, identifier: RM44288
2026-03-28 18:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7dadd69-4268-5386-bb11-a9fc32343992 with identifier: RM44288
2026-03-28 18:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7dadd69-4268-5386-bb11-a9fc32343992 with identifier: RM44288
2026-03-28 18:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7dadd69-4268-5386-bb11-a9fc32343992 with identifier: RM44288 to the API
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:22:36Z',
 'fuel_type': 'diesel',
 'id': 'c7dadd69-4268-5386-bb11-a9fc32343992',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM44288',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 224714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-16',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM44288%27 HTTP/1.1" 200 None
2026-03-28 18:37:14 [auto1.de] INFO: Saving data for RM44288: {'auction_closing_time': 1774884156.0, 'created_time': 1774521588.523144, 'last_price_update_time': 1774723034.33321}
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM44288') HTTP/1.1" 204 0
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39576%27 HTTP/1.1" 200 None
2026-03-28 18:37:14 [auto1.de] INFO: Scrape type for EG39576: 0
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN99491%27 HTTP/1.1" 200 None
2026-03-28 18:37:14 [auto1.de] INFO: Scrape type for SN99491: 0
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK97473%27 HTTP/1.1" 200 None
2026-03-28 18:37:14 [auto1.de] INFO: Scrape type for WK97473: 0
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG38985%27 HTTP/1.1" 200 None
2026-03-28 18:37:14 [auto1.de] INFO: Scrape type for VG38985: 0
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: KV78740
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-28 18:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:16 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY92753%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for PY92753: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL12267%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for FL12267: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ04369%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for LJ04369: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72223%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for SD72223: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52630%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for RZ52630: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU53159%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for FU53159: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW76497%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for DW76497: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX37368%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for JX37368: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91741%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for YP91741: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81340%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for BP81340: 2
2026-03-28 18:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b41a123c-e89b-5dbd-af01-63be3ca46c37 with identifier: BP81340
2026-03-28 18:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b41a123c-e89b-5dbd-af01-63be3ca46c37 with scrape type 2
2026-03-28 18:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b41a123c-e89b-5dbd-af01-63be3ca46c37 with scrape type 2
2026-03-28 18:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b41a123c-e89b-5dbd-af01-63be3ca46c37, identifier: BP81340
2026-03-28 18:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b41a123c-e89b-5dbd-af01-63be3ca46c37 with identifier: BP81340
2026-03-28 18:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b41a123c-e89b-5dbd-af01-63be3ca46c37 with identifier: BP81340
2026-03-28 18:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b41a123c-e89b-5dbd-af01-63be3ca46c37 with identifier: BP81340 to the API
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:15:58Z',
 'fuel_type': 'petrol',
 'id': 'b41a123c-e89b-5dbd-af01-63be3ca46c37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP81340',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 200208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-30',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81340%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Saving data for BP81340: {'auction_closing_time': 1774883758.0, 'created_time': 1773917309.492338, 'last_price_update_time': 1774723036.68208}
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP81340') HTTP/1.1" 204 0
2026-03-28 18:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF63833%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for DF63833: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU39624%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for FU39624: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW83321%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for SW83321: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA37640%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for PA37640: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM22494%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for EM22494: 2
2026-03-28 18:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a1effc-b0de-5c9b-85c0-bf35fff7962e with identifier: EM22494
2026-03-28 18:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a1effc-b0de-5c9b-85c0-bf35fff7962e with scrape type 2
2026-03-28 18:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29a1effc-b0de-5c9b-85c0-bf35fff7962e with scrape type 2
2026-03-28 18:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29a1effc-b0de-5c9b-85c0-bf35fff7962e, identifier: EM22494
2026-03-28 18:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29a1effc-b0de-5c9b-85c0-bf35fff7962e with identifier: EM22494
2026-03-28 18:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29a1effc-b0de-5c9b-85c0-bf35fff7962e with identifier: EM22494
2026-03-28 18:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29a1effc-b0de-5c9b-85c0-bf35fff7962e with identifier: EM22494 to the API
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:33:59Z',
 'fuel_type': 'petrol',
 'id': '29a1effc-b0de-5c9b-85c0-bf35fff7962e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM22494',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 143229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'BMW 3er 328i GT xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM22494%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Saving data for EM22494: {'auction_closing_time': 1774884839.0, 'created_time': 1774521552.554999, 'last_price_update_time': 1774723037.389574}
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM22494') HTTP/1.1" 204 0
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD59606%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Scrape type for UD59606: 0
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU50288%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Scrape type for MU50288: 2
2026-03-28 18:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with identifier: MU50288
2026-03-28 18:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with scrape type 2
2026-03-28 18:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with scrape type 2
2026-03-28 18:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48c2b4a3-802d-59a1-8a39-6aea083e2e61, identifier: MU50288
2026-03-28 18:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with identifier: MU50288
2026-03-28 18:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with identifier: MU50288
2026-03-28 18:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with identifier: MU50288 to the API
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:46:01Z',
 'fuel_type': 'petrol',
 'id': '48c2b4a3-802d-59a1-8a39-6aea083e2e61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU50288',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 84113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Dacia Dokker 1.6 SCe Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2016}
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU50288%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Saving data for MU50288: {'auction_closing_time': 1774885561.0, 'created_time': 1773382817.353215, 'last_price_update_time': 1774723037.871235}
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU50288') HTTP/1.1" 204 0
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV18053%27 HTTP/1.1" 200 None
2026-03-28 18:37:18 [auto1.de] INFO: Scrape type for MV18053: 0
2026-03-28 18:37:18 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-28 18:37:18 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-28 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA22944%27 HTTP/1.1" 200 None
2026-03-28 18:37:18 [auto1.de] INFO: Scrape type for KA22944: 0
2026-03-28 18:37:18 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-28 18:37:18 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-28 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27918%27 HTTP/1.1" 200 None
2026-03-28 18:37:18 [auto1.de] INFO: Scrape type for AP27918: 0
2026-03-28 18:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:18 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:18 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-28 18:37:18 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-28 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB67029%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for HB67029: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK38056%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for PK38056: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ35619%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for EZ35619: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV27021%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for PV27021: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM08795%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for GM08795: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ25875%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for NZ25875: 2
2026-03-28 18:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with identifier: NZ25875
2026-03-28 18:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with scrape type 2
2026-03-28 18:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with scrape type 2
2026-03-28 18:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a, identifier: NZ25875
2026-03-28 18:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with identifier: NZ25875
2026-03-28 18:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with identifier: NZ25875
2026-03-28 18:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with identifier: NZ25875 to the API
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:04Z',
 'fuel_type': 'diesel',
 'id': '601e9cdd-97c9-525e-b7cf-7c4a8e449b2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ25875',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 260732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-14',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ25875%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Saving data for NZ25875: {'auction_closing_time': 1774885564.0, 'created_time': 1774521561.69777, 'last_price_update_time': 1774723039.535817}
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ25875') HTTP/1.1" 204 0
2026-03-28 18:37:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR95574%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for LR95574: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR11157%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for YR11157: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB39806%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for XB39806: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG85121%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for LG85121: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU93919%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for YU93919: 2
2026-03-28 18:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d38cf00-8821-5672-93b9-61bee1495ca9 with identifier: YU93919
2026-03-28 18:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d38cf00-8821-5672-93b9-61bee1495ca9 with scrape type 2
2026-03-28 18:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d38cf00-8821-5672-93b9-61bee1495ca9 with scrape type 2
2026-03-28 18:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d38cf00-8821-5672-93b9-61bee1495ca9, identifier: YU93919
2026-03-28 18:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d38cf00-8821-5672-93b9-61bee1495ca9 with identifier: YU93919
2026-03-28 18:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d38cf00-8821-5672-93b9-61bee1495ca9 with identifier: YU93919
2026-03-28 18:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d38cf00-8821-5672-93b9-61bee1495ca9 with identifier: YU93919 to the API
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:25:07Z',
 'fuel_type': 'petrol',
 'id': '1d38cf00-8821-5672-93b9-61bee1495ca9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU93919',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 82900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-27',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU93919%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Saving data for YU93919: {'auction_closing_time': 1774884307.0, 'created_time': 1774636637.382297, 'last_price_update_time': 1774723040.160836}
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU93919') HTTP/1.1" 204 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE25882%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for TE25882: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR74805%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for LR74805: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX03618%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for MX03618: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC30039%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for DC30039: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP20467%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for MP20467: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63954%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for UK63954: 2
2026-03-28 18:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed63697-20ff-502a-a518-a6e3ed065080 with identifier: UK63954
2026-03-28 18:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed63697-20ff-502a-a518-a6e3ed065080 with scrape type 2
2026-03-28 18:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fed63697-20ff-502a-a518-a6e3ed065080 with scrape type 2
2026-03-28 18:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fed63697-20ff-502a-a518-a6e3ed065080, identifier: UK63954
2026-03-28 18:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fed63697-20ff-502a-a518-a6e3ed065080 with identifier: UK63954
2026-03-28 18:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fed63697-20ff-502a-a518-a6e3ed065080 with identifier: UK63954
2026-03-28 18:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fed63697-20ff-502a-a518-a6e3ed065080 with identifier: UK63954 to the API
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:49:48Z',
 'fuel_type': 'diesel',
 'id': 'fed63697-20ff-502a-a518-a6e3ed065080',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK63954',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 156224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-27',
 'seller_name': None,
 'title': 'BMW 5er 540d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2018}
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63954%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Saving data for UK63954: {'auction_closing_time': 1774885788.0, 'created_time': 1774522466.489692, 'last_price_update_time': 1774723040.770451}
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK63954') HTTP/1.1" 204 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF62011%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for CF62011: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS29851%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for JS29851: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM82441%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for VM82441: 0
2026-03-28 18:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:22 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK07510%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Scrape type for FK07510: 2
2026-03-28 18:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30eb1c70-fef3-54e4-bdb6-dd67548bae53 with identifier: FK07510
2026-03-28 18:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30eb1c70-fef3-54e4-bdb6-dd67548bae53 with scrape type 2
2026-03-28 18:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30eb1c70-fef3-54e4-bdb6-dd67548bae53 with scrape type 2
2026-03-28 18:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30eb1c70-fef3-54e4-bdb6-dd67548bae53, identifier: FK07510
2026-03-28 18:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30eb1c70-fef3-54e4-bdb6-dd67548bae53 with identifier: FK07510
2026-03-28 18:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30eb1c70-fef3-54e4-bdb6-dd67548bae53 with identifier: FK07510
2026-03-28 18:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30eb1c70-fef3-54e4-bdb6-dd67548bae53 with identifier: FK07510 to the API
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:57:57Z',
 'fuel_type': 'petrol',
 'id': '30eb1c70-fef3-54e4-bdb6-dd67548bae53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK07510',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 343787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-21',
 'seller_name': None,
 'title': 'BMW 3er 320Ci',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK07510%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Saving data for FK07510: {'auction_closing_time': 1774886277.0, 'created_time': 1773303037.949585, 'last_price_update_time': 1774723042.524827}
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK07510') HTTP/1.1" 204 0
2026-03-28 18:37:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF80406%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Scrape type for WF80406: 0
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC92334%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Scrape type for KC92334: 0
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV15826%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Scrape type for SV15826: 0
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP86079%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Scrape type for WP86079: 0
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN30435%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Scrape type for LN30435: 0
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY26571%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Scrape type for EY26571: 0
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST87748%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Scrape type for ST87748: 0
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL97595%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Scrape type for DL97595: 0
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE57105%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Scrape type for VE57105: 0
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC99000%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Scrape type for CC99000: 2
2026-03-28 18:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da322c59-9334-52c4-a80a-21c9badf40d4 with identifier: CC99000
2026-03-28 18:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da322c59-9334-52c4-a80a-21c9badf40d4 with scrape type 2
2026-03-28 18:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da322c59-9334-52c4-a80a-21c9badf40d4 with scrape type 2
2026-03-28 18:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da322c59-9334-52c4-a80a-21c9badf40d4, identifier: CC99000
2026-03-28 18:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da322c59-9334-52c4-a80a-21c9badf40d4 with identifier: CC99000
2026-03-28 18:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da322c59-9334-52c4-a80a-21c9badf40d4 with identifier: CC99000
2026-03-28 18:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da322c59-9334-52c4-a80a-21c9badf40d4 with identifier: CC99000 to the API
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:51:40Z',
 'fuel_type': 'petrol',
 'id': 'da322c59-9334-52c4-a80a-21c9badf40d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC99000',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 96033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-26',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2010}
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC99000%27 HTTP/1.1" 200 None
2026-03-28 18:37:23 [auto1.de] INFO: Saving data for CC99000: {'auction_closing_time': 1774885900.0, 'created_time': 1774522187.993582, 'last_price_update_time': 1774723043.160553}
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC99000') HTTP/1.1" 204 0
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB25361%27 HTTP/1.1" 200 None
2026-03-28 18:37:23 [auto1.de] INFO: Scrape type for UB25361: 0
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB12842%27 HTTP/1.1" 200 None
2026-03-28 18:37:23 [auto1.de] INFO: Scrape type for CB12842: 0
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63570%27 HTTP/1.1" 200 None
2026-03-28 18:37:23 [auto1.de] INFO: Scrape type for TN63570: 0
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX08843%27 HTTP/1.1" 200 None
2026-03-28 18:37:23 [auto1.de] INFO: Scrape type for PX08843: 0
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG93766%27 HTTP/1.1" 200 None
2026-03-28 18:37:23 [auto1.de] INFO: Scrape type for UG93766: 0
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH53485%27 HTTP/1.1" 200 None
2026-03-28 18:37:23 [auto1.de] INFO: Scrape type for FH53485: 0
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB33429%27 HTTP/1.1" 200 None
2026-03-28 18:37:23 [auto1.de] INFO: Scrape type for JB33429: 2
2026-03-28 18:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with identifier: JB33429
2026-03-28 18:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with scrape type 2
2026-03-28 18:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with scrape type 2
2026-03-28 18:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ea037ab-8aa6-5e60-963b-ffd280e343a9, identifier: JB33429
2026-03-28 18:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with identifier: JB33429
2026-03-28 18:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with identifier: JB33429
2026-03-28 18:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with identifier: JB33429 to the API
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:19:04Z',
 'fuel_type': 'petrol',
 'id': '9ea037ab-8aa6-5e60-963b-ffd280e343a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB33429',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 51287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-20',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Experience',
 'transmission': 'automatic',
 'trim': 'Experience',
 'year': 2017}
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB33429%27 HTTP/1.1" 200 None
2026-03-28 18:37:23 [auto1.de] INFO: Saving data for JB33429: {'auction_closing_time': 1774883944.0, 'created_time': 1774522628.154338, 'last_price_update_time': 1774723043.804905}
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB33429') HTTP/1.1" 204 0
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34551%27 HTTP/1.1" 200 None
2026-03-28 18:37:23 [auto1.de] INFO: Scrape type for AL34551: 2
2026-03-28 18:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c12c7325-bbda-58aa-a7db-87bbba1fe59b with identifier: AL34551
2026-03-28 18:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c12c7325-bbda-58aa-a7db-87bbba1fe59b with scrape type 2
2026-03-28 18:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c12c7325-bbda-58aa-a7db-87bbba1fe59b with scrape type 2
2026-03-28 18:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c12c7325-bbda-58aa-a7db-87bbba1fe59b, identifier: AL34551
2026-03-28 18:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c12c7325-bbda-58aa-a7db-87bbba1fe59b with identifier: AL34551
2026-03-28 18:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c12c7325-bbda-58aa-a7db-87bbba1fe59b with identifier: AL34551
2026-03-28 18:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c12c7325-bbda-58aa-a7db-87bbba1fe59b with identifier: AL34551 to the API
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:51:56Z',
 'fuel_type': 'petrol',
 'id': 'c12c7325-bbda-58aa-a7db-87bbba1fe59b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL34551',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 112550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-26',
 'seller_name': None,
 'title': 'Renault Megane 1.2 BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34551%27 HTTP/1.1" 200 None
2026-03-28 18:37:24 [auto1.de] INFO: Saving data for AL34551: {'auction_closing_time': 1774885916.0, 'created_time': 1774521556.467277, 'last_price_update_time': 1774723044.253069}
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL34551') HTTP/1.1" 204 0
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95499%27 HTTP/1.1" 200 None
2026-03-28 18:37:24 [auto1.de] INFO: Scrape type for DL95499: 0
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-28 18:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:25 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK59033%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Scrape type for CK59033: 2
2026-03-28 18:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e79539-dad3-54b0-bbb2-a0517f5a3682 with identifier: CK59033
2026-03-28 18:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e79539-dad3-54b0-bbb2-a0517f5a3682 with scrape type 2
2026-03-28 18:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7e79539-dad3-54b0-bbb2-a0517f5a3682 with scrape type 2
2026-03-28 18:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7e79539-dad3-54b0-bbb2-a0517f5a3682, identifier: CK59033
2026-03-28 18:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7e79539-dad3-54b0-bbb2-a0517f5a3682 with identifier: CK59033
2026-03-28 18:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7e79539-dad3-54b0-bbb2-a0517f5a3682 with identifier: CK59033
2026-03-28 18:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7e79539-dad3-54b0-bbb2-a0517f5a3682 with identifier: CK59033 to the API
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:37:39Z',
 'fuel_type': 'diesel',
 'id': 'e7e79539-dad3-54b0-bbb2-a0517f5a3682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK59033',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 114303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK59033%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Saving data for CK59033: {'auction_closing_time': 1774885059.0, 'created_time': 1773426942.174199, 'last_price_update_time': 1774723045.632877}
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK59033') HTTP/1.1" 204 0
2026-03-28 18:37:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT42363%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Scrape type for DT42363: 0
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96921%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Scrape type for GE96921: 0
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM95893%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Scrape type for DM95893: 0
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75116%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Scrape type for JW75116: 0
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN96808%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Scrape type for UN96808: 0
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW78199%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Scrape type for DW78199: 0
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS73501%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Scrape type for JS73501: 0
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE41778%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Scrape type for DE41778: 0
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB33155%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Scrape type for GB33155: 0
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16553%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Scrape type for GE16553: 0
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA42451%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Scrape type for MA42451: 2
2026-03-28 18:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef96b239-8aea-5bf6-81c9-ac6ca2d07872 with identifier: MA42451
2026-03-28 18:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef96b239-8aea-5bf6-81c9-ac6ca2d07872 with scrape type 2
2026-03-28 18:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef96b239-8aea-5bf6-81c9-ac6ca2d07872 with scrape type 2
2026-03-28 18:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef96b239-8aea-5bf6-81c9-ac6ca2d07872, identifier: MA42451
2026-03-28 18:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef96b239-8aea-5bf6-81c9-ac6ca2d07872 with identifier: MA42451
2026-03-28 18:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef96b239-8aea-5bf6-81c9-ac6ca2d07872 with identifier: MA42451
2026-03-28 18:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef96b239-8aea-5bf6-81c9-ac6ca2d07872 with identifier: MA42451 to the API
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:55:17Z',
 'fuel_type': 'diesel',
 'id': 'ef96b239-8aea-5bf6-81c9-ac6ca2d07872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA42451',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 106368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-11',
 'seller_name': None,
 'title': 'Opel Vivaro 2.0 CDTI Kombi L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kombi L1H1 2,7t',
 'year': 2013}
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA42451%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Saving data for MA42451: {'auction_closing_time': 1774886117.0, 'created_time': 1773831260.018224, 'last_price_update_time': 1774723046.260894}
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA42451') HTTP/1.1" 204 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU85949%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for AU85949: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP97012%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for SP97012: 2
2026-03-28 18:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a37772f-de89-5640-b593-3f7dd9722c1f with identifier: SP97012
2026-03-28 18:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a37772f-de89-5640-b593-3f7dd9722c1f with scrape type 2
2026-03-28 18:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a37772f-de89-5640-b593-3f7dd9722c1f with scrape type 2
2026-03-28 18:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a37772f-de89-5640-b593-3f7dd9722c1f, identifier: SP97012
2026-03-28 18:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a37772f-de89-5640-b593-3f7dd9722c1f with identifier: SP97012
2026-03-28 18:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a37772f-de89-5640-b593-3f7dd9722c1f with identifier: SP97012
2026-03-28 18:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a37772f-de89-5640-b593-3f7dd9722c1f with identifier: SP97012 to the API
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:50:46Z',
 'fuel_type': 'petrol',
 'id': '1a37772f-de89-5640-b593-3f7dd9722c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP97012',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 110572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-06',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Passion',
 'transmission': 'manual',
 'trim': 'Passion',
 'year': 2016}
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP97012%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Saving data for SP97012: {'auction_closing_time': 1774885846.0, 'created_time': 1774550132.308179, 'last_price_update_time': 1774723046.81309}
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP97012') HTTP/1.1" 204 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL90308%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for EL90308: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: UB34830
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV57112%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for KV57112: 2
2026-03-28 18:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 346156e2-f9e2-5727-93ca-a77304334280 with identifier: KV57112
2026-03-28 18:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 346156e2-f9e2-5727-93ca-a77304334280 with scrape type 2
2026-03-28 18:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 346156e2-f9e2-5727-93ca-a77304334280 with scrape type 2
2026-03-28 18:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 346156e2-f9e2-5727-93ca-a77304334280, identifier: KV57112
2026-03-28 18:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 346156e2-f9e2-5727-93ca-a77304334280 with identifier: KV57112
2026-03-28 18:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 346156e2-f9e2-5727-93ca-a77304334280 with identifier: KV57112
2026-03-28 18:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 346156e2-f9e2-5727-93ca-a77304334280 with identifier: KV57112 to the API
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:36:12Z',
 'fuel_type': 'diesel',
 'id': '346156e2-f9e2-5727-93ca-a77304334280',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV57112',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 131139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-06',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 250 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV57112%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Saving data for KV57112: {'auction_closing_time': 1774884972.0, 'created_time': 1774034648.295742, 'last_price_update_time': 1774723047.26279}
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV57112') HTTP/1.1" 204 0
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR96643%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Scrape type for MR96643: 0
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR08367%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Scrape type for ZR08367: 2
2026-03-28 18:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25d98715-d5bd-5045-b106-666888f5010e with identifier: ZR08367
2026-03-28 18:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d98715-d5bd-5045-b106-666888f5010e with scrape type 2
2026-03-28 18:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25d98715-d5bd-5045-b106-666888f5010e with scrape type 2
2026-03-28 18:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25d98715-d5bd-5045-b106-666888f5010e, identifier: ZR08367
2026-03-28 18:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25d98715-d5bd-5045-b106-666888f5010e with identifier: ZR08367
2026-03-28 18:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25d98715-d5bd-5045-b106-666888f5010e with identifier: ZR08367
2026-03-28 18:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25d98715-d5bd-5045-b106-666888f5010e with identifier: ZR08367 to the API
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:57:41Z',
 'fuel_type': 'petrol',
 'id': '25d98715-d5bd-5045-b106-666888f5010e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR08367',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 107814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-31',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR08367%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Saving data for ZR08367: {'auction_closing_time': 1774886261.0, 'created_time': 1774521562.999123, 'last_price_update_time': 1774723047.757147}
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR08367') HTTP/1.1" 204 0
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC04938%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Scrape type for GC04938: 0
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH56246%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Scrape type for CH56246: 0
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK31305%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Scrape type for VK31305: 0
2026-03-28 18:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:28 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK31305%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Scrape type for VK31305: 0
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX77194%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Scrape type for SX77194: 0
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ71458%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Scrape type for WJ71458: 0
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ35475%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Scrape type for XZ35475: 0
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS76015%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Scrape type for CS76015: 2
2026-03-28 18:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4d3b1f0-1250-51d7-9894-06060af54cae with identifier: CS76015
2026-03-28 18:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d3b1f0-1250-51d7-9894-06060af54cae with scrape type 2
2026-03-28 18:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4d3b1f0-1250-51d7-9894-06060af54cae with scrape type 2
2026-03-28 18:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4d3b1f0-1250-51d7-9894-06060af54cae, identifier: CS76015
2026-03-28 18:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4d3b1f0-1250-51d7-9894-06060af54cae with identifier: CS76015
2026-03-28 18:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4d3b1f0-1250-51d7-9894-06060af54cae with identifier: CS76015
2026-03-28 18:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4d3b1f0-1250-51d7-9894-06060af54cae with identifier: CS76015 to the API
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:38:26Z',
 'fuel_type': 'petrol',
 'id': 'a4d3b1f0-1250-51d7-9894-06060af54cae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS76015',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 55477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-11',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2016}
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS76015%27 HTTP/1.1" 200 None
2026-03-28 18:37:29 [auto1.de] INFO: Saving data for CS76015: {'auction_closing_time': 1774885106.0, 'created_time': 1774636642.030374, 'last_price_update_time': 1774723049.125452}
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS76015') HTTP/1.1" 204 0
2026-03-28 18:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH40808%27 HTTP/1.1" 200 None
2026-03-28 18:37:29 [auto1.de] INFO: Scrape type for UH40808: 0
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU52502%27 HTTP/1.1" 200 None
2026-03-28 18:37:29 [auto1.de] INFO: Scrape type for XU52502: 0
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ51408%27 HTTP/1.1" 200 None
2026-03-28 18:37:29 [auto1.de] INFO: Scrape type for YJ51408: 0
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: XN70423
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX27277%27 HTTP/1.1" 200 None
2026-03-28 18:37:29 [auto1.de] INFO: Scrape type for EX27277: 2
2026-03-28 18:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a53456ef-07da-57e0-8532-8606bba5fcf4 with identifier: EX27277
2026-03-28 18:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a53456ef-07da-57e0-8532-8606bba5fcf4 with scrape type 2
2026-03-28 18:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a53456ef-07da-57e0-8532-8606bba5fcf4 with scrape type 2
2026-03-28 18:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a53456ef-07da-57e0-8532-8606bba5fcf4, identifier: EX27277
2026-03-28 18:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a53456ef-07da-57e0-8532-8606bba5fcf4 with identifier: EX27277
2026-03-28 18:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a53456ef-07da-57e0-8532-8606bba5fcf4 with identifier: EX27277
2026-03-28 18:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a53456ef-07da-57e0-8532-8606bba5fcf4 with identifier: EX27277 to the API
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:39:15Z',
 'fuel_type': 'petrol',
 'id': 'a53456ef-07da-57e0-8532-8606bba5fcf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX27277',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 190703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-22',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 Kombi',
 'transmission': 'manual',
 'trim': 'Kombi',
 'year': 2004}
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX27277%27 HTTP/1.1" 200 None
2026-03-28 18:37:29 [auto1.de] INFO: Saving data for EX27277: {'auction_closing_time': 1774885155.0, 'created_time': 1773387366.282428, 'last_price_update_time': 1774723049.727791}
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX27277') HTTP/1.1" 204 0
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25868%27 HTTP/1.1" 200 None
2026-03-28 18:37:29 [auto1.de] INFO: Scrape type for UA25868: 0
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ60723%27 HTTP/1.1" 200 None
2026-03-28 18:37:29 [auto1.de] INFO: Scrape type for MZ60723: 0
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX50427%27 HTTP/1.1" 200 None
2026-03-28 18:37:29 [auto1.de] INFO: Scrape type for VX50427: 0
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19657%27 HTTP/1.1" 200 None
2026-03-28 18:37:29 [auto1.de] INFO: Scrape type for GB19657: 2
2026-03-28 18:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6eb3ecf-0385-5581-9ea6-c3c495d3066b with identifier: GB19657
2026-03-28 18:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6eb3ecf-0385-5581-9ea6-c3c495d3066b with scrape type 2
2026-03-28 18:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6eb3ecf-0385-5581-9ea6-c3c495d3066b with scrape type 2
2026-03-28 18:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6eb3ecf-0385-5581-9ea6-c3c495d3066b, identifier: GB19657
2026-03-28 18:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6eb3ecf-0385-5581-9ea6-c3c495d3066b with identifier: GB19657
2026-03-28 18:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6eb3ecf-0385-5581-9ea6-c3c495d3066b with identifier: GB19657
2026-03-28 18:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6eb3ecf-0385-5581-9ea6-c3c495d3066b with identifier: GB19657 to the API
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:28:38Z',
 'fuel_type': 'petrol',
 'id': 'a6eb3ecf-0385-5581-9ea6-c3c495d3066b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB19657',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 118632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-24',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19657%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Saving data for GB19657: {'auction_closing_time': 1774884518.0, 'created_time': 1773402151.748617, 'last_price_update_time': 1774723050.378127}
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB19657') HTTP/1.1" 204 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: JJ39643
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ39643%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for JJ39643: 2
2026-03-28 18:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e7034be-46ca-5daf-9cf3-3e71776ec507 with identifier: JJ39643
2026-03-28 18:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e7034be-46ca-5daf-9cf3-3e71776ec507 with scrape type 2
2026-03-28 18:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e7034be-46ca-5daf-9cf3-3e71776ec507 with scrape type 2
2026-03-28 18:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e7034be-46ca-5daf-9cf3-3e71776ec507, identifier: JJ39643
2026-03-28 18:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e7034be-46ca-5daf-9cf3-3e71776ec507 with identifier: JJ39643
2026-03-28 18:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e7034be-46ca-5daf-9cf3-3e71776ec507 with identifier: JJ39643
2026-03-28 18:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e7034be-46ca-5daf-9cf3-3e71776ec507 with identifier: JJ39643 to the API
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:44:43Z',
 'fuel_type': 'diesel',
 'id': '0e7034be-46ca-5daf-9cf3-3e71776ec507',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ39643',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'R-Klasse',
 'odometer': 355203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-11',
 'seller_name': None,
 'title': 'Mercedes-Benz R-Klasse R 300 CDI BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2012}
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ39643%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Saving data for JJ39643: {'auction_closing_time': 1774885483.0, 'created_time': 1774002450.925007, 'last_price_update_time': 1774723050.840182}
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ39643') HTTP/1.1" 204 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB12349%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for WB12349: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL38868%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for KL38868: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ31953%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for BJ31953: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09023%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for DB09023: 0
2026-03-28 18:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:31 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF93652%27 HTTP/1.1" 200 None
2026-03-28 18:37:31 [auto1.de] INFO: Scrape type for DF93652: 0
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN73895%27 HTTP/1.1" 200 None
2026-03-28 18:37:31 [auto1.de] INFO: Scrape type for ZN73895: 0
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL76772%27 HTTP/1.1" 200 None
2026-03-28 18:37:31 [auto1.de] INFO: Scrape type for TL76772: 0
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: EC81606
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC81606%27 HTTP/1.1" 200 None
2026-03-28 18:37:31 [auto1.de] INFO: Scrape type for EC81606: 2
2026-03-28 18:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63d48810-3049-56cc-b4bc-256b36f7b081 with identifier: EC81606
2026-03-28 18:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63d48810-3049-56cc-b4bc-256b36f7b081 with scrape type 2
2026-03-28 18:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63d48810-3049-56cc-b4bc-256b36f7b081 with scrape type 2
2026-03-28 18:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63d48810-3049-56cc-b4bc-256b36f7b081, identifier: EC81606
2026-03-28 18:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63d48810-3049-56cc-b4bc-256b36f7b081 with identifier: EC81606
2026-03-28 18:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63d48810-3049-56cc-b4bc-256b36f7b081 with identifier: EC81606
2026-03-28 18:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63d48810-3049-56cc-b4bc-256b36f7b081 with identifier: EC81606 to the API
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:15:05Z',
 'fuel_type': 'petrol',
 'id': '63d48810-3049-56cc-b4bc-256b36f7b081',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC81606',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 178925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-06',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC81606%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Saving data for EC81606: {'auction_closing_time': 1774883705.0, 'created_time': 1774089533.795378, 'last_price_update_time': 1774723052.264557}
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC81606') HTTP/1.1" 204 0
2026-03-28 18:37:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA89012%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Scrape type for WA89012: 0
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91844%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Scrape type for MW91844: 0
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA54301%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Scrape type for VA54301: 2
2026-03-28 18:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53c19188-3369-53d3-bfc0-078b879d1b1f with identifier: VA54301
2026-03-28 18:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c19188-3369-53d3-bfc0-078b879d1b1f with scrape type 2
2026-03-28 18:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53c19188-3369-53d3-bfc0-078b879d1b1f with scrape type 2
2026-03-28 18:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53c19188-3369-53d3-bfc0-078b879d1b1f, identifier: VA54301
2026-03-28 18:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53c19188-3369-53d3-bfc0-078b879d1b1f with identifier: VA54301
2026-03-28 18:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53c19188-3369-53d3-bfc0-078b879d1b1f with identifier: VA54301
2026-03-28 18:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53c19188-3369-53d3-bfc0-078b879d1b1f with identifier: VA54301 to the API
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:08:08Z',
 'fuel_type': 'petrol',
 'id': '53c19188-3369-53d3-bfc0-078b879d1b1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA54301',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 54101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-10',
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2018}
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA54301%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Saving data for VA54301: {'auction_closing_time': 1774883288.0, 'created_time': 1772544081.676093, 'last_price_update_time': 1774723052.866087}
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA54301') HTTP/1.1" 204 0
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX63179%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Scrape type for XX63179: 0
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY47852%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Scrape type for HY47852: 0
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09271%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Scrape type for SM09271: 0
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX42832%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Scrape type for DX42832: 0
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34106%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Scrape type for SY34106: 0
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND90067%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Scrape type for ND90067: 0
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72953%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Scrape type for CK72953: 0
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF56816%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Scrape type for MF56816: 2
2026-03-28 18:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8d0ebea-faf1-51a4-bbb9-707001d8db27 with identifier: MF56816
2026-03-28 18:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8d0ebea-faf1-51a4-bbb9-707001d8db27 with scrape type 2
2026-03-28 18:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8d0ebea-faf1-51a4-bbb9-707001d8db27 with scrape type 2
2026-03-28 18:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8d0ebea-faf1-51a4-bbb9-707001d8db27, identifier: MF56816
2026-03-28 18:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8d0ebea-faf1-51a4-bbb9-707001d8db27 with identifier: MF56816
2026-03-28 18:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8d0ebea-faf1-51a4-bbb9-707001d8db27 with identifier: MF56816
2026-03-28 18:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8d0ebea-faf1-51a4-bbb9-707001d8db27 with identifier: MF56816 to the API
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:47:15Z',
 'fuel_type': 'diesel',
 'id': 'e8d0ebea-faf1-51a4-bbb9-707001d8db27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF56816',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 165894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-28',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF56816%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Saving data for MF56816: {'auction_closing_time': 1774885635.0, 'created_time': 1774522036.277938, 'last_price_update_time': 1774723053.475867}
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF56816') HTTP/1.1" 204 0
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY46067%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Scrape type for PY46067: 0
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03477%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Scrape type for WB03477: 0
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM55237%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Scrape type for YM55237: 0
2026-03-28 18:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:34 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY23917%27 HTTP/1.1" 200 None
2026-03-28 18:37:34 [auto1.de] INFO: Scrape type for GY23917: 0
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58590%27 HTTP/1.1" 200 None
2026-03-28 18:37:34 [auto1.de] INFO: Scrape type for SG58590: 0
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC43616%27 HTTP/1.1" 200 None
2026-03-28 18:37:34 [auto1.de] INFO: Scrape type for NC43616: 0
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL36228%27 HTTP/1.1" 200 None
2026-03-28 18:37:34 [auto1.de] INFO: Scrape type for NL36228: 2
2026-03-28 18:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with identifier: NL36228
2026-03-28 18:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with scrape type 2
2026-03-28 18:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with scrape type 2
2026-03-28 18:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6, identifier: NL36228
2026-03-28 18:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with identifier: NL36228
2026-03-28 18:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with identifier: NL36228
2026-03-28 18:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with identifier: NL36228 to the API
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:50:06Z',
 'fuel_type': 'petrol',
 'id': '4caa522a-fecf-53c2-876e-e1d9cd2c25b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL36228',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 86197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-06',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL36228%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Saving data for NL36228: {'auction_closing_time': 1774885806.0, 'created_time': 1773429458.45857, 'last_price_update_time': 1774723055.14722}
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL36228') HTTP/1.1" 204 0
2026-03-28 18:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09769%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Scrape type for SM09769: 0
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11985%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Scrape type for SA11985: 0
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML64265%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Scrape type for ML64265: 0
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA44966%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Scrape type for RA44966: 0
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23717%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Scrape type for NU23717: 0
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT79554%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Scrape type for RT79554: 0
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95489%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Scrape type for HB95489: 0
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU18943%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Scrape type for ZU18943: 0
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ68009%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Scrape type for JJ68009: 2
2026-03-28 18:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d with identifier: JJ68009
2026-03-28 18:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d with scrape type 2
2026-03-28 18:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d with scrape type 2
2026-03-28 18:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d, identifier: JJ68009
2026-03-28 18:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d with identifier: JJ68009
2026-03-28 18:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d with identifier: JJ68009
2026-03-28 18:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d with identifier: JJ68009 to the API
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:45:55Z',
 'fuel_type': 'diesel',
 'id': '5a1bf5b5-17f5-57f4-a24a-ee55931ec27d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ68009',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Caravelle',
 'odometer': 191246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-30',
 'seller_name': None,
 'title': 'Volkswagen T5 Caravelle 2.0 TDI omfortline 4Motion',
 'transmission': 'manual',
 'trim': 'omfortline 4Motion',
 'year': 2014}
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ68009%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Saving data for JJ68009: {'auction_closing_time': 1774885555.0, 'created_time': 1774636638.488969, 'last_price_update_time': 1774723055.858104}
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ68009') HTTP/1.1" 204 0
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR61198%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Scrape type for CR61198: 0
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP61360%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for ZP61360: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ04747%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for UZ04747: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB41592%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for PB41592: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV47355%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for TV47355: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH96711%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for EH96711: 0
2026-03-28 18:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:37 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL56937%27 HTTP/1.1" 200 None
2026-03-28 18:37:37 [auto1.de] INFO: Scrape type for XL56937: 0
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE62797%27 HTTP/1.1" 200 None
2026-03-28 18:37:37 [auto1.de] INFO: Scrape type for DE62797: 0
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN55276%27 HTTP/1.1" 200 None
2026-03-28 18:37:37 [auto1.de] INFO: Scrape type for BN55276: 0
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT51313%27 HTTP/1.1" 200 None
2026-03-28 18:37:37 [auto1.de] INFO: Scrape type for JT51313: 0
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN15165%27 HTTP/1.1" 200 None
2026-03-28 18:37:37 [auto1.de] INFO: Scrape type for AN15165: 0
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF88064%27 HTTP/1.1" 200 None
2026-03-28 18:37:37 [auto1.de] INFO: Scrape type for NF88064: 2
2026-03-28 18:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92de2b6d-5010-5db3-ad16-9b4571e94f00 with identifier: NF88064
2026-03-28 18:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92de2b6d-5010-5db3-ad16-9b4571e94f00 with scrape type 2
2026-03-28 18:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92de2b6d-5010-5db3-ad16-9b4571e94f00 with scrape type 2
2026-03-28 18:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92de2b6d-5010-5db3-ad16-9b4571e94f00, identifier: NF88064
2026-03-28 18:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92de2b6d-5010-5db3-ad16-9b4571e94f00 with identifier: NF88064
2026-03-28 18:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92de2b6d-5010-5db3-ad16-9b4571e94f00 with identifier: NF88064
2026-03-28 18:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92de2b6d-5010-5db3-ad16-9b4571e94f00 with identifier: NF88064 to the API
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:58:11Z',
 'fuel_type': 'petrol',
 'id': '92de2b6d-5010-5db3-ad16-9b4571e94f00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF88064',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 142808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-08',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TSI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF88064%27 HTTP/1.1" 200 None
2026-03-28 18:37:37 [auto1.de] INFO: Saving data for NF88064: {'auction_closing_time': 1774886291.0, 'created_time': 1773381630.819834, 'last_price_update_time': 1774723057.674954}
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF88064') HTTP/1.1" 204 0
2026-03-28 18:37:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-28 18:37:37 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV66840%27 HTTP/1.1" 200 None
2026-03-28 18:37:37 [auto1.de] INFO: Scrape type for JV66840: 2
2026-03-28 18:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f66e88fe-f417-571c-955a-d46ee92603db with identifier: JV66840
2026-03-28 18:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f66e88fe-f417-571c-955a-d46ee92603db with scrape type 2
2026-03-28 18:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f66e88fe-f417-571c-955a-d46ee92603db with scrape type 2
2026-03-28 18:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f66e88fe-f417-571c-955a-d46ee92603db, identifier: JV66840
2026-03-28 18:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f66e88fe-f417-571c-955a-d46ee92603db with identifier: JV66840
2026-03-28 18:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f66e88fe-f417-571c-955a-d46ee92603db with identifier: JV66840
2026-03-28 18:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f66e88fe-f417-571c-955a-d46ee92603db with identifier: JV66840 to the API
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:11Z',
 'fuel_type': 'diesel',
 'id': 'f66e88fe-f417-571c-955a-d46ee92603db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV66840',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 78935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-05',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2019}
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV66840%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Saving data for JV66840: {'auction_closing_time': 1774886231.0, 'created_time': 1774521607.543785, 'last_price_update_time': 1774723058.246604}
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV66840') HTTP/1.1" 204 0
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH20468%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for MH20468: 2
2026-03-28 18:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c352e107-2b72-519c-86d3-e21931e56e57 with identifier: MH20468
2026-03-28 18:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c352e107-2b72-519c-86d3-e21931e56e57 with scrape type 2
2026-03-28 18:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c352e107-2b72-519c-86d3-e21931e56e57 with scrape type 2
2026-03-28 18:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c352e107-2b72-519c-86d3-e21931e56e57, identifier: MH20468
2026-03-28 18:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c352e107-2b72-519c-86d3-e21931e56e57 with identifier: MH20468
2026-03-28 18:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c352e107-2b72-519c-86d3-e21931e56e57 with identifier: MH20468
2026-03-28 18:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c352e107-2b72-519c-86d3-e21931e56e57 with identifier: MH20468 to the API
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-30T15:21:00Z',
 'fuel_type': 'petrol',
 'id': 'c352e107-2b72-519c-86d3-e21931e56e57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH20468',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 51593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-28',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH20468%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Saving data for MH20468: {'auction_closing_time': 1774884060.0, 'created_time': 1773946254.387335, 'last_price_update_time': 1774723058.688885}
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH20468') HTTP/1.1" 204 0
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: PV33295
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV33295%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for PV33295: 2
2026-03-28 18:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d48c85-8ff1-5a97-bb75-d680d5303806 with identifier: PV33295
2026-03-28 18:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d48c85-8ff1-5a97-bb75-d680d5303806 with scrape type 2
2026-03-28 18:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8d48c85-8ff1-5a97-bb75-d680d5303806 with scrape type 2
2026-03-28 18:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8d48c85-8ff1-5a97-bb75-d680d5303806, identifier: PV33295
2026-03-28 18:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8d48c85-8ff1-5a97-bb75-d680d5303806 with identifier: PV33295
2026-03-28 18:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8d48c85-8ff1-5a97-bb75-d680d5303806 with identifier: PV33295
2026-03-28 18:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8d48c85-8ff1-5a97-bb75-d680d5303806 with identifier: PV33295 to the API
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:26:30Z',
 'fuel_type': 'petrol',
 'id': 'f8d48c85-8ff1-5a97-bb75-d680d5303806',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV33295',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 65970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'BMW X2 M35i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV33295%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Saving data for PV33295: {'auction_closing_time': 1774884390.0, 'created_time': 1773340955.190953, 'last_price_update_time': 1774723059.179694}
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV33295') HTTP/1.1" 204 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG61616%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for DG61616: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE65204%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for VE65204: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63876%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for DZ63876: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW15579%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for VW15579: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45132%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for BH45132: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69075%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for BP69075: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN58244%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for JN58244: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE28536%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for ZE28536: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY45921%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for CY45921: 2
2026-03-28 18:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with identifier: CY45921
2026-03-28 18:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with scrape type 2
2026-03-28 18:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with scrape type 2
2026-03-28 18:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5, identifier: CY45921
2026-03-28 18:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with identifier: CY45921
2026-03-28 18:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with identifier: CY45921
2026-03-28 18:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with identifier: CY45921 to the API
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:50:31Z',
 'fuel_type': 'petrol',
 'id': 'f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY45921',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 40343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-13',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Beats',
 'transmission': 'manual',
 'trim': 'Beats',
 'year': 2020}
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY45921%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Saving data for CY45921: {'auction_closing_time': 1774885831.0, 'created_time': 1774521622.535347, 'last_price_update_time': 1774723059.976554}
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY45921') HTTP/1.1" 204 0
2026-03-28 18:37:40 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-28 18:37:40 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX04518%27 HTTP/1.1" 200 None
2026-03-28 18:37:40 [auto1.de] INFO: Scrape type for XX04518: 0
2026-03-28 18:37:40 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93561%27 HTTP/1.1" 200 None
2026-03-28 18:37:40 [auto1.de] INFO: Scrape type for GM93561: 2
2026-03-28 18:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be70f286-8ac9-532f-8791-dd82c6e0ab30 with identifier: GM93561
2026-03-28 18:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be70f286-8ac9-532f-8791-dd82c6e0ab30 with scrape type 2
2026-03-28 18:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be70f286-8ac9-532f-8791-dd82c6e0ab30 with scrape type 2
2026-03-28 18:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be70f286-8ac9-532f-8791-dd82c6e0ab30, identifier: GM93561
2026-03-28 18:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be70f286-8ac9-532f-8791-dd82c6e0ab30 with identifier: GM93561
2026-03-28 18:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be70f286-8ac9-532f-8791-dd82c6e0ab30 with identifier: GM93561
2026-03-28 18:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be70f286-8ac9-532f-8791-dd82c6e0ab30 with identifier: GM93561 to the API
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:11:53Z',
 'fuel_type': 'petrol',
 'id': 'be70f286-8ac9-532f-8791-dd82c6e0ab30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM93561',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 141932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-30',
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2013}
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93561%27 HTTP/1.1" 200 None
2026-03-28 18:37:40 [auto1.de] INFO: Saving data for GM93561: {'auction_closing_time': 1774883513.0, 'created_time': 1774550174.16482, 'last_price_update_time': 1774723060.528782}
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM93561') HTTP/1.1" 204 0
2026-03-28 18:37:40 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-28 18:37:40 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-28 18:37:40 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ09412%27 HTTP/1.1" 200 None
2026-03-28 18:37:40 [auto1.de] INFO: Scrape type for SJ09412: 0
2026-03-28 18:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:40 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:40 [auto1.de] INFO: Found listing with ID: SV25975
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV25975%27 HTTP/1.1" 200 None
2026-03-28 18:37:40 [auto1.de] INFO: Scrape type for SV25975: 2
2026-03-28 18:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36fc3d5d-3448-5e19-a156-1b6259b8c2ef with identifier: SV25975
2026-03-28 18:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36fc3d5d-3448-5e19-a156-1b6259b8c2ef with scrape type 2
2026-03-28 18:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36fc3d5d-3448-5e19-a156-1b6259b8c2ef with scrape type 2
2026-03-28 18:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36fc3d5d-3448-5e19-a156-1b6259b8c2ef, identifier: SV25975
2026-03-28 18:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36fc3d5d-3448-5e19-a156-1b6259b8c2ef with identifier: SV25975
2026-03-28 18:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36fc3d5d-3448-5e19-a156-1b6259b8c2ef with identifier: SV25975
2026-03-28 18:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36fc3d5d-3448-5e19-a156-1b6259b8c2ef with identifier: SV25975 to the API
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:13Z',
 'fuel_type': 'diesel',
 'id': '36fc3d5d-3448-5e19-a156-1b6259b8c2ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV25975',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 174913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-28',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sendo 2WD',
 'transmission': 'manual',
 'trim': 'Sendo 2WD',
 'year': 2015}
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV25975%27 HTTP/1.1" 200 None
2026-03-28 18:37:41 [auto1.de] INFO: Saving data for SV25975: {'auction_closing_time': 1774885573.0, 'created_time': 1773427595.869437, 'last_price_update_time': 1774723061.917481}
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV25975') HTTP/1.1" 204 0
2026-03-28 18:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR39544%27 HTTP/1.1" 200 None
2026-03-28 18:37:41 [auto1.de] INFO: Scrape type for AR39544: 0
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ84971%27 HTTP/1.1" 200 None
2026-03-28 18:37:41 [auto1.de] INFO: Scrape type for SJ84971: 0
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW32541%27 HTTP/1.1" 200 None
2026-03-28 18:37:41 [auto1.de] INFO: Scrape type for RW32541: 0
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN62296%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for BN62296: 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL31529%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for VL31529: 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH04834%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for YH04834: 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT13241%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for LT13241: 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV47802%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for VV47802: 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK32817%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for RK32817: 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH90150%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for UH90150: 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP43917%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for JP43917: 2
2026-03-28 18:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6c4e00c-bbba-5ffc-946f-501ca151a72c with identifier: JP43917
2026-03-28 18:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6c4e00c-bbba-5ffc-946f-501ca151a72c with scrape type 2
2026-03-28 18:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6c4e00c-bbba-5ffc-946f-501ca151a72c with scrape type 2
2026-03-28 18:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6c4e00c-bbba-5ffc-946f-501ca151a72c, identifier: JP43917
2026-03-28 18:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6c4e00c-bbba-5ffc-946f-501ca151a72c with identifier: JP43917
2026-03-28 18:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6c4e00c-bbba-5ffc-946f-501ca151a72c with identifier: JP43917
2026-03-28 18:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6c4e00c-bbba-5ffc-946f-501ca151a72c with identifier: JP43917 to the API
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-30T15:15:10Z',
 'fuel_type': 'petrol',
 'id': 'd6c4e00c-bbba-5ffc-946f-501ca151a72c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP43917',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 67409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
 'transmission': 'automatic',
 'trim': 'GTI TCR',
 'year': 2019}
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP43917%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Saving data for JP43917: {'auction_closing_time': 1774883710.0, 'created_time': 1774521369.818013, 'last_price_update_time': 1774723062.578494}
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP43917') HTTP/1.1" 204 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH72749%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for YH72749: 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD88757%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for UD88757: 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE92828%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for KE92828: 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST98775%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for ST98775: 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS96658%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for AS96658: 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD81240%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for AD81240: 0
2026-03-28 18:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:43 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ25721%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Scrape type for MJ25721: 0
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT65416%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Scrape type for KT65416: 0
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF96715%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Scrape type for DF96715: 0
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY05464%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Scrape type for JY05464: 0
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE68185%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Scrape type for AE68185: 0
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC67226%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Scrape type for XC67226: 2
2026-03-28 18:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac7448ae-c3ad-57fe-91ed-618f9cd516ce with identifier: XC67226
2026-03-28 18:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac7448ae-c3ad-57fe-91ed-618f9cd516ce with scrape type 2
2026-03-28 18:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac7448ae-c3ad-57fe-91ed-618f9cd516ce with scrape type 2
2026-03-28 18:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac7448ae-c3ad-57fe-91ed-618f9cd516ce, identifier: XC67226
2026-03-28 18:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac7448ae-c3ad-57fe-91ed-618f9cd516ce with identifier: XC67226
2026-03-28 18:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac7448ae-c3ad-57fe-91ed-618f9cd516ce with identifier: XC67226
2026-03-28 18:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac7448ae-c3ad-57fe-91ed-618f9cd516ce with identifier: XC67226 to the API
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:36:50Z',
 'fuel_type': 'petrol',
 'id': 'ac7448ae-c3ad-57fe-91ed-618f9cd516ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC67226',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 74122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-11',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2020}
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC67226%27 HTTP/1.1" 200 None
2026-03-28 18:37:44 [auto1.de] INFO: Saving data for XC67226: {'auction_closing_time': 1774885010.0, 'created_time': 1774521747.744556, 'last_price_update_time': 1774723064.392792}
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC67226') HTTP/1.1" 204 0
2026-03-28 18:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:44 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24751%27 HTTP/1.1" 200 None
2026-03-28 18:37:44 [auto1.de] INFO: Scrape type for KX24751: 2
2026-03-28 18:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with identifier: KX24751
2026-03-28 18:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with scrape type 2
2026-03-28 18:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with scrape type 2
2026-03-28 18:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02, identifier: KX24751
2026-03-28 18:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with identifier: KX24751
2026-03-28 18:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with identifier: KX24751
2026-03-28 18:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with identifier: KX24751 to the API
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:25:54Z',
 'fuel_type': 'petrol',
 'id': '38dd2c2f-cd8c-5649-b67c-3d8d625e6b02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX24751',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 95671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.8 Turbo Veloce',
 'transmission': 'automatic',
 'trim': 'Veloce',
 'year': 2016}
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24751%27 HTTP/1.1" 200 None
2026-03-28 18:37:44 [auto1.de] INFO: Saving data for KX24751: {'auction_closing_time': 1774884354.0, 'created_time': 1774521581.237791, 'last_price_update_time': 1774723064.934811}
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX24751') HTTP/1.1" 204 0
2026-03-28 18:37:44 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05119%27 HTTP/1.1" 200 None
2026-03-28 18:37:44 [auto1.de] INFO: Scrape type for YT05119: 0
2026-03-28 18:37:44 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD16900%27 HTTP/1.1" 200 None
2026-03-28 18:37:44 [auto1.de] INFO: Scrape type for WD16900: 2
2026-03-28 18:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c9a156-4810-50b1-bd13-4614942f55f9 with identifier: WD16900
2026-03-28 18:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c9a156-4810-50b1-bd13-4614942f55f9 with scrape type 2
2026-03-28 18:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c9a156-4810-50b1-bd13-4614942f55f9 with scrape type 2
2026-03-28 18:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2c9a156-4810-50b1-bd13-4614942f55f9, identifier: WD16900
2026-03-28 18:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2c9a156-4810-50b1-bd13-4614942f55f9 with identifier: WD16900
2026-03-28 18:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2c9a156-4810-50b1-bd13-4614942f55f9 with identifier: WD16900
2026-03-28 18:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2c9a156-4810-50b1-bd13-4614942f55f9 with identifier: WD16900 to the API
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:02Z',
 'fuel_type': 'diesel',
 'id': 'b2c9a156-4810-50b1-bd13-4614942f55f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD16900',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 212953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD16900%27 HTTP/1.1" 200 None
2026-03-28 18:37:45 [auto1.de] INFO: Saving data for WD16900: {'auction_closing_time': 1774883102.0, 'created_time': 1774522543.871373, 'last_price_update_time': 1774723065.394347}
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD16900') HTTP/1.1" 204 0
2026-03-28 18:37:45 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-28 18:37:45 [auto1.de] INFO: Found listing with ID: AW88722
2026-03-28 18:37:45 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09118%27 HTTP/1.1" 200 None
2026-03-28 18:37:45 [auto1.de] INFO: Scrape type for CZ09118: 0
2026-03-28 18:37:45 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-28 18:37:45 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-28 18:37:45 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-28 18:37:45 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-28 18:37:45 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD99191%27 HTTP/1.1" 200 None
2026-03-28 18:37:45 [auto1.de] INFO: Scrape type for BD99191: 0
2026-03-28 18:37:45 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX85367%27 HTTP/1.1" 200 None
2026-03-28 18:37:45 [auto1.de] INFO: Scrape type for SX85367: 2
2026-03-28 18:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9ac1045-435c-5da7-a577-e451a7325fa4 with identifier: SX85367
2026-03-28 18:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9ac1045-435c-5da7-a577-e451a7325fa4 with scrape type 2
2026-03-28 18:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9ac1045-435c-5da7-a577-e451a7325fa4 with scrape type 2
2026-03-28 18:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9ac1045-435c-5da7-a577-e451a7325fa4, identifier: SX85367
2026-03-28 18:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9ac1045-435c-5da7-a577-e451a7325fa4 with identifier: SX85367
2026-03-28 18:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9ac1045-435c-5da7-a577-e451a7325fa4 with identifier: SX85367
2026-03-28 18:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9ac1045-435c-5da7-a577-e451a7325fa4 with identifier: SX85367 to the API
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:12:00Z',
 'fuel_type': 'petrol',
 'id': 'a9ac1045-435c-5da7-a577-e451a7325fa4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX85367',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 78206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-02',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 SIDI Turbo Business Innovation 4x4',
 'transmission': 'automatic',
 'trim': 'Business Innovation 4x4',
 'year': 2016}
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX85367%27 HTTP/1.1" 200 None
2026-03-28 18:37:45 [auto1.de] INFO: Saving data for SX85367: {'auction_closing_time': 1774883520.0, 'created_time': 1774522214.001102, 'last_price_update_time': 1774723065.870557}
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX85367') HTTP/1.1" 204 0
2026-03-28 18:37:45 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-28 18:37:45 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-28 18:37:45 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL28048%27 HTTP/1.1" 200 None
2026-03-28 18:37:46 [auto1.de] INFO: Scrape type for SL28048: 0
2026-03-28 18:37:46 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-28 18:37:46 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA61541%27 HTTP/1.1" 200 None
2026-03-28 18:37:46 [auto1.de] INFO: Scrape type for MA61541: 0
2026-03-28 18:37:46 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-28 18:37:46 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU85370%27 HTTP/1.1" 200 None
2026-03-28 18:37:46 [auto1.de] INFO: Scrape type for FU85370: 0
2026-03-28 18:37:46 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW37787%27 HTTP/1.1" 200 None
2026-03-28 18:37:46 [auto1.de] INFO: Scrape type for EW37787: 2
2026-03-28 18:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30840ba6-ab32-5a63-a268-b91665de409f with identifier: EW37787
2026-03-28 18:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30840ba6-ab32-5a63-a268-b91665de409f with scrape type 2
2026-03-28 18:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30840ba6-ab32-5a63-a268-b91665de409f with scrape type 2
2026-03-28 18:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30840ba6-ab32-5a63-a268-b91665de409f, identifier: EW37787
2026-03-28 18:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30840ba6-ab32-5a63-a268-b91665de409f with identifier: EW37787
2026-03-28 18:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30840ba6-ab32-5a63-a268-b91665de409f with identifier: EW37787
2026-03-28 18:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30840ba6-ab32-5a63-a268-b91665de409f with identifier: EW37787 to the API
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:26:19Z',
 'fuel_type': 'petrol',
 'id': '30840ba6-ab32-5a63-a268-b91665de409f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW37787',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 101070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW37787%27 HTTP/1.1" 200 None
2026-03-28 18:37:46 [auto1.de] INFO: Saving data for EW37787: {'auction_closing_time': 1774884379.0, 'created_time': 1773382930.846707, 'last_price_update_time': 1774723066.478528}
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW37787') HTTP/1.1" 204 0
2026-03-28 18:37:46 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-28 18:37:46 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC91159%27 HTTP/1.1" 200 None
2026-03-28 18:37:46 [auto1.de] INFO: Scrape type for HC91159: 0
2026-03-28 18:37:46 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU38066%27 HTTP/1.1" 200 None
2026-03-28 18:37:46 [auto1.de] INFO: Scrape type for XU38066: 0
2026-03-28 18:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:47 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:47 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26190%27 HTTP/1.1" 200 None
2026-03-28 18:37:47 [auto1.de] INFO: Scrape type for DZ26190: 0
2026-03-28 18:37:47 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU48886%27 HTTP/1.1" 200 None
2026-03-28 18:37:47 [auto1.de] INFO: Scrape type for ZU48886: 0
2026-03-28 18:37:47 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP42616%27 HTTP/1.1" 200 None
2026-03-28 18:37:47 [auto1.de] INFO: Scrape type for PP42616: 2
2026-03-28 18:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2efc9f65-2879-5396-ad22-f22fd4117735 with identifier: PP42616
2026-03-28 18:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2efc9f65-2879-5396-ad22-f22fd4117735 with scrape type 2
2026-03-28 18:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2efc9f65-2879-5396-ad22-f22fd4117735 with scrape type 2
2026-03-28 18:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2efc9f65-2879-5396-ad22-f22fd4117735, identifier: PP42616
2026-03-28 18:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2efc9f65-2879-5396-ad22-f22fd4117735 with identifier: PP42616
2026-03-28 18:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2efc9f65-2879-5396-ad22-f22fd4117735 with identifier: PP42616
2026-03-28 18:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2efc9f65-2879-5396-ad22-f22fd4117735 with identifier: PP42616 to the API
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:20:43Z',
 'fuel_type': 'petrol',
 'id': '2efc9f65-2879-5396-ad22-f22fd4117735',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP42616',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 107383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-02',
 'seller_name': None,
 'title': 'Mazda CX-5 2.5 Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2021}
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP42616%27 HTTP/1.1" 200 None
2026-03-28 18:37:47 [auto1.de] INFO: Saving data for PP42616: {'auction_closing_time': 1774884043.0, 'created_time': 1774521630.126617, 'last_price_update_time': 1774723067.896788}
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP42616') HTTP/1.1" 204 0
2026-03-28 18:37:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM51665%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Scrape type for RM51665: 0
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL15014%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Scrape type for LL15014: 0
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW82569%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Scrape type for WW82569: 0
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR33012%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Scrape type for GR33012: 0
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ32773%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Scrape type for WZ32773: 2
2026-03-28 18:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with identifier: WZ32773
2026-03-28 18:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with scrape type 2
2026-03-28 18:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with scrape type 2
2026-03-28 18:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 339c61d7-3eb8-5336-9ec8-e791c28e59e5, identifier: WZ32773
2026-03-28 18:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with identifier: WZ32773
2026-03-28 18:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with identifier: WZ32773
2026-03-28 18:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with identifier: WZ32773 to the API
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:51:50Z',
 'fuel_type': 'petrol',
 'id': '339c61d7-3eb8-5336-9ec8-e791c28e59e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ32773',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 153049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-04-02',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2003}
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ32773%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Saving data for WZ32773: {'auction_closing_time': 1774885910.0, 'created_time': 1774034715.107828, 'last_price_update_time': 1774723068.547025}
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ32773') HTTP/1.1" 204 0
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN83173%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Scrape type for BN83173: 0
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM60777%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Scrape type for AM60777: 0
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03365%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Scrape type for MH03365: 2
2026-03-28 18:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67c06ff0-b109-55ed-974b-feef205979f2 with identifier: MH03365
2026-03-28 18:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67c06ff0-b109-55ed-974b-feef205979f2 with scrape type 2
2026-03-28 18:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67c06ff0-b109-55ed-974b-feef205979f2 with scrape type 2
2026-03-28 18:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67c06ff0-b109-55ed-974b-feef205979f2, identifier: MH03365
2026-03-28 18:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67c06ff0-b109-55ed-974b-feef205979f2 with identifier: MH03365
2026-03-28 18:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67c06ff0-b109-55ed-974b-feef205979f2 with identifier: MH03365
2026-03-28 18:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67c06ff0-b109-55ed-974b-feef205979f2 with identifier: MH03365 to the API
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:32Z',
 'fuel_type': 'petrol',
 'id': '67c06ff0-b109-55ed-974b-feef205979f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH03365',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 119893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-26',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03365%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Saving data for MH03365: {'auction_closing_time': 1774884992.0, 'created_time': 1773429467.988775, 'last_price_update_time': 1774723069.044089}
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH03365') HTTP/1.1" 204 0
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR44160%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Scrape type for ZR44160: 0
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP99988%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Scrape type for GP99988: 0
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD42848%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Scrape type for XD42848: 0
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK52286%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Scrape type for UK52286: 2
2026-03-28 18:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae5c3948-cac5-5680-8af5-311903ebdecc with identifier: UK52286
2026-03-28 18:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae5c3948-cac5-5680-8af5-311903ebdecc with scrape type 2
2026-03-28 18:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae5c3948-cac5-5680-8af5-311903ebdecc with scrape type 2
2026-03-28 18:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae5c3948-cac5-5680-8af5-311903ebdecc, identifier: UK52286
2026-03-28 18:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae5c3948-cac5-5680-8af5-311903ebdecc with identifier: UK52286
2026-03-28 18:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae5c3948-cac5-5680-8af5-311903ebdecc with identifier: UK52286
2026-03-28 18:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae5c3948-cac5-5680-8af5-311903ebdecc with identifier: UK52286 to the API
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:30Z',
 'fuel_type': 'diesel',
 'id': 'ae5c3948-cac5-5680-8af5-311903ebdecc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK52286',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 196212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-22',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2015}
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK52286%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Saving data for UK52286: {'auction_closing_time': 1774884810.0, 'created_time': 1774522248.292621, 'last_price_update_time': 1774723069.670978}
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK52286') HTTP/1.1" 204 0
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR92554%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Scrape type for ZR92554: 0
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA96638%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Scrape type for FA96638: 0
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR52886%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Scrape type for XR52886: 0
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ39955%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Scrape type for MZ39955: 0
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE07006%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Scrape type for TE07006: 2
2026-03-28 18:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with identifier: TE07006
2026-03-28 18:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with scrape type 2
2026-03-28 18:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with scrape type 2
2026-03-28 18:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd, identifier: TE07006
2026-03-28 18:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with identifier: TE07006
2026-03-28 18:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with identifier: TE07006
2026-03-28 18:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with identifier: TE07006 to the API
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:26:00Z',
 'fuel_type': 'diesel',
 'id': '286f6afd-b19a-5c75-9fe3-ae17bc758dbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE07006',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 141703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE07006%27 HTTP/1.1" 200 None
2026-03-28 18:37:50 [auto1.de] INFO: Saving data for TE07006: {'auction_closing_time': 1774884360.0, 'created_time': 1774522570.894017, 'last_price_update_time': 1774723070.220832}
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE07006') HTTP/1.1" 204 0
2026-03-28 18:37:50 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-28 18:37:50 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-28 18:37:50 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-28 18:37:50 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-28 18:37:50 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK01329%27 HTTP/1.1" 200 None
2026-03-28 18:37:50 [auto1.de] INFO: Scrape type for ZK01329: 2
2026-03-28 18:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa with identifier: ZK01329
2026-03-28 18:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa with scrape type 2
2026-03-28 18:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa with scrape type 2
2026-03-28 18:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa, identifier: ZK01329
2026-03-28 18:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa with identifier: ZK01329
2026-03-28 18:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa with identifier: ZK01329
2026-03-28 18:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa with identifier: ZK01329 to the API
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:29:42Z',
 'fuel_type': 'petrol',
 'id': 'a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK01329',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 67398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-27',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.1 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK01329%27 HTTP/1.1" 200 None
2026-03-28 18:37:50 [auto1.de] INFO: Saving data for ZK01329: {'auction_closing_time': 1774884582.0, 'created_time': 1774636630.486562, 'last_price_update_time': 1774723070.745078}
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK01329') HTTP/1.1" 204 0
2026-03-28 18:37:50 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE62159%27 HTTP/1.1" 200 None
2026-03-28 18:37:50 [auto1.de] INFO: Scrape type for FE62159: 0
2026-03-28 18:37:50 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC12469%27 HTTP/1.1" 200 None
2026-03-28 18:37:50 [auto1.de] INFO: Scrape type for MC12469: 0
2026-03-28 18:37:50 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB37654%27 HTTP/1.1" 200 None
2026-03-28 18:37:50 [auto1.de] INFO: Scrape type for TB37654: 2
2026-03-28 18:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with identifier: TB37654
2026-03-28 18:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with scrape type 2
2026-03-28 18:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with scrape type 2
2026-03-28 18:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2edb494e-f9d4-53f6-9321-c8c7a3e42653, identifier: TB37654
2026-03-28 18:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with identifier: TB37654
2026-03-28 18:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with identifier: TB37654
2026-03-28 18:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with identifier: TB37654 to the API
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:35:36Z',
 'fuel_type': 'petrol',
 'id': '2edb494e-f9d4-53f6-9321-c8c7a3e42653',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB37654',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 81108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-09',
 'seller_name': None,
 'title': 'Volvo V40 1.6 T2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2014}
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB37654%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Saving data for TB37654: {'auction_closing_time': 1774884936.0, 'created_time': 1774522476.640558, 'last_price_update_time': 1774723071.245746}
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB37654') HTTP/1.1" 204 0
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-28 18:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:51 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB15265%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Scrape type for BB15265: 0
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS30943%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Scrape type for SS30943: 0
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH02243%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Scrape type for RH02243: 0
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH96915%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Scrape type for PH96915: 0
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM07898%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Scrape type for EM07898: 0
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY95504%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Scrape type for DY95504: 0
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP05122%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Scrape type for EP05122: 0
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT52370%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Scrape type for YT52370: 2
2026-03-28 18:37:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3 with identifier: YT52370
2026-03-28 18:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3 with scrape type 2
2026-03-28 18:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3 with scrape type 2
2026-03-28 18:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3, identifier: YT52370
2026-03-28 18:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3 with identifier: YT52370
2026-03-28 18:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3 with identifier: YT52370
2026-03-28 18:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3 with identifier: YT52370 to the API
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:33:14Z',
 'fuel_type': 'diesel',
 'id': '9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT52370',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 160574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-12',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2020}
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT52370%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Saving data for YT52370: {'auction_closing_time': 1774884794.0, 'created_time': 1773303214.203218, 'last_price_update_time': 1774723072.071718}
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT52370') HTTP/1.1" 204 0
2026-03-28 18:37:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR50591%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for KR50591: 0
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13721%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for CD13721: 0
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02810%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for WF02810: 0
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL84937%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for TL84937: 0
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24274%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for PG24274: 0
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ88633%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for HJ88633: 0
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: PP10507
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP10507%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for PP10507: 1
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75597%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for NY75597: 0
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU59921%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for GU59921: 2
2026-03-28 18:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4d5ce38-9bc7-5269-896e-b4e77e9115e6 with identifier: GU59921
2026-03-28 18:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d5ce38-9bc7-5269-896e-b4e77e9115e6 with scrape type 2
2026-03-28 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4d5ce38-9bc7-5269-896e-b4e77e9115e6 with scrape type 2
2026-03-28 18:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4d5ce38-9bc7-5269-896e-b4e77e9115e6, identifier: GU59921
2026-03-28 18:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4d5ce38-9bc7-5269-896e-b4e77e9115e6 with identifier: GU59921
2026-03-28 18:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4d5ce38-9bc7-5269-896e-b4e77e9115e6 with identifier: GU59921
2026-03-28 18:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4d5ce38-9bc7-5269-896e-b4e77e9115e6 with identifier: GU59921 to the API
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:29Z',
 'fuel_type': 'diesel',
 'id': 'a4d5ce38-9bc7-5269-896e-b4e77e9115e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU59921',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 32870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU59921%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Saving data for GU59921: {'auction_closing_time': 1774885169.0, 'created_time': 1774264201.621354, 'last_price_update_time': 1774723072.749209}
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU59921') HTTP/1.1" 204 0
2026-03-28 18:37:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD15904%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for SD15904: 0
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-28 18:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP10507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:54 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04622%27 HTTP/1.1" 200 None
2026-03-28 18:37:54 [auto1.de] INFO: Scrape type for HH04622: 0
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME06173%27 HTTP/1.1" 200 None
2026-03-28 18:37:54 [auto1.de] INFO: Scrape type for ME06173: 0
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG81908%27 HTTP/1.1" 200 None
2026-03-28 18:37:54 [auto1.de] INFO: Scrape type for BG81908: 0
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ75374%27 HTTP/1.1" 200 None
2026-03-28 18:37:54 [auto1.de] INFO: Scrape type for GJ75374: 0
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV97888%27 HTTP/1.1" 200 None
2026-03-28 18:37:54 [auto1.de] INFO: Scrape type for EV97888: 2
2026-03-28 18:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e42c9a0-88b2-5573-9408-d43f7b85871e with identifier: EV97888
2026-03-28 18:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e42c9a0-88b2-5573-9408-d43f7b85871e with scrape type 2
2026-03-28 18:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e42c9a0-88b2-5573-9408-d43f7b85871e with scrape type 2
2026-03-28 18:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e42c9a0-88b2-5573-9408-d43f7b85871e, identifier: EV97888
2026-03-28 18:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e42c9a0-88b2-5573-9408-d43f7b85871e with identifier: EV97888
2026-03-28 18:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e42c9a0-88b2-5573-9408-d43f7b85871e with identifier: EV97888
2026-03-28 18:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e42c9a0-88b2-5573-9408-d43f7b85871e with identifier: EV97888 to the API
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:00:04Z',
 'fuel_type': 'petrol',
 'id': '9e42c9a0-88b2-5573-9408-d43f7b85871e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV97888',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 101872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-26',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV97888%27 HTTP/1.1" 200 None
2026-03-28 18:37:54 [auto1.de] INFO: Saving data for EV97888: {'auction_closing_time': 1774882804.0, 'created_time': 1773946781.881588, 'last_price_update_time': 1774723074.82771}
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV97888') HTTP/1.1" 204 0
2026-03-28 18:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL64975%27 HTTP/1.1" 200 None
2026-03-28 18:37:54 [auto1.de] INFO: Scrape type for PL64975: 0
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF36424%27 HTTP/1.1" 200 None
2026-03-28 18:37:54 [auto1.de] INFO: Scrape type for JF36424: 0
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG10671%27 HTTP/1.1" 200 None
2026-03-28 18:37:55 [auto1.de] INFO: Scrape type for BG10671: 0
2026-03-28 18:37:55 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN46464%27 HTTP/1.1" 200 None
2026-03-28 18:37:55 [auto1.de] INFO: Scrape type for AN46464: 0
2026-03-28 18:37:55 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-28 18:37:55 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP37567%27 HTTP/1.1" 200 None
2026-03-28 18:37:55 [auto1.de] INFO: Scrape type for HP37567: 2
2026-03-28 18:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25d3d63c-9514-5cea-9df5-dd64be066daf with identifier: HP37567
2026-03-28 18:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d3d63c-9514-5cea-9df5-dd64be066daf with scrape type 2
2026-03-28 18:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25d3d63c-9514-5cea-9df5-dd64be066daf with scrape type 2
2026-03-28 18:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25d3d63c-9514-5cea-9df5-dd64be066daf, identifier: HP37567
2026-03-28 18:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25d3d63c-9514-5cea-9df5-dd64be066daf with identifier: HP37567
2026-03-28 18:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25d3d63c-9514-5cea-9df5-dd64be066daf with identifier: HP37567
2026-03-28 18:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25d3d63c-9514-5cea-9df5-dd64be066daf with identifier: HP37567 to the API
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:57:23Z',
 'fuel_type': 'petrol',
 'id': '25d3d63c-9514-5cea-9df5-dd64be066daf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP37567',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 188603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-28',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP37567%27 HTTP/1.1" 200 None
2026-03-28 18:37:55 [auto1.de] INFO: Saving data for HP37567: {'auction_closing_time': 1774886243.0, 'created_time': 1774522545.479878, 'last_price_update_time': 1774723075.487152}
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP37567') HTTP/1.1" 204 0
2026-03-28 18:37:55 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41414%27 HTTP/1.1" 200 None
2026-03-28 18:37:55 [auto1.de] INFO: Scrape type for AN41414: 2
2026-03-28 18:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a6b024f-8851-548e-b542-c66f26fc002d with identifier: AN41414
2026-03-28 18:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a6b024f-8851-548e-b542-c66f26fc002d with scrape type 2
2026-03-28 18:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a6b024f-8851-548e-b542-c66f26fc002d with scrape type 2
2026-03-28 18:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a6b024f-8851-548e-b542-c66f26fc002d, identifier: AN41414
2026-03-28 18:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a6b024f-8851-548e-b542-c66f26fc002d with identifier: AN41414
2026-03-28 18:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a6b024f-8851-548e-b542-c66f26fc002d with identifier: AN41414
2026-03-28 18:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a6b024f-8851-548e-b542-c66f26fc002d with identifier: AN41414 to the API
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:43:09Z',
 'fuel_type': 'petrol',
 'id': '3a6b024f-8851-548e-b542-c66f26fc002d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN41414',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 103179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-29',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Style Salsa',
 'transmission': 'manual',
 'trim': 'Style Salsa',
 'year': 2014}
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41414%27 HTTP/1.1" 200 None
2026-03-28 18:37:56 [auto1.de] INFO: Saving data for AN41414: {'auction_closing_time': 1774885389.0, 'created_time': 1774521693.272948, 'last_price_update_time': 1774723076.026737}
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN41414') HTTP/1.1" 204 0
2026-03-28 18:37:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT75774%27 HTTP/1.1" 200 None
2026-03-28 18:37:56 [auto1.de] INFO: Scrape type for UT75774: 2
2026-03-28 18:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23431afd-dcda-592e-92ff-3aa35ba0d9c7 with identifier: UT75774
2026-03-28 18:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23431afd-dcda-592e-92ff-3aa35ba0d9c7 with scrape type 2
2026-03-28 18:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23431afd-dcda-592e-92ff-3aa35ba0d9c7 with scrape type 2
2026-03-28 18:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23431afd-dcda-592e-92ff-3aa35ba0d9c7, identifier: UT75774
2026-03-28 18:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23431afd-dcda-592e-92ff-3aa35ba0d9c7 with identifier: UT75774
2026-03-28 18:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23431afd-dcda-592e-92ff-3aa35ba0d9c7 with identifier: UT75774
2026-03-28 18:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23431afd-dcda-592e-92ff-3aa35ba0d9c7 with identifier: UT75774 to the API
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:14:51Z',
 'fuel_type': 'diesel',
 'id': '23431afd-dcda-592e-92ff-3aa35ba0d9c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT75774',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 193250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-03',
 'seller_name': None,
 'title': 'BMW X5 xDrive 40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT75774%27 HTTP/1.1" 200 None
2026-03-28 18:37:56 [auto1.de] INFO: Saving data for UT75774: {'auction_closing_time': 1774883691.0, 'created_time': 1773344354.189045, 'last_price_update_time': 1774723076.477477}
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT75774') HTTP/1.1" 204 0
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25980%27 HTTP/1.1" 200 None
2026-03-28 18:37:56 [auto1.de] INFO: Scrape type for YR25980: 2
2026-03-28 18:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1315275e-81ac-5ae2-a803-94d2ead6b39f with identifier: YR25980
2026-03-28 18:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1315275e-81ac-5ae2-a803-94d2ead6b39f with scrape type 2
2026-03-28 18:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1315275e-81ac-5ae2-a803-94d2ead6b39f with scrape type 2
2026-03-28 18:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1315275e-81ac-5ae2-a803-94d2ead6b39f, identifier: YR25980
2026-03-28 18:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1315275e-81ac-5ae2-a803-94d2ead6b39f with identifier: YR25980
2026-03-28 18:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1315275e-81ac-5ae2-a803-94d2ead6b39f with identifier: YR25980
2026-03-28 18:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1315275e-81ac-5ae2-a803-94d2ead6b39f with identifier: YR25980 to the API
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:29:49Z',
 'fuel_type': 'diesel',
 'id': '1315275e-81ac-5ae2-a803-94d2ead6b39f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR25980',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 72123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-26',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 111 CDI lang Tourer Edition',
 'transmission': 'manual',
 'trim': 'lang Tourer Edition',
 'year': 2019}
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25980%27 HTTP/1.1" 200 None
2026-03-28 18:37:56 [auto1.de] INFO: Saving data for YR25980: {'auction_closing_time': 1774884589.0, 'created_time': 1774521421.949189, 'last_price_update_time': 1774723076.93678}
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR25980') HTTP/1.1" 204 0
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY58366%27 HTTP/1.1" 200 None
2026-03-28 18:37:56 [auto1.de] INFO: Scrape type for ZY58366: 0
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD69180%27 HTTP/1.1" 200 None
2026-03-28 18:37:56 [auto1.de] INFO: Scrape type for CD69180: 0
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT34656%27 HTTP/1.1" 200 None
2026-03-28 18:37:56 [auto1.de] INFO: Scrape type for LT34656: 0
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX90434%27 HTTP/1.1" 200 None
2026-03-28 18:37:57 [auto1.de] INFO: Scrape type for VX90434: 0
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM42204%27 HTTP/1.1" 200 None
2026-03-28 18:37:57 [auto1.de] INFO: Scrape type for MM42204: 0
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL25204%27 HTTP/1.1" 200 None
2026-03-28 18:37:57 [auto1.de] INFO: Scrape type for LL25204: 0
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23493%27 HTTP/1.1" 200 None
2026-03-28 18:37:57 [auto1.de] INFO: Scrape type for YT23493: 0
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-28 18:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP10507> (referer: https://www.auto1.com/v1/car-details-view/PP10507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f22ab60-d7ac-5294-a564-e39de3f1f50a with identifier: PP10507
2026-03-28 18:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f22ab60-d7ac-5294-a564-e39de3f1f50a with scrape type 1
2026-03-28 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f22ab60-d7ac-5294-a564-e39de3f1f50a
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3e%252F2d3efb0379e39bd4aa8f6e746b9445f7%252Fpa%252FPP10507_eca39003461f732396fc484568d1fa12.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_eca39003461f732396fc484568d1fa12.jpg already downloaded
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3e%252F2d3efb0379e39bd4aa8f6e746b9445f7%252Fpa%252FPP10507_89db9775d2f2ff7a330b2cd3d8bcf43e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_89db9775d2f2ff7a330b2cd3d8bcf43e.jpg already downloaded
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3e%252F2d3efb0379e39bd4aa8f6e746b9445f7%252Fpa%252FPP10507_8b32a976108b4c9b60e13fffcbcad505.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_8b32a976108b4c9b60e13fffcbcad505.jpg already downloaded
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3e%252F2d3efb0379e39bd4aa8f6e746b9445f7%252Fpa%252FPP10507_76775d5566934dd90e0afae80062741a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_76775d5566934dd90e0afae80062741a.jpg already downloaded
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3e%252F2d3efb0379e39bd4aa8f6e746b9445f7%252Fpa%252FPP10507_b308eba13de5738d1507a4461d0c56cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_b308eba13de5738d1507a4461d0c56cf.jpg already downloaded
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3e%252F2d3efb0379e39bd4aa8f6e746b9445f7%252Fpa%252FPP10507_d9c0fe67bf7dd1130bbeaedd91ac3d51.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_d9c0fe67bf7dd1130bbeaedd91ac3d51.jpg already downloaded
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3e%252F2d3efb0379e39bd4aa8f6e746b9445f7%252Fpa%252FPP10507_350a37fcc1cdebd685b0153dd7236f0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_350a37fcc1cdebd685b0153dd7236f0c.jpg already downloaded
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3e%252F2d3efb0379e39bd4aa8f6e746b9445f7%252Fpa%252FPP10507_1379b0aa210c1f040b303ebae83d434b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_1379b0aa210c1f040b303ebae83d434b.jpg already downloaded
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3e%252F2d3efb0379e39bd4aa8f6e746b9445f7%252Fpa%252FPP10507_b16a85a6a302fa89092ae5220e3cfdb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_b16a85a6a302fa89092ae5220e3cfdb0.jpg already downloaded
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3e%252F2d3efb0379e39bd4aa8f6e746b9445f7%252Fpa%252FPP10507_c55031ad5234e342824d28ff041a9c55.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_c55031ad5234e342824d28ff041a9c55.jpg already downloaded
2026-03-28 18:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f22ab60-d7ac-5294-a564-e39de3f1f50a, identifier: PP10507
2026-03-28 18:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f22ab60-d7ac-5294-a564-e39de3f1f50a with identifier: PP10507
2026-03-28 18:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f22ab60-d7ac-5294-a564-e39de3f1f50a with identifier: PP10507
2026-03-28 18:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f22ab60-d7ac-5294-a564-e39de3f1f50a with identifier: PP10507 to the API
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PP10507>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:23:04Z',
 'fuel_type': 'petrol',
 'id': '5f22ab60-d7ac-5294-a564-e39de3f1f50a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP10507',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 137625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_eca39003461f732396fc484568d1fa12.jpg',
                'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_89db9775d2f2ff7a330b2cd3d8bcf43e.jpg',
                'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_8b32a976108b4c9b60e13fffcbcad505.jpg',
                'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_76775d5566934dd90e0afae80062741a.jpg',
                'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_b308eba13de5738d1507a4461d0c56cf.jpg',
                'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_d9c0fe67bf7dd1130bbeaedd91ac3d51.jpg',
                'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_350a37fcc1cdebd685b0153dd7236f0c.jpg',
                'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_1379b0aa210c1f040b303ebae83d434b.jpg',
                'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_b16a85a6a302fa89092ae5220e3cfdb0.jpg',
                'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_c55031ad5234e342824d28ff041a9c55.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f22ab60-d7ac-5294-a564-e39de3f1f50a/5f22ab60-d7ac-5294-a564-e39de3f1f50a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_eca39003461f732396fc484568d1fa12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f22ab60-d7ac-5294-a564-e39de3f1f50a/5f22ab60-d7ac-5294-a564-e39de3f1f50a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_89db9775d2f2ff7a330b2cd3d8bcf43e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f22ab60-d7ac-5294-a564-e39de3f1f50a/5f22ab60-d7ac-5294-a564-e39de3f1f50a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_8b32a976108b4c9b60e13fffcbcad505.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f22ab60-d7ac-5294-a564-e39de3f1f50a/5f22ab60-d7ac-5294-a564-e39de3f1f50a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_76775d5566934dd90e0afae80062741a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f22ab60-d7ac-5294-a564-e39de3f1f50a/5f22ab60-d7ac-5294-a564-e39de3f1f50a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_b308eba13de5738d1507a4461d0c56cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f22ab60-d7ac-5294-a564-e39de3f1f50a/5f22ab60-d7ac-5294-a564-e39de3f1f50a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_d9c0fe67bf7dd1130bbeaedd91ac3d51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f22ab60-d7ac-5294-a564-e39de3f1f50a/5f22ab60-d7ac-5294-a564-e39de3f1f50a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_350a37fcc1cdebd685b0153dd7236f0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f22ab60-d7ac-5294-a564-e39de3f1f50a/5f22ab60-d7ac-5294-a564-e39de3f1f50a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_1379b0aa210c1f040b303ebae83d434b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f22ab60-d7ac-5294-a564-e39de3f1f50a/5f22ab60-d7ac-5294-a564-e39de3f1f50a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_b16a85a6a302fa89092ae5220e3cfdb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f22ab60-d7ac-5294-a564-e39de3f1f50a/5f22ab60-d7ac-5294-a564-e39de3f1f50a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3e/2d3efb0379e39bd4aa8f6e746b9445f7/pa/PP10507_c55031ad5234e342824d28ff041a9c55.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Club 4x4',
 'transmission': 'manual',
 'trim': 'Club 4x4',
 'year': 2013}
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP10507%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [auto1.de] INFO: Saving data for PP10507: {'created_time': 1774723078.797411, 'last_price_update_time': 1774723078.797421, 'auction_closing_time': 1774884184.0}
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP10507') HTTP/1.1" 204 0
2026-03-28 18:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:59 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE08080%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for AE08080: 0
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB50562%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for UB50562: 0
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD30169%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for HD30169: 0
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW12135%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for WW12135: 0
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF47074%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for EF47074: 0
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ86962%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for WZ86962: 2
2026-03-28 18:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf87a281-581b-55a7-b337-f760e7e20505 with identifier: WZ86962
2026-03-28 18:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf87a281-581b-55a7-b337-f760e7e20505 with scrape type 2
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf87a281-581b-55a7-b337-f760e7e20505 with scrape type 2
2026-03-28 18:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf87a281-581b-55a7-b337-f760e7e20505, identifier: WZ86962
2026-03-28 18:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf87a281-581b-55a7-b337-f760e7e20505 with identifier: WZ86962
2026-03-28 18:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf87a281-581b-55a7-b337-f760e7e20505 with identifier: WZ86962
2026-03-28 18:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf87a281-581b-55a7-b337-f760e7e20505 with identifier: WZ86962 to the API
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:00Z',
 'fuel_type': 'diesel',
 'id': 'cf87a281-581b-55a7-b337-f760e7e20505',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ86962',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 150943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-03',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2022}
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ86962%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Saving data for WZ86962: {'auction_closing_time': 1774884240.0, 'created_time': 1773427330.107369, 'last_price_update_time': 1774723079.630479}
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ86962') HTTP/1.1" 204 0
2026-03-28 18:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR24647%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for BR24647: 0
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE84104%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for DE84104: 0
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD55722%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for MD55722: 0
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF73158%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for FF73158: 0
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY67323%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for DY67323: 0
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD30774%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for ZD30774: 0
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ66077%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for NJ66077: 2
2026-03-28 18:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91e30b56-18ba-5db7-ad81-a312262d174c with identifier: NJ66077
2026-03-28 18:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91e30b56-18ba-5db7-ad81-a312262d174c with scrape type 2
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91e30b56-18ba-5db7-ad81-a312262d174c with scrape type 2
2026-03-28 18:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91e30b56-18ba-5db7-ad81-a312262d174c, identifier: NJ66077
2026-03-28 18:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91e30b56-18ba-5db7-ad81-a312262d174c with identifier: NJ66077
2026-03-28 18:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91e30b56-18ba-5db7-ad81-a312262d174c with identifier: NJ66077
2026-03-28 18:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91e30b56-18ba-5db7-ad81-a312262d174c with identifier: NJ66077 to the API
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:55:53Z',
 'fuel_type': 'petrol',
 'id': '91e30b56-18ba-5db7-ad81-a312262d174c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ66077',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 35091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-24',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2014}
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ66077%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Saving data for NJ66077: {'auction_closing_time': 1774886153.0, 'created_time': 1774636595.525794, 'last_price_update_time': 1774723080.23377}
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ66077') HTTP/1.1" 204 0
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK09737%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for UK09737: 0
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV13612%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for AV13612: 0
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT21792%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for MT21792: 0
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY04572%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for FY04572: 0
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG90770%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for NG90770: 0
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL69348%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for DL69348: 0
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY21775%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for JY21775: 2
2026-03-28 18:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with identifier: JY21775
2026-03-28 18:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with scrape type 2
2026-03-28 18:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with scrape type 2
2026-03-28 18:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9, identifier: JY21775
2026-03-28 18:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with identifier: JY21775
2026-03-28 18:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with identifier: JY21775
2026-03-28 18:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with identifier: JY21775 to the API
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:21:00Z',
 'fuel_type': 'diesel',
 'id': '5debbf9e-e055-55b0-8ebc-dd5881b8b2a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY21775',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 254371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-05',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.6 TDCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2014}
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY21775%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Saving data for JY21775: {'auction_closing_time': 1774884060.0, 'created_time': 1774522250.937504, 'last_price_update_time': 1774723080.876281}
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY21775') HTTP/1.1" 204 0
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40199%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for RK40199: 0
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56450%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for XU56450: 0
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT35414%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for BT35414: 0
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-28 18:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:02 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 6003 | hits on page: 40
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX23620%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Scrape type for NX23620: 0
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL62100%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Scrape type for HL62100: 0
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77480%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Scrape type for YA77480: 0
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73225%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Scrape type for BC73225: 0
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ94385%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Scrape type for BJ94385: 2
2026-03-28 18:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4c7c257-c4a7-5e84-ab2c-716a24c6c73c with identifier: BJ94385
2026-03-28 18:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4c7c257-c4a7-5e84-ab2c-716a24c6c73c with scrape type 2
2026-03-28 18:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4c7c257-c4a7-5e84-ab2c-716a24c6c73c with scrape type 2
2026-03-28 18:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4c7c257-c4a7-5e84-ab2c-716a24c6c73c, identifier: BJ94385
2026-03-28 18:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4c7c257-c4a7-5e84-ab2c-716a24c6c73c with identifier: BJ94385
2026-03-28 18:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4c7c257-c4a7-5e84-ab2c-716a24c6c73c with identifier: BJ94385
2026-03-28 18:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4c7c257-c4a7-5e84-ab2c-716a24c6c73c with identifier: BJ94385 to the API
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:12:34Z',
 'fuel_type': 'diesel',
 'id': 'b4c7c257-c4a7-5e84-ab2c-716a24c6c73c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ94385',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 142183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-14',
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Kasten Trend',
 'transmission': 'manual',
 'trim': 'Kasten Trend',
 'year': 2016}
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ94385%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Saving data for BJ94385: {'auction_closing_time': 1774883554.0, 'created_time': 1773402199.389185, 'last_price_update_time': 1774723082.562941}
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ94385') HTTP/1.1" 204 0
2026-03-28 18:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP87789%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Scrape type for DP87789: 0
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN83370%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Scrape type for EN83370: 0
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA59196%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Scrape type for SA59196: 0
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH38821%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Scrape type for AH38821: 2
2026-03-28 18:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cff92bc-7630-5cd0-9978-5f92ab76c302 with identifier: AH38821
2026-03-28 18:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cff92bc-7630-5cd0-9978-5f92ab76c302 with scrape type 2
2026-03-28 18:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cff92bc-7630-5cd0-9978-5f92ab76c302 with scrape type 2
2026-03-28 18:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cff92bc-7630-5cd0-9978-5f92ab76c302, identifier: AH38821
2026-03-28 18:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cff92bc-7630-5cd0-9978-5f92ab76c302 with identifier: AH38821
2026-03-28 18:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cff92bc-7630-5cd0-9978-5f92ab76c302 with identifier: AH38821
2026-03-28 18:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cff92bc-7630-5cd0-9978-5f92ab76c302 with identifier: AH38821 to the API
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:11:32Z',
 'fuel_type': 'petrol',
 'id': '4cff92bc-7630-5cd0-9978-5f92ab76c302',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH38821',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 30204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-28',
 'seller_name': None,
 'title': 'Renault Captur 0.9 TCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2015}
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH38821%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Saving data for AH38821: {'auction_closing_time': 1774883492.0, 'created_time': 1774118545.112776, 'last_price_update_time': 1774723083.175209}
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH38821') HTTP/1.1" 204 0
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ27429%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for WZ27429: 0
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83541%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for YF83541: 2
2026-03-28 18:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e56f4e5-e247-56cf-a2b9-697d39dca00a with identifier: YF83541
2026-03-28 18:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e56f4e5-e247-56cf-a2b9-697d39dca00a with scrape type 2
2026-03-28 18:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e56f4e5-e247-56cf-a2b9-697d39dca00a with scrape type 2
2026-03-28 18:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e56f4e5-e247-56cf-a2b9-697d39dca00a, identifier: YF83541
2026-03-28 18:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e56f4e5-e247-56cf-a2b9-697d39dca00a with identifier: YF83541
2026-03-28 18:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e56f4e5-e247-56cf-a2b9-697d39dca00a with identifier: YF83541
2026-03-28 18:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e56f4e5-e247-56cf-a2b9-697d39dca00a with identifier: YF83541 to the API
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:55:31Z',
 'fuel_type': 'diesel',
 'id': '0e56f4e5-e247-56cf-a2b9-697d39dca00a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF83541',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 284890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-09',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83541%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Saving data for YF83541: {'auction_closing_time': 1774886131.0, 'created_time': 1774521584.185089, 'last_price_update_time': 1774723083.623476}
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF83541') HTTP/1.1" 204 0
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC36419%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for MC36419: 0
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK25487%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for BK25487: 0
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13854%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for EA13854: 0
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67551%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for MH67551: 0
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF98082%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for KF98082: 2
2026-03-28 18:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with identifier: KF98082
2026-03-28 18:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with scrape type 2
2026-03-28 18:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with scrape type 2
2026-03-28 18:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762, identifier: KF98082
2026-03-28 18:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with identifier: KF98082
2026-03-28 18:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with identifier: KF98082
2026-03-28 18:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with identifier: KF98082 to the API
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:20:42Z',
 'fuel_type': 'petrol',
 'id': '1f162d6f-6e38-554d-b98e-c5a0cf2c9762',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF98082',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 73254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2009}
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF98082%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [auto1.de] INFO: Saving data for KF98082: {'auction_closing_time': 1774884042.0, 'created_time': 1774522152.056699, 'last_price_update_time': 1774723084.200473}
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF98082') HTTP/1.1" 204 0
2026-03-28 18:38:04 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK49064%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [auto1.de] INFO: Scrape type for BK49064: 0
2026-03-28 18:38:04 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-28 18:38:04 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA94096%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [auto1.de] INFO: Scrape type for SA94096: 0
2026-03-28 18:38:04 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE33973%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [auto1.de] INFO: Scrape type for HE33973: 0
2026-03-28 18:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:05 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE33973%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Scrape type for HE33973: 0
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR72060%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Scrape type for AR72060: 2
2026-03-28 18:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with identifier: AR72060
2026-03-28 18:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with scrape type 2
2026-03-28 18:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with scrape type 2
2026-03-28 18:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8306150f-da16-5cd2-8527-3d2bfc7f92f4, identifier: AR72060
2026-03-28 18:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with identifier: AR72060
2026-03-28 18:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with identifier: AR72060
2026-03-28 18:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with identifier: AR72060 to the API
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:48:22Z',
 'fuel_type': 'diesel',
 'id': '8306150f-da16-5cd2-8527-3d2bfc7f92f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR72060',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 141659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-15',
 'seller_name': None,
 'title': 'BMW 2er 220d Gran Tourer Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2015}
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR72060%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Saving data for AR72060: {'auction_closing_time': 1774885702.0, 'created_time': 1774522108.18799, 'last_price_update_time': 1774723085.726848}
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR72060') HTTP/1.1" 204 0
2026-03-28 18:38:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA65377%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Scrape type for HA65377: 0
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG36952%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Scrape type for BG36952: 0
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR06088%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Scrape type for XR06088: 0
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK78247%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Scrape type for WK78247: 0
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY74387%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Scrape type for RY74387: 0
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB80689%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Scrape type for NB80689: 0
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05399%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Scrape type for LU05399: 2
2026-03-28 18:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with identifier: LU05399
2026-03-28 18:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with scrape type 2
2026-03-28 18:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with scrape type 2
2026-03-28 18:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4c8b30f-3e4e-5ee3-9431-89b2335b9551, identifier: LU05399
2026-03-28 18:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with identifier: LU05399
2026-03-28 18:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with identifier: LU05399
2026-03-28 18:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with identifier: LU05399 to the API
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:11:33Z',
 'fuel_type': 'petrol',
 'id': 'c4c8b30f-3e4e-5ee3-9431-89b2335b9551',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU05399',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 144678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-08',
 'seller_name': None,
 'title': 'Renault Espace 2.0 Turbo Dynamique',
 'transmission': 'automatic',
 'trim': 'Dynamique',
 'year': 2006}
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05399%27 HTTP/1.1" 200 None
2026-03-28 18:38:06 [auto1.de] INFO: Saving data for LU05399: {'auction_closing_time': 1774883493.0, 'created_time': 1774034620.095612, 'last_price_update_time': 1774723086.296898}
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU05399') HTTP/1.1" 204 0
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37659%27 HTTP/1.1" 200 None
2026-03-28 18:38:06 [auto1.de] INFO: Scrape type for CG37659: 0
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH13691%27 HTTP/1.1" 200 None
2026-03-28 18:38:06 [auto1.de] INFO: Scrape type for NH13691: 0
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM12960%27 HTTP/1.1" 200 None
2026-03-28 18:38:06 [auto1.de] INFO: Scrape type for ZM12960: 0
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU88385%27 HTTP/1.1" 200 None
2026-03-28 18:38:06 [auto1.de] INFO: Scrape type for HU88385: 0
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG81975%27 HTTP/1.1" 200 None
2026-03-28 18:38:06 [auto1.de] INFO: Scrape type for MG81975: 2
2026-03-28 18:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79f41c08-e1c8-54ef-820c-82ae5030fff1 with identifier: MG81975
2026-03-28 18:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79f41c08-e1c8-54ef-820c-82ae5030fff1 with scrape type 2
2026-03-28 18:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79f41c08-e1c8-54ef-820c-82ae5030fff1 with scrape type 2
2026-03-28 18:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79f41c08-e1c8-54ef-820c-82ae5030fff1, identifier: MG81975
2026-03-28 18:38:06 [scrapy.extensions.logstats] INFO: Crawled 83 pages (at 21 pages/min), scraped 200 items (at 69 items/min)
2026-03-28 18:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-28 18:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79f41c08-e1c8-54ef-820c-82ae5030fff1 with identifier: MG81975
2026-03-28 18:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79f41c08-e1c8-54ef-820c-82ae5030fff1 with identifier: MG81975
2026-03-28 18:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79f41c08-e1c8-54ef-820c-82ae5030fff1 with identifier: MG81975 to the API
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:38:40Z',
 'fuel_type': 'petrol',
 'id': '79f41c08-e1c8-54ef-820c-82ae5030fff1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG81975',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 131228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-06',
 'seller_name': None,
 'title': 'Mazda 3 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG81975%27 HTTP/1.1" 200 None
2026-03-28 18:38:06 [auto1.de] INFO: Saving data for MG81975: {'auction_closing_time': 1774885120.0, 'created_time': 1774522189.849585, 'last_price_update_time': 1774723086.932859}
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG81975') HTTP/1.1" 204 0
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV10728%27 HTTP/1.1" 200 None
2026-03-28 18:38:06 [auto1.de] INFO: Scrape type for BV10728: 0
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX49915%27 HTTP/1.1" 200 None
2026-03-28 18:38:06 [auto1.de] INFO: Scrape type for HX49915: 0
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70837%27 HTTP/1.1" 200 None
2026-03-28 18:38:07 [auto1.de] INFO: Scrape type for DM70837: 0
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE50897%27 HTTP/1.1" 200 None
2026-03-28 18:38:07 [auto1.de] INFO: Scrape type for KE50897: 0
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL07705%27 HTTP/1.1" 200 None
2026-03-28 18:38:07 [auto1.de] INFO: Scrape type for BL07705: 0
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM64478%27 HTTP/1.1" 200 None
2026-03-28 18:38:07 [auto1.de] INFO: Scrape type for AM64478: 0
2026-03-28 18:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:08 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:08 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP72323%27 HTTP/1.1" 200 None
2026-03-28 18:38:09 [auto1.de] INFO: Scrape type for RP72323: 0
2026-03-28 18:38:09 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF85526%27 HTTP/1.1" 200 None
2026-03-28 18:38:09 [auto1.de] INFO: Scrape type for CF85526: 2
2026-03-28 18:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7bc35b9-6828-580e-940b-ad3dc78296cb with identifier: CF85526
2026-03-28 18:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7bc35b9-6828-580e-940b-ad3dc78296cb with scrape type 2
2026-03-28 18:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7bc35b9-6828-580e-940b-ad3dc78296cb with scrape type 2
2026-03-28 18:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7bc35b9-6828-580e-940b-ad3dc78296cb, identifier: CF85526
2026-03-28 18:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7bc35b9-6828-580e-940b-ad3dc78296cb with identifier: CF85526
2026-03-28 18:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7bc35b9-6828-580e-940b-ad3dc78296cb with identifier: CF85526
2026-03-28 18:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7bc35b9-6828-580e-940b-ad3dc78296cb with identifier: CF85526 to the API
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:09:10Z',
 'fuel_type': 'petrol',
 'id': 'a7bc35b9-6828-580e-940b-ad3dc78296cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF85526',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 106802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-10',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF85526%27 HTTP/1.1" 200 None
2026-03-28 18:38:09 [auto1.de] INFO: Saving data for CF85526: {'auction_closing_time': 1774883350.0, 'created_time': 1773227566.121359, 'last_price_update_time': 1774723089.469589}
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF85526') HTTP/1.1" 204 0
2026-03-28 18:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:09 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92660%27 HTTP/1.1" 200 None
2026-03-28 18:38:09 [auto1.de] INFO: Scrape type for TX92660: 0
2026-03-28 18:38:09 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-28 18:38:09 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19270%27 HTTP/1.1" 200 None
2026-03-28 18:38:09 [auto1.de] INFO: Scrape type for YJ19270: 0
2026-03-28 18:38:09 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-28 18:38:09 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX91022%27 HTTP/1.1" 200 None
2026-03-28 18:38:09 [auto1.de] INFO: Scrape type for GX91022: 0
2026-03-28 18:38:09 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-28 18:38:09 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA56207%27 HTTP/1.1" 200 None
2026-03-28 18:38:09 [auto1.de] INFO: Scrape type for UA56207: 2
2026-03-28 18:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with identifier: UA56207
2026-03-28 18:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with scrape type 2
2026-03-28 18:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with scrape type 2
2026-03-28 18:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f060cc35-4113-5f3f-9eb8-57f7ad02ea75, identifier: UA56207
2026-03-28 18:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with identifier: UA56207
2026-03-28 18:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with identifier: UA56207
2026-03-28 18:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with identifier: UA56207 to the API
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:47:47Z',
 'fuel_type': 'diesel',
 'id': 'f060cc35-4113-5f3f-9eb8-57f7ad02ea75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA56207',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 38847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-19',
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2018}
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA56207%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Saving data for UA56207: {'auction_closing_time': 1774885667.0, 'created_time': 1773345212.34461, 'last_price_update_time': 1774723090.052238}
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA56207') HTTP/1.1" 204 0
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79607%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for KL79607: 0
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88982%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for HG88982: 2
2026-03-28 18:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 525f407c-e6f0-5e8d-b628-1e1b00077b2b with identifier: HG88982
2026-03-28 18:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 525f407c-e6f0-5e8d-b628-1e1b00077b2b with scrape type 2
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 525f407c-e6f0-5e8d-b628-1e1b00077b2b with scrape type 2
2026-03-28 18:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 525f407c-e6f0-5e8d-b628-1e1b00077b2b, identifier: HG88982
2026-03-28 18:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 525f407c-e6f0-5e8d-b628-1e1b00077b2b with identifier: HG88982
2026-03-28 18:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 525f407c-e6f0-5e8d-b628-1e1b00077b2b with identifier: HG88982
2026-03-28 18:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 525f407c-e6f0-5e8d-b628-1e1b00077b2b with identifier: HG88982 to the API
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:32:25Z',
 'fuel_type': 'diesel',
 'id': '525f407c-e6f0-5e8d-b628-1e1b00077b2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG88982',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 207271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-03',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline 4Motion BlueMotion',
 'year': 2015}
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88982%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Saving data for HG88982: {'auction_closing_time': 1774884745.0, 'created_time': 1773229937.87208, 'last_price_update_time': 1774723090.52575}
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG88982') HTTP/1.1" 204 0
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL76472%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for YL76472: 0
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED43113%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for ED43113: 0
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL54594%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for DL54594: 0
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW09320%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for BW09320: 0
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP13980%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for EP13980: 0
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE37083%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for DE37083: 0
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP19513%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for GP19513: 0
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96558%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for VB96558: 0
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-28 18:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:11 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW98982%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [auto1.de] INFO: Scrape type for UW98982: 0
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34308%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [auto1.de] INFO: Scrape type for DG34308: 0
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM13407%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [auto1.de] INFO: Scrape type for SM13407: 0
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71348%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [auto1.de] INFO: Scrape type for KZ71348: 0
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP54397%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [auto1.de] INFO: Scrape type for GP54397: 0
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE22331%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [auto1.de] INFO: Scrape type for DE22331: 0
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96543%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [auto1.de] INFO: Scrape type for XZ96543: 0
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: US78573
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US78573%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [auto1.de] INFO: Scrape type for US78573: 0
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13409%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [auto1.de] INFO: Scrape type for TR13409: 2
2026-03-28 18:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a88b5f00-afc0-5f02-92ca-29d6080430e2 with identifier: TR13409
2026-03-28 18:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a88b5f00-afc0-5f02-92ca-29d6080430e2 with scrape type 2
2026-03-28 18:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a88b5f00-afc0-5f02-92ca-29d6080430e2 with scrape type 2
2026-03-28 18:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a88b5f00-afc0-5f02-92ca-29d6080430e2, identifier: TR13409
2026-03-28 18:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a88b5f00-afc0-5f02-92ca-29d6080430e2 with identifier: TR13409
2026-03-28 18:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a88b5f00-afc0-5f02-92ca-29d6080430e2 with identifier: TR13409
2026-03-28 18:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a88b5f00-afc0-5f02-92ca-29d6080430e2 with identifier: TR13409 to the API
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:07:39Z',
 'fuel_type': 'diesel',
 'id': 'a88b5f00-afc0-5f02-92ca-29d6080430e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR13409',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 127899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-07',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket plus',
 'year': 2013}
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13409%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Saving data for TR13409: {'auction_closing_time': 1774883259.0, 'created_time': 1773946547.883605, 'last_price_update_time': 1774723092.327306}
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR13409') HTTP/1.1" 204 0
2026-03-28 18:38:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93445%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Scrape type for NL93445: 0
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK62428%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Scrape type for VK62428: 0
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD70157%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Scrape type for MD70157: 0
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS55646%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Scrape type for ZS55646: 2
2026-03-28 18:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d6319a2-bad8-56d7-837d-e184347807c0 with identifier: ZS55646
2026-03-28 18:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d6319a2-bad8-56d7-837d-e184347807c0 with scrape type 2
2026-03-28 18:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d6319a2-bad8-56d7-837d-e184347807c0 with scrape type 2
2026-03-28 18:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d6319a2-bad8-56d7-837d-e184347807c0, identifier: ZS55646
2026-03-28 18:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d6319a2-bad8-56d7-837d-e184347807c0 with identifier: ZS55646
2026-03-28 18:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d6319a2-bad8-56d7-837d-e184347807c0 with identifier: ZS55646
2026-03-28 18:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d6319a2-bad8-56d7-837d-e184347807c0 with identifier: ZS55646 to the API
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:32:21Z',
 'fuel_type': 'diesel',
 'id': '6d6319a2-bad8-56d7-837d-e184347807c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS55646',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 322535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-29',
 'seller_name': None,
 'title': 'BMW 3er 320d EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2012}
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS55646%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Saving data for ZS55646: {'auction_closing_time': 1774884741.0, 'created_time': 1774350253.45486, 'last_price_update_time': 1774723092.919655}
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS55646') HTTP/1.1" 204 0
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38480%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Scrape type for CA38480: 0
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT32036%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Scrape type for UT32036: 0
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF88550%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Scrape type for UF88550: 0
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH20562%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Scrape type for KH20562: 0
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM14327%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [auto1.de] INFO: Scrape type for XM14327: 0
2026-03-28 18:38:13 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-28 18:38:13 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-28 18:38:13 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-28 18:38:13 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-28 18:38:13 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ90967%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [auto1.de] INFO: Scrape type for JJ90967: 2
2026-03-28 18:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef26d279-a85b-5aa6-bdc1-faff4f306f50 with identifier: JJ90967
2026-03-28 18:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef26d279-a85b-5aa6-bdc1-faff4f306f50 with scrape type 2
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef26d279-a85b-5aa6-bdc1-faff4f306f50 with scrape type 2
2026-03-28 18:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef26d279-a85b-5aa6-bdc1-faff4f306f50, identifier: JJ90967
2026-03-28 18:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef26d279-a85b-5aa6-bdc1-faff4f306f50 with identifier: JJ90967
2026-03-28 18:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef26d279-a85b-5aa6-bdc1-faff4f306f50 with identifier: JJ90967
2026-03-28 18:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef26d279-a85b-5aa6-bdc1-faff4f306f50 with identifier: JJ90967 to the API
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:15Z',
 'fuel_type': 'petrol',
 'id': 'ef26d279-a85b-5aa6-bdc1-faff4f306f50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ90967',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 188785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ90967%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [auto1.de] INFO: Saving data for JJ90967: {'auction_closing_time': 1774883775.0, 'created_time': 1774522143.059001, 'last_price_update_time': 1774723093.461091}
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ90967') HTTP/1.1" 204 0
2026-03-28 18:38:13 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-28 18:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:15 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:15 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-28 18:38:15 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND67175%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [auto1.de] INFO: Scrape type for ND67175: 0
2026-03-28 18:38:15 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-28 18:38:15 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG01299%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [auto1.de] INFO: Scrape type for FG01299: 2
2026-03-28 18:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce51b7c8-365b-5bca-87a3-d6997ee936df with identifier: FG01299
2026-03-28 18:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce51b7c8-365b-5bca-87a3-d6997ee936df with scrape type 2
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce51b7c8-365b-5bca-87a3-d6997ee936df with scrape type 2
2026-03-28 18:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce51b7c8-365b-5bca-87a3-d6997ee936df, identifier: FG01299
2026-03-28 18:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce51b7c8-365b-5bca-87a3-d6997ee936df with identifier: FG01299
2026-03-28 18:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce51b7c8-365b-5bca-87a3-d6997ee936df with identifier: FG01299
2026-03-28 18:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce51b7c8-365b-5bca-87a3-d6997ee936df with identifier: FG01299 to the API
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:44:59Z',
 'fuel_type': 'petrol',
 'id': 'ce51b7c8-365b-5bca-87a3-d6997ee936df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG01299',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 197731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-29',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2009}
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG01299%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [auto1.de] INFO: Saving data for FG01299: {'auction_closing_time': 1774885499.0, 'created_time': 1774522140.954486, 'last_price_update_time': 1774723095.667225}
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG01299') HTTP/1.1" 204 0
2026-03-28 18:38:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:15 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-28 18:38:15 [auto1.de] INFO: Found listing with ID: XN62659
2026-03-28 18:38:15 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-28 18:38:15 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-28 18:38:15 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD50788%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [auto1.de] INFO: Scrape type for XD50788: 0
2026-03-28 18:38:15 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-28 18:38:15 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30438%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [auto1.de] INFO: Scrape type for WX30438: 0
2026-03-28 18:38:15 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-28 18:38:15 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED91782%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [auto1.de] INFO: Scrape type for ED91782: 2
2026-03-28 18:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0295c5d7-fb95-550a-847b-28b21e0b69a1 with identifier: ED91782
2026-03-28 18:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0295c5d7-fb95-550a-847b-28b21e0b69a1 with scrape type 2
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0295c5d7-fb95-550a-847b-28b21e0b69a1 with scrape type 2
2026-03-28 18:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0295c5d7-fb95-550a-847b-28b21e0b69a1, identifier: ED91782
2026-03-28 18:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0295c5d7-fb95-550a-847b-28b21e0b69a1 with identifier: ED91782
2026-03-28 18:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0295c5d7-fb95-550a-847b-28b21e0b69a1 with identifier: ED91782
2026-03-28 18:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0295c5d7-fb95-550a-847b-28b21e0b69a1 with identifier: ED91782 to the API
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:11Z',
 'fuel_type': 'petrol',
 'id': '0295c5d7-fb95-550a-847b-28b21e0b69a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED91782',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 121759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Trendline 4Motion BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline 4Motion BlueMotion',
 'year': 2017}
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED91782%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [auto1.de] INFO: Saving data for ED91782: {'auction_closing_time': 1774884251.0, 'created_time': 1774522265.655727, 'last_price_update_time': 1774723096.1687}
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED91782') HTTP/1.1" 204 0
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE71372%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [auto1.de] INFO: Scrape type for FE71372: 0
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51493%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [auto1.de] INFO: Scrape type for SS51493: 0
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ04828%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [auto1.de] INFO: Scrape type for HJ04828: 0
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56526%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [auto1.de] INFO: Scrape type for KU56526: 0
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: WD73510
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD73510%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [auto1.de] INFO: Scrape type for WD73510: 2
2026-03-28 18:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afa54f4c-493d-586d-a2b2-24e95d5f486f with identifier: WD73510
2026-03-28 18:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afa54f4c-493d-586d-a2b2-24e95d5f486f with scrape type 2
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afa54f4c-493d-586d-a2b2-24e95d5f486f with scrape type 2
2026-03-28 18:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afa54f4c-493d-586d-a2b2-24e95d5f486f, identifier: WD73510
2026-03-28 18:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afa54f4c-493d-586d-a2b2-24e95d5f486f with identifier: WD73510
2026-03-28 18:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afa54f4c-493d-586d-a2b2-24e95d5f486f with identifier: WD73510
2026-03-28 18:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afa54f4c-493d-586d-a2b2-24e95d5f486f with identifier: WD73510 to the API
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:00:01Z',
 'fuel_type': 'petrol',
 'id': 'afa54f4c-493d-586d-a2b2-24e95d5f486f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD73510',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 28231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2015}
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD73510%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [auto1.de] INFO: Saving data for WD73510: {'auction_closing_time': 1774882801.0, 'created_time': 1773466533.201349, 'last_price_update_time': 1774723096.815537}
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD73510') HTTP/1.1" 204 0
2026-03-28 18:38:16 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ29192%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [auto1.de] INFO: Scrape type for JJ29192: 2
2026-03-28 18:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with identifier: JJ29192
2026-03-28 18:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with scrape type 2
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with scrape type 2
2026-03-28 18:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd, identifier: JJ29192
2026-03-28 18:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with identifier: JJ29192
2026-03-28 18:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with identifier: JJ29192
2026-03-28 18:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with identifier: JJ29192 to the API
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:41:19Z',
 'fuel_type': 'petrol',
 'id': '8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ29192',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 186438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-09',
 'seller_name': None,
 'title': 'BMW 1er 116i Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2008}
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ29192%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [auto1.de] INFO: Saving data for JJ29192: {'auction_closing_time': 1774885279.0, 'created_time': 1773382596.543345, 'last_price_update_time': 1774723097.38389}
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ29192') HTTP/1.1" 204 0
2026-03-28 18:38:17 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-28 18:38:17 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN05925%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [auto1.de] INFO: Scrape type for ZN05925: 0
2026-03-28 18:38:17 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-28 18:38:17 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH25486%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [auto1.de] INFO: Scrape type for PH25486: 0
2026-03-28 18:38:17 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX13584%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [auto1.de] INFO: Scrape type for WX13584: 0
2026-03-28 18:38:17 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY00431%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [auto1.de] INFO: Scrape type for EY00431: 0
2026-03-28 18:38:17 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-28 18:38:17 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-28 18:38:17 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY60596%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [auto1.de] INFO: Scrape type for HY60596: 0
2026-03-28 18:38:17 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35846%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [auto1.de] INFO: Scrape type for PB35846: 0
2026-03-28 18:38:17 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS55163%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [auto1.de] INFO: Scrape type for YS55163: 0
2026-03-28 18:38:17 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:18 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:18 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-28 18:38:18 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-28 18:38:18 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK68330%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [auto1.de] INFO: Scrape type for MK68330: 0
2026-03-28 18:38:18 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ14311%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [auto1.de] INFO: Scrape type for RZ14311: 2
2026-03-28 18:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with identifier: RZ14311
2026-03-28 18:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with scrape type 2
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with scrape type 2
2026-03-28 18:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca3d5718-933b-5fe6-9bc3-2b748e4b0093, identifier: RZ14311
2026-03-28 18:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with identifier: RZ14311
2026-03-28 18:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with identifier: RZ14311
2026-03-28 18:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with identifier: RZ14311 to the API
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:51:53Z',
 'fuel_type': 'diesel',
 'id': 'ca3d5718-933b-5fe6-9bc3-2b748e4b0093',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ14311',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 484880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-18',
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 2.0 TDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2015}
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ14311%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [auto1.de] INFO: Saving data for RZ14311: {'auction_closing_time': 1774885913.0, 'created_time': 1773224131.491213, 'last_price_update_time': 1774723098.776257}
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ14311') HTTP/1.1" 204 0
2026-03-28 18:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:18 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB08106%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [auto1.de] INFO: Scrape type for HB08106: 0
2026-03-28 18:38:18 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM76815%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [auto1.de] INFO: Scrape type for BM76815: 0
2026-03-28 18:38:18 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40216%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [auto1.de] INFO: Scrape type for ZU40216: 0
2026-03-28 18:38:18 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70862%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [auto1.de] INFO: Scrape type for DM70862: 0
2026-03-28 18:38:18 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-28 18:38:18 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23896%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [auto1.de] INFO: Scrape type for JD23896: 0
2026-03-28 18:38:18 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE61397%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [auto1.de] INFO: Scrape type for VE61397: 0
2026-03-28 18:38:18 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW97412%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [auto1.de] INFO: Scrape type for GW97412: 2
2026-03-28 18:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bb45f3f-ad9d-51e6-a619-fd514554a051 with identifier: GW97412
2026-03-28 18:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bb45f3f-ad9d-51e6-a619-fd514554a051 with scrape type 2
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bb45f3f-ad9d-51e6-a619-fd514554a051 with scrape type 2
2026-03-28 18:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bb45f3f-ad9d-51e6-a619-fd514554a051, identifier: GW97412
2026-03-28 18:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bb45f3f-ad9d-51e6-a619-fd514554a051 with identifier: GW97412
2026-03-28 18:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bb45f3f-ad9d-51e6-a619-fd514554a051 with identifier: GW97412
2026-03-28 18:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bb45f3f-ad9d-51e6-a619-fd514554a051 with identifier: GW97412 to the API
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:46Z',
 'fuel_type': 'petrol',
 'id': '7bb45f3f-ad9d-51e6-a619-fd514554a051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW97412',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 70537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-18',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2021}
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW97412%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Saving data for GW97412: {'auction_closing_time': 1774885006.0, 'created_time': 1773134754.157556, 'last_price_update_time': 1774723099.415401}
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW97412') HTTP/1.1" 204 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA54240%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for CA54240: 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV08426%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for UV08426: 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU43350%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for ZU43350: 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS28030%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for SS28030: 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN40502%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for ZN40502: 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV10952%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for WV10952: 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU97666%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for VU97666: 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD78060%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for VD78060: 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW04069%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for RW04069: 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51107%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for SS51107: 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ43768%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for ZZ43768: 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS04042%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for CS04042: 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG21382%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for YG21382: 0
2026-03-28 18:38:19 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK43120%27 HTTP/1.1" 200 None
2026-03-28 18:38:19 [auto1.de] INFO: Scrape type for ZK43120: 2
2026-03-28 18:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c13eaeea-2787-5935-a3ce-e38859fb0902 with identifier: ZK43120
2026-03-28 18:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c13eaeea-2787-5935-a3ce-e38859fb0902 with scrape type 2
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c13eaeea-2787-5935-a3ce-e38859fb0902 with scrape type 2
2026-03-28 18:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c13eaeea-2787-5935-a3ce-e38859fb0902, identifier: ZK43120
2026-03-28 18:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c13eaeea-2787-5935-a3ce-e38859fb0902 with identifier: ZK43120
2026-03-28 18:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c13eaeea-2787-5935-a3ce-e38859fb0902 with identifier: ZK43120
2026-03-28 18:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c13eaeea-2787-5935-a3ce-e38859fb0902 with identifier: ZK43120 to the API
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:14:26Z',
 'fuel_type': 'diesel',
 'id': 'c13eaeea-2787-5935-a3ce-e38859fb0902',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK43120',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 186821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 111 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2007}
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK43120%27 HTTP/1.1" 200 None
2026-03-28 18:38:20 [auto1.de] INFO: Saving data for ZK43120: {'auction_closing_time': 1774883666.0, 'created_time': 1773947073.680524, 'last_price_update_time': 1774723100.219317}
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK43120') HTTP/1.1" 204 0
2026-03-28 18:38:20 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ78717%27 HTTP/1.1" 200 None
2026-03-28 18:38:20 [auto1.de] INFO: Scrape type for AJ78717: 0
2026-03-28 18:38:20 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH89031%27 HTTP/1.1" 200 None
2026-03-28 18:38:20 [auto1.de] INFO: Scrape type for FH89031: 0
2026-03-28 18:38:20 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-28 18:38:20 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19815%27 HTTP/1.1" 200 None
2026-03-28 18:38:20 [auto1.de] INFO: Scrape type for SC19815: 0
2026-03-28 18:38:20 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU03537%27 HTTP/1.1" 200 None
2026-03-28 18:38:20 [auto1.de] INFO: Scrape type for YU03537: 0
2026-03-28 18:38:20 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-28 18:38:20 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE48122%27 HTTP/1.1" 200 None
2026-03-28 18:38:20 [auto1.de] INFO: Scrape type for JE48122: 0
2026-03-28 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:21 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:21 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF31444%27 HTTP/1.1" 200 None
2026-03-28 18:38:21 [auto1.de] INFO: Scrape type for BF31444: 0
2026-03-28 18:38:21 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ77655%27 HTTP/1.1" 200 None
2026-03-28 18:38:21 [auto1.de] INFO: Scrape type for DJ77655: 0
2026-03-28 18:38:21 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW69749%27 HTTP/1.1" 200 None
2026-03-28 18:38:21 [auto1.de] INFO: Scrape type for LW69749: 2
2026-03-28 18:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69b1ed9-2bac-5178-bc91-933aa9cde670 with identifier: LW69749
2026-03-28 18:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69b1ed9-2bac-5178-bc91-933aa9cde670 with scrape type 2
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b69b1ed9-2bac-5178-bc91-933aa9cde670 with scrape type 2
2026-03-28 18:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b69b1ed9-2bac-5178-bc91-933aa9cde670, identifier: LW69749
2026-03-28 18:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b69b1ed9-2bac-5178-bc91-933aa9cde670 with identifier: LW69749
2026-03-28 18:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b69b1ed9-2bac-5178-bc91-933aa9cde670 with identifier: LW69749
2026-03-28 18:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b69b1ed9-2bac-5178-bc91-933aa9cde670 with identifier: LW69749 to the API
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:49:09Z',
 'fuel_type': 'diesel',
 'id': 'b69b1ed9-2bac-5178-bc91-933aa9cde670',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW69749',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 122743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-22',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW69749%27 HTTP/1.1" 200 None
2026-03-28 18:38:21 [auto1.de] INFO: Saving data for LW69749: {'auction_closing_time': 1774885749.0, 'created_time': 1774350634.114974, 'last_price_update_time': 1774723101.956049}
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW69749') HTTP/1.1" 204 0
2026-03-28 18:38:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:21 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU51889%27 HTTP/1.1" 200 None
2026-03-28 18:38:21 [auto1.de] INFO: Scrape type for EU51889: 0
2026-03-28 18:38:21 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG35961%27 HTTP/1.1" 200 None
2026-03-28 18:38:22 [auto1.de] INFO: Scrape type for DG35961: 0
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG76856%27 HTTP/1.1" 200 None
2026-03-28 18:38:22 [auto1.de] INFO: Scrape type for EG76856: 0
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: US02373
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD83034%27 HTTP/1.1" 200 None
2026-03-28 18:38:22 [auto1.de] INFO: Scrape type for SD83034: 0
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY84491%27 HTTP/1.1" 200 None
2026-03-28 18:38:22 [auto1.de] INFO: Scrape type for SY84491: 0
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR94699%27 HTTP/1.1" 200 None
2026-03-28 18:38:22 [auto1.de] INFO: Scrape type for DR94699: 0
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63692%27 HTTP/1.1" 200 None
2026-03-28 18:38:22 [auto1.de] INFO: Scrape type for TP63692: 2
2026-03-28 18:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with identifier: TP63692
2026-03-28 18:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with scrape type 2
2026-03-28 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with scrape type 2
2026-03-28 18:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4, identifier: TP63692
2026-03-28 18:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with identifier: TP63692
2026-03-28 18:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with identifier: TP63692
2026-03-28 18:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with identifier: TP63692 to the API
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:05:18Z',
 'fuel_type': 'diesel',
 'id': '3742e63d-7217-51cc-a9eb-cd0e9a90cbe4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP63692',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 186748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-27',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63692%27 HTTP/1.1" 200 None
2026-03-28 18:38:22 [auto1.de] INFO: Saving data for TP63692: {'auction_closing_time': 1774883118.0, 'created_time': 1773945770.31255, 'last_price_update_time': 1774723102.491616}
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP63692') HTTP/1.1" 204 0
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT65842%27 HTTP/1.1" 200 None
2026-03-28 18:38:22 [auto1.de] INFO: Scrape type for CT65842: 0
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA01752%27 HTTP/1.1" 200 None
2026-03-28 18:38:22 [auto1.de] INFO: Scrape type for TA01752: 0
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: EK13927
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK13927%27 HTTP/1.1" 200 None
2026-03-28 18:38:22 [auto1.de] INFO: Scrape type for EK13927: 1
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR38354%27 HTTP/1.1" 200 None
2026-03-28 18:38:22 [auto1.de] INFO: Scrape type for CR38354: 0
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-28 18:38:22 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH07682%27 HTTP/1.1" 200 None
2026-03-28 18:38:22 [auto1.de] INFO: Scrape type for GH07682: 2
2026-03-28 18:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed9becb-58eb-5e5d-ab29-1f07305abc6e with identifier: GH07682
2026-03-28 18:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed9becb-58eb-5e5d-ab29-1f07305abc6e with scrape type 2
2026-03-28 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fed9becb-58eb-5e5d-ab29-1f07305abc6e with scrape type 2
2026-03-28 18:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fed9becb-58eb-5e5d-ab29-1f07305abc6e, identifier: GH07682
2026-03-28 18:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fed9becb-58eb-5e5d-ab29-1f07305abc6e with identifier: GH07682
2026-03-28 18:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fed9becb-58eb-5e5d-ab29-1f07305abc6e with identifier: GH07682
2026-03-28 18:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fed9becb-58eb-5e5d-ab29-1f07305abc6e with identifier: GH07682 to the API
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 440,
 'expiration_date': '2026-03-30T15:33:38Z',
 'fuel_type': 'petrol',
 'id': 'fed9becb-58eb-5e5d-ab29-1f07305abc6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH07682',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 109980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-24',
 'seller_name': None,
 'title': 'Porsche Cayenne GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH07682%27 HTTP/1.1" 200 None
2026-03-28 18:38:23 [auto1.de] INFO: Saving data for GH07682: {'auction_closing_time': 1774884818.0, 'created_time': 1773402275.523204, 'last_price_update_time': 1774723103.123521}
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH07682') HTTP/1.1" 204 0
2026-03-28 18:38:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:23 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-28 18:38:23 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28097%27 HTTP/1.1" 200 None
2026-03-28 18:38:23 [auto1.de] INFO: Scrape type for WC28097: 2
2026-03-28 18:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c76c79-86a4-5acf-b698-d2567d48235d with identifier: WC28097
2026-03-28 18:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c76c79-86a4-5acf-b698-d2567d48235d with scrape type 2
2026-03-28 18:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82c76c79-86a4-5acf-b698-d2567d48235d with scrape type 2
2026-03-28 18:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82c76c79-86a4-5acf-b698-d2567d48235d, identifier: WC28097
2026-03-28 18:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82c76c79-86a4-5acf-b698-d2567d48235d with identifier: WC28097
2026-03-28 18:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82c76c79-86a4-5acf-b698-d2567d48235d with identifier: WC28097
2026-03-28 18:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82c76c79-86a4-5acf-b698-d2567d48235d with identifier: WC28097 to the API
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:32:40Z',
 'fuel_type': 'diesel',
 'id': '82c76c79-86a4-5acf-b698-d2567d48235d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC28097',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 195999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-24',
 'seller_name': None,
 'title': 'BMW 3er 330d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28097%27 HTTP/1.1" 200 None
2026-03-28 18:38:23 [auto1.de] INFO: Saving data for WC28097: {'auction_closing_time': 1774884760.0, 'created_time': 1774636652.762221, 'last_price_update_time': 1774723103.535602}
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC28097') HTTP/1.1" 204 0
2026-03-28 18:38:23 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB32004%27 HTTP/1.1" 200 None
2026-03-28 18:38:23 [auto1.de] INFO: Scrape type for WB32004: 0
2026-03-28 18:38:23 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-28 18:38:23 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-28 18:38:23 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-28 18:38:23 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97428%27 HTTP/1.1" 200 None
2026-03-28 18:38:23 [auto1.de] INFO: Scrape type for YY97428: 0
2026-03-28 18:38:23 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-28 18:38:23 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-28 18:38:23 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-28 18:38:23 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-28 18:38:23 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM80186%27 HTTP/1.1" 200 None
2026-03-28 18:38:23 [auto1.de] INFO: Scrape type for EM80186: 2
2026-03-28 18:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb1b1e42-fa90-514a-814c-dd2cd41a2211 with identifier: EM80186
2026-03-28 18:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb1b1e42-fa90-514a-814c-dd2cd41a2211 with scrape type 2
2026-03-28 18:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb1b1e42-fa90-514a-814c-dd2cd41a2211 with scrape type 2
2026-03-28 18:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb1b1e42-fa90-514a-814c-dd2cd41a2211, identifier: EM80186
2026-03-28 18:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb1b1e42-fa90-514a-814c-dd2cd41a2211 with identifier: EM80186
2026-03-28 18:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb1b1e42-fa90-514a-814c-dd2cd41a2211 with identifier: EM80186
2026-03-28 18:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb1b1e42-fa90-514a-814c-dd2cd41a2211 with identifier: EM80186 to the API
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:34:40Z',
 'fuel_type': 'diesel',
 'id': 'bb1b1e42-fa90-514a-814c-dd2cd41a2211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM80186',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 101692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-19',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM80186%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [auto1.de] INFO: Saving data for EM80186: {'auction_closing_time': 1774884880.0, 'created_time': 1774350161.940641, 'last_price_update_time': 1774723104.106283}
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM80186') HTTP/1.1" 204 0
2026-03-28 18:38:24 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09685%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [auto1.de] INFO: Scrape type for DB09685: 0
2026-03-28 18:38:24 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT11802%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [auto1.de] INFO: Scrape type for HT11802: 0
2026-03-28 18:38:24 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11611%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [auto1.de] INFO: Scrape type for SY11611: 2
2026-03-28 18:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adfb3519-6ed5-5d2c-a088-086b690ffc3c with identifier: SY11611
2026-03-28 18:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adfb3519-6ed5-5d2c-a088-086b690ffc3c with scrape type 2
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adfb3519-6ed5-5d2c-a088-086b690ffc3c with scrape type 2
2026-03-28 18:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adfb3519-6ed5-5d2c-a088-086b690ffc3c, identifier: SY11611
2026-03-28 18:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adfb3519-6ed5-5d2c-a088-086b690ffc3c with identifier: SY11611
2026-03-28 18:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adfb3519-6ed5-5d2c-a088-086b690ffc3c with identifier: SY11611
2026-03-28 18:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adfb3519-6ed5-5d2c-a088-086b690ffc3c with identifier: SY11611 to the API
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:40:49Z',
 'fuel_type': 'petrol',
 'id': 'adfb3519-6ed5-5d2c-a088-086b690ffc3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY11611',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 105670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-07',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Celebration',
 'transmission': 'manual',
 'trim': 'Stepway Celebration',
 'year': 2018}
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11611%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [auto1.de] INFO: Saving data for SY11611: {'auction_closing_time': 1774885249.0, 'created_time': 1773946563.199743, 'last_price_update_time': 1774723104.59572}
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY11611') HTTP/1.1" 204 0
2026-03-28 18:38:24 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE16717%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [auto1.de] INFO: Scrape type for NE16717: 0
2026-03-28 18:38:24 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX36326%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [auto1.de] INFO: Scrape type for HX36326: 0
2026-03-28 18:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK13927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:25 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW76685%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [auto1.de] INFO: Scrape type for ZW76685: 0
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT22955%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [auto1.de] INFO: Scrape type for ZT22955: 0
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML35786%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [auto1.de] INFO: Scrape type for ML35786: 0
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG74367%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [auto1.de] INFO: Scrape type for YG74367: 0
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC06699%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [auto1.de] INFO: Scrape type for BC06699: 0
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW39351%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [auto1.de] INFO: Scrape type for TW39351: 0
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX92411%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [auto1.de] INFO: Scrape type for XX92411: 0
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX62437%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [auto1.de] INFO: Scrape type for BX62437: 0
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06555%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [auto1.de] INFO: Scrape type for VN06555: 0
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-28 18:38:25 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA07160%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [auto1.de] INFO: Scrape type for EA07160: 2
2026-03-28 18:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d831d3c5-504a-56e5-aefb-c068d82c1691 with identifier: EA07160
2026-03-28 18:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d831d3c5-504a-56e5-aefb-c068d82c1691 with scrape type 2
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d831d3c5-504a-56e5-aefb-c068d82c1691 with scrape type 2
2026-03-28 18:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d831d3c5-504a-56e5-aefb-c068d82c1691, identifier: EA07160
2026-03-28 18:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d831d3c5-504a-56e5-aefb-c068d82c1691 with identifier: EA07160
2026-03-28 18:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d831d3c5-504a-56e5-aefb-c068d82c1691 with identifier: EA07160
2026-03-28 18:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d831d3c5-504a-56e5-aefb-c068d82c1691 with identifier: EA07160 to the API
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:43:51Z',
 'fuel_type': 'petrol',
 'id': 'd831d3c5-504a-56e5-aefb-c068d82c1691',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA07160',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 52498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-15',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA07160%27 HTTP/1.1" 200 None
2026-03-28 18:38:26 [auto1.de] INFO: Saving data for EA07160: {'auction_closing_time': 1774885431.0, 'created_time': 1774522463.055979, 'last_price_update_time': 1774723106.201846}
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA07160') HTTP/1.1" 204 0
2026-03-28 18:38:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:26 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48051%27 HTTP/1.1" 200 None
2026-03-28 18:38:26 [auto1.de] INFO: Scrape type for MY48051: 2
2026-03-28 18:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with identifier: MY48051
2026-03-28 18:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with scrape type 2
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with scrape type 2
2026-03-28 18:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 607cd388-1ec9-5ecb-bbcc-d483e737cb20, identifier: MY48051
2026-03-28 18:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with identifier: MY48051
2026-03-28 18:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with identifier: MY48051
2026-03-28 18:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with identifier: MY48051 to the API
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-30T15:03:48Z',
 'fuel_type': 'diesel',
 'id': '607cd388-1ec9-5ecb-bbcc-d483e737cb20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY48051',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 111287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-14',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 300 d 4MATIC AVANTGARDE EDITION 19 lang',
 'transmission': 'automatic',
 'trim': '4MATIC AVANTGARDE EDITION 19 lang',
 'year': 2019}
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48051%27 HTTP/1.1" 200 None
2026-03-28 18:38:26 [auto1.de] INFO: Saving data for MY48051: {'auction_closing_time': 1774883028.0, 'created_time': 1774521425.753132, 'last_price_update_time': 1774723106.781459}
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY48051') HTTP/1.1" 204 0
2026-03-28 18:38:26 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14298%27 HTTP/1.1" 200 None
2026-03-28 18:38:26 [auto1.de] INFO: Scrape type for UC14298: 0
2026-03-28 18:38:26 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-28 18:38:26 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-28 18:38:26 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78048%27 HTTP/1.1" 200 None
2026-03-28 18:38:26 [auto1.de] INFO: Scrape type for FJ78048: 0
2026-03-28 18:38:26 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN41224%27 HTTP/1.1" 200 None
2026-03-28 18:38:26 [auto1.de] INFO: Scrape type for NN41224: 0
2026-03-28 18:38:26 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02201%27 HTTP/1.1" 200 None
2026-03-28 18:38:26 [auto1.de] INFO: Scrape type for FZ02201: 0
2026-03-28 18:38:26 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-28 18:38:26 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ76178%27 HTTP/1.1" 200 None
2026-03-28 18:38:26 [auto1.de] INFO: Scrape type for DJ76178: 0
2026-03-28 18:38:26 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42354%27 HTTP/1.1" 200 None
2026-03-28 18:38:26 [auto1.de] INFO: Scrape type for BZ42354: 2
2026-03-28 18:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80d1dcea-8cb9-5771-b10e-2bd298219f4c with identifier: BZ42354
2026-03-28 18:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d1dcea-8cb9-5771-b10e-2bd298219f4c with scrape type 2
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80d1dcea-8cb9-5771-b10e-2bd298219f4c with scrape type 2
2026-03-28 18:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80d1dcea-8cb9-5771-b10e-2bd298219f4c, identifier: BZ42354
2026-03-28 18:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80d1dcea-8cb9-5771-b10e-2bd298219f4c with identifier: BZ42354
2026-03-28 18:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80d1dcea-8cb9-5771-b10e-2bd298219f4c with identifier: BZ42354
2026-03-28 18:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80d1dcea-8cb9-5771-b10e-2bd298219f4c with identifier: BZ42354 to the API
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:43:09Z',
 'fuel_type': 'diesel',
 'id': '80d1dcea-8cb9-5771-b10e-2bd298219f4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ42354',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Cross Tourer',
 'odometer': 397870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-26',
 'seller_name': None,
 'title': 'Citroen C5 Cross Tourer 2.2 HDi',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42354%27 HTTP/1.1" 200 None
2026-03-28 18:38:27 [auto1.de] INFO: Saving data for BZ42354: {'auction_closing_time': 1774885389.0, 'created_time': 1773831209.503042, 'last_price_update_time': 1774723107.305306}
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ42354') HTTP/1.1" 204 0
2026-03-28 18:38:27 [auto1.de] INFO: Found listing with ID: US46384
2026-03-28 18:38:27 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03726%27 HTTP/1.1" 200 None
2026-03-28 18:38:27 [auto1.de] INFO: Scrape type for JB03726: 0
2026-03-28 18:38:27 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL79145%27 HTTP/1.1" 200 None
2026-03-28 18:38:27 [auto1.de] INFO: Scrape type for EL79145: 0
2026-03-28 18:38:27 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU11267%27 HTTP/1.1" 200 None
2026-03-28 18:38:27 [auto1.de] INFO: Scrape type for PU11267: 2
2026-03-28 18:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8caa3d6-751b-547e-91dd-070393e16382 with identifier: PU11267
2026-03-28 18:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8caa3d6-751b-547e-91dd-070393e16382 with scrape type 2
2026-03-28 18:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8caa3d6-751b-547e-91dd-070393e16382 with scrape type 2
2026-03-28 18:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8caa3d6-751b-547e-91dd-070393e16382, identifier: PU11267
2026-03-28 18:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8caa3d6-751b-547e-91dd-070393e16382 with identifier: PU11267
2026-03-28 18:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8caa3d6-751b-547e-91dd-070393e16382 with identifier: PU11267
2026-03-28 18:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8caa3d6-751b-547e-91dd-070393e16382 with identifier: PU11267 to the API
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:42:35Z',
 'fuel_type': 'petrol',
 'id': 'd8caa3d6-751b-547e-91dd-070393e16382',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU11267',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 37127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-03',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2019}
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU11267%27 HTTP/1.1" 200 None
2026-03-28 18:38:27 [auto1.de] INFO: Saving data for PU11267: {'auction_closing_time': 1774885355.0, 'created_time': 1774521870.657776, 'last_price_update_time': 1774723107.772435}
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU11267') HTTP/1.1" 204 0
2026-03-28 18:38:27 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59883%27 HTTP/1.1" 200 None
2026-03-28 18:38:27 [auto1.de] INFO: Scrape type for UA59883: 0
2026-03-28 18:38:27 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-28 18:38:27 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-28 18:38:27 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-28 18:38:27 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM22108%27 HTTP/1.1" 200 None
2026-03-28 18:38:27 [auto1.de] INFO: Scrape type for AM22108: 0
2026-03-28 18:38:27 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-28 18:38:27 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU95957%27 HTTP/1.1" 200 None
2026-03-28 18:38:27 [auto1.de] INFO: Scrape type for FU95957: 0
2026-03-28 18:38:27 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG88480%27 HTTP/1.1" 200 None
2026-03-28 18:38:27 [auto1.de] INFO: Scrape type for AG88480: 0
2026-03-28 18:38:27 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-28 18:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK13927> (referer: https://www.auto1.com/v1/car-details-view/EK13927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb282563-d73a-54cf-bbf3-3184ba59ade6 with identifier: EK13927
2026-03-28 18:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb282563-d73a-54cf-bbf3-3184ba59ade6 with scrape type 1
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb282563-d73a-54cf-bbf3-3184ba59ade6
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F75%252F5b75f0f7aede9bc889a685e0c7983e3e%252Fpa%252FEK13927_d181ba001c43e52c4b538ce08f831296.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_d181ba001c43e52c4b538ce08f831296.jpg already downloaded
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F75%252F5b75f0f7aede9bc889a685e0c7983e3e%252Fpa%252FEK13927_7ba6410835a22549e87afb2cfe01fbc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_7ba6410835a22549e87afb2cfe01fbc7.jpg already downloaded
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F75%252F5b75f0f7aede9bc889a685e0c7983e3e%252Fpa%252FEK13927_9321ec300220de2f35d0cf1d940d1387.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_9321ec300220de2f35d0cf1d940d1387.jpg already downloaded
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F75%252F5b75f0f7aede9bc889a685e0c7983e3e%252Fpa%252FEK13927_44be17d898b019d9413a92d56273dd1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_44be17d898b019d9413a92d56273dd1a.jpg already downloaded
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F75%252F5b75f0f7aede9bc889a685e0c7983e3e%252Fpa%252FEK13927_5049da9129baebcafcf4d2198624bc6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_5049da9129baebcafcf4d2198624bc6f.jpg already downloaded
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F75%252F5b75f0f7aede9bc889a685e0c7983e3e%252Fpa%252FEK13927_bf8c76ef9255e1675f2e88b33915e337.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_bf8c76ef9255e1675f2e88b33915e337.jpg already downloaded
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F75%252F5b75f0f7aede9bc889a685e0c7983e3e%252Fpa%252FEK13927_c9cd0905ad47cae0eb54afefc176ed00.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_c9cd0905ad47cae0eb54afefc176ed00.jpg already downloaded
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F75%252F5b75f0f7aede9bc889a685e0c7983e3e%252Fpa%252FEK13927_b7db7f46fa62f11dec533170f021cd86.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_b7db7f46fa62f11dec533170f021cd86.jpg already downloaded
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F75%252F5b75f0f7aede9bc889a685e0c7983e3e%252Fpa%252FEK13927_032e8e46fa4c1a66e0e33f85d2c0348b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_032e8e46fa4c1a66e0e33f85d2c0348b.jpg already downloaded
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F75%252F5b75f0f7aede9bc889a685e0c7983e3e%252Fpa%252FEK13927_487b531bd21bbd4a7b99107093eefe17.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_487b531bd21bbd4a7b99107093eefe17.jpg already downloaded
2026-03-28 18:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb282563-d73a-54cf-bbf3-3184ba59ade6, identifier: EK13927
2026-03-28 18:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb282563-d73a-54cf-bbf3-3184ba59ade6 with identifier: EK13927
2026-03-28 18:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb282563-d73a-54cf-bbf3-3184ba59ade6 with identifier: EK13927
2026-03-28 18:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb282563-d73a-54cf-bbf3-3184ba59ade6 with identifier: EK13927 to the API
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EK13927>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:49:36Z',
 'fuel_type': 'petrol',
 'id': 'bb282563-d73a-54cf-bbf3-3184ba59ade6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK13927',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 267645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_d181ba001c43e52c4b538ce08f831296.jpg',
                'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_7ba6410835a22549e87afb2cfe01fbc7.jpg',
                'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_9321ec300220de2f35d0cf1d940d1387.jpg',
                'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_44be17d898b019d9413a92d56273dd1a.jpg',
                'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_5049da9129baebcafcf4d2198624bc6f.jpg',
                'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_bf8c76ef9255e1675f2e88b33915e337.jpg',
                'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_c9cd0905ad47cae0eb54afefc176ed00.jpg',
                'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_b7db7f46fa62f11dec533170f021cd86.jpg',
                'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_032e8e46fa4c1a66e0e33f85d2c0348b.jpg',
                'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_487b531bd21bbd4a7b99107093eefe17.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_d181ba001c43e52c4b538ce08f831296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_7ba6410835a22549e87afb2cfe01fbc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 971634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_9321ec300220de2f35d0cf1d940d1387.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1004232,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_44be17d898b019d9413a92d56273dd1a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1230725,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_5049da9129baebcafcf4d2198624bc6f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_bf8c76ef9255e1675f2e88b33915e337.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 873345,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_c9cd0905ad47cae0eb54afefc176ed00.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_b7db7f46fa62f11dec533170f021cd86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_032e8e46fa4c1a66e0e33f85d2c0348b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb282563-d73a-54cf-bbf3-3184ba59ade6/bb282563-d73a-54cf-bbf3-3184ba59ade6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/75/5b75f0f7aede9bc889a685e0c7983e3e/pa/EK13927_487b531bd21bbd4a7b99107093eefe17.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK13927%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [auto1.de] INFO: Saving data for EK13927: {'created_time': 1774723108.743238, 'last_price_update_time': 1774723108.743253, 'auction_closing_time': 1774885776.0}
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK13927') HTTP/1.1" 204 0
2026-03-28 18:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:28 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:28 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-28 18:38:28 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-28 18:38:28 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV40802%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [auto1.de] INFO: Scrape type for AV40802: 2
2026-03-28 18:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f1e5439-69a0-583a-ab1a-f64ba770b286 with identifier: AV40802
2026-03-28 18:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f1e5439-69a0-583a-ab1a-f64ba770b286 with scrape type 2
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f1e5439-69a0-583a-ab1a-f64ba770b286 with scrape type 2
2026-03-28 18:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f1e5439-69a0-583a-ab1a-f64ba770b286, identifier: AV40802
2026-03-28 18:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f1e5439-69a0-583a-ab1a-f64ba770b286 with identifier: AV40802
2026-03-28 18:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f1e5439-69a0-583a-ab1a-f64ba770b286 with identifier: AV40802
2026-03-28 18:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f1e5439-69a0-583a-ab1a-f64ba770b286 with identifier: AV40802 to the API
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:06:57Z',
 'fuel_type': 'diesel',
 'id': '4f1e5439-69a0-583a-ab1a-f64ba770b286',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV40802',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 191544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2015}
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV40802%27 HTTP/1.1" 200 None
2026-03-28 18:38:29 [auto1.de] INFO: Saving data for AV40802: {'auction_closing_time': 1774883217.0, 'created_time': 1774003057.35564, 'last_price_update_time': 1774723109.325127}
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV40802') HTTP/1.1" 204 0
2026-03-28 18:38:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:29 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU33293%27 HTTP/1.1" 200 None
2026-03-28 18:38:29 [auto1.de] INFO: Scrape type for EU33293: 0
2026-03-28 18:38:29 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY72609%27 HTTP/1.1" 200 None
2026-03-28 18:38:29 [auto1.de] INFO: Scrape type for DY72609: 0
2026-03-28 18:38:29 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB14997%27 HTTP/1.1" 200 None
2026-03-28 18:38:29 [auto1.de] INFO: Scrape type for BB14997: 0
2026-03-28 18:38:29 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-28 18:38:29 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-28 18:38:29 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-28 18:38:29 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-28 18:38:29 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-28 18:38:29 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-28 18:38:29 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-28 18:38:29 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA15787%27 HTTP/1.1" 200 None
2026-03-28 18:38:29 [auto1.de] INFO: Scrape type for XA15787: 2
2026-03-28 18:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e078c114-4301-5eca-8554-b012db12e2ee with identifier: XA15787
2026-03-28 18:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e078c114-4301-5eca-8554-b012db12e2ee with scrape type 2
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e078c114-4301-5eca-8554-b012db12e2ee with scrape type 2
2026-03-28 18:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e078c114-4301-5eca-8554-b012db12e2ee, identifier: XA15787
2026-03-28 18:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e078c114-4301-5eca-8554-b012db12e2ee with identifier: XA15787
2026-03-28 18:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e078c114-4301-5eca-8554-b012db12e2ee with identifier: XA15787
2026-03-28 18:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e078c114-4301-5eca-8554-b012db12e2ee with identifier: XA15787 to the API
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:42:12Z',
 'fuel_type': 'diesel',
 'id': 'e078c114-4301-5eca-8554-b012db12e2ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA15787',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 244780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-15',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA15787%27 HTTP/1.1" 200 None
2026-03-28 18:38:29 [auto1.de] INFO: Saving data for XA15787: {'auction_closing_time': 1774885332.0, 'created_time': 1773428740.461163, 'last_price_update_time': 1774723109.943729}
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA15787') HTTP/1.1" 204 0
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF39586%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Scrape type for FF39586: 2
2026-03-28 18:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e60c8e2-9151-5dde-8e0e-10f649360f5f with identifier: FF39586
2026-03-28 18:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e60c8e2-9151-5dde-8e0e-10f649360f5f with scrape type 2
2026-03-28 18:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e60c8e2-9151-5dde-8e0e-10f649360f5f with scrape type 2
2026-03-28 18:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e60c8e2-9151-5dde-8e0e-10f649360f5f, identifier: FF39586
2026-03-28 18:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e60c8e2-9151-5dde-8e0e-10f649360f5f with identifier: FF39586
2026-03-28 18:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e60c8e2-9151-5dde-8e0e-10f649360f5f with identifier: FF39586
2026-03-28 18:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e60c8e2-9151-5dde-8e0e-10f649360f5f with identifier: FF39586 to the API
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:25:58Z',
 'fuel_type': 'diesel',
 'id': '3e60c8e2-9151-5dde-8e0e-10f649360f5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF39586',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 180689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-11',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF39586%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Saving data for FF39586: {'auction_closing_time': 1774884358.0, 'created_time': 1773301779.583936, 'last_price_update_time': 1774723110.500174}
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF39586') HTTP/1.1" 204 0
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG61391%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Scrape type for RG61391: 0
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: US51436
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG58500%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Scrape type for XG58500: 0
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG49368%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Scrape type for PG49368: 0
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47615%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Scrape type for EJ47615: 0
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA77354%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Scrape type for PA77354: 0
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT59305%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Scrape type for UT59305: 0
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: FP14792
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP14792%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Scrape type for FP14792: 0
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM67977%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Scrape type for KM67977: 0
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB02361%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Scrape type for YB02361: 0
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG96137%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Scrape type for PG96137: 0
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ39363%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Scrape type for TJ39363: 0
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-28 18:38:30 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL13857%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Scrape type for XL13857: 2
2026-03-28 18:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with identifier: XL13857
2026-03-28 18:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with scrape type 2
2026-03-28 18:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with scrape type 2
2026-03-28 18:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2, identifier: XL13857
2026-03-28 18:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with identifier: XL13857
2026-03-28 18:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with identifier: XL13857
2026-03-28 18:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with identifier: XL13857 to the API
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:22:52Z',
 'fuel_type': 'petrol',
 'id': 'f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL13857',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 25693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-03',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL13857%27 HTTP/1.1" 200 None
2026-03-28 18:38:31 [auto1.de] INFO: Saving data for XL13857: {'auction_closing_time': 1774884172.0, 'created_time': 1774521563.494481, 'last_price_update_time': 1774723111.308698}
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL13857') HTTP/1.1" 204 0
2026-03-28 18:38:31 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-28 18:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:32 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN86617%27 HTTP/1.1" 200 None
2026-03-28 18:38:32 [auto1.de] INFO: Scrape type for PN86617: 0
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45710%27 HTTP/1.1" 200 None
2026-03-28 18:38:32 [auto1.de] INFO: Scrape type for NY45710: 0
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG32866%27 HTTP/1.1" 200 None
2026-03-28 18:38:32 [auto1.de] INFO: Scrape type for MG32866: 0
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA43321%27 HTTP/1.1" 200 None
2026-03-28 18:38:32 [auto1.de] INFO: Scrape type for BA43321: 0
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK83629%27 HTTP/1.1" 200 None
2026-03-28 18:38:32 [auto1.de] INFO: Scrape type for BK83629: 0
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX49945%27 HTTP/1.1" 200 None
2026-03-28 18:38:32 [auto1.de] INFO: Scrape type for RX49945: 0
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW06930%27 HTTP/1.1" 200 None
2026-03-28 18:38:32 [auto1.de] INFO: Scrape type for EW06930: 0
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH67751%27 HTTP/1.1" 200 None
2026-03-28 18:38:32 [auto1.de] INFO: Scrape type for LH67751: 0
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS61714%27 HTTP/1.1" 200 None
2026-03-28 18:38:32 [auto1.de] INFO: Scrape type for TS61714: 0
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: FJ40863
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-28 18:38:32 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27909%27 HTTP/1.1" 200 None
2026-03-28 18:38:32 [auto1.de] INFO: Scrape type for BG27909: 2
2026-03-28 18:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c9d574-5ffb-5619-8435-005227d17693 with identifier: BG27909
2026-03-28 18:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c9d574-5ffb-5619-8435-005227d17693 with scrape type 2
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c9d574-5ffb-5619-8435-005227d17693 with scrape type 2
2026-03-28 18:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36c9d574-5ffb-5619-8435-005227d17693, identifier: BG27909
2026-03-28 18:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36c9d574-5ffb-5619-8435-005227d17693 with identifier: BG27909
2026-03-28 18:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36c9d574-5ffb-5619-8435-005227d17693 with identifier: BG27909
2026-03-28 18:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36c9d574-5ffb-5619-8435-005227d17693 with identifier: BG27909 to the API
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:08:04Z',
 'fuel_type': 'petrol',
 'id': '36c9d574-5ffb-5619-8435-005227d17693',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG27909',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 39519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-23',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Sport Edition',
 'transmission': 'manual',
 'trim': 'Sport Edition',
 'year': 2005}
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27909%27 HTTP/1.1" 200 None
2026-03-28 18:38:32 [auto1.de] INFO: Saving data for BG27909: {'auction_closing_time': 1774883284.0, 'created_time': 1774521951.273152, 'last_price_update_time': 1774723112.892721}
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG27909') HTTP/1.1" 204 0
2026-03-28 18:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54532%27 HTTP/1.1" 200 None
2026-03-28 18:38:33 [auto1.de] INFO: Scrape type for HY54532: 0
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC84828%27 HTTP/1.1" 200 None
2026-03-28 18:38:33 [auto1.de] INFO: Scrape type for GC84828: 0
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB04104%27 HTTP/1.1" 200 None
2026-03-28 18:38:33 [auto1.de] INFO: Scrape type for SB04104: 0
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY33433%27 HTTP/1.1" 200 None
2026-03-28 18:38:33 [auto1.de] INFO: Scrape type for AY33433: 0
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65486%27 HTTP/1.1" 200 None
2026-03-28 18:38:33 [auto1.de] INFO: Scrape type for AH65486: 2
2026-03-28 18:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcae66b3-402f-5baa-b5b9-f5dea7b03047 with identifier: AH65486
2026-03-28 18:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcae66b3-402f-5baa-b5b9-f5dea7b03047 with scrape type 2
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcae66b3-402f-5baa-b5b9-f5dea7b03047 with scrape type 2
2026-03-28 18:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bcae66b3-402f-5baa-b5b9-f5dea7b03047, identifier: AH65486
2026-03-28 18:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bcae66b3-402f-5baa-b5b9-f5dea7b03047 with identifier: AH65486
2026-03-28 18:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bcae66b3-402f-5baa-b5b9-f5dea7b03047 with identifier: AH65486
2026-03-28 18:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bcae66b3-402f-5baa-b5b9-f5dea7b03047 with identifier: AH65486 to the API
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 335,
 'expiration_date': '2026-03-30T15:49:03Z',
 'fuel_type': 'petrol',
 'id': 'bcae66b3-402f-5baa-b5b9-f5dea7b03047',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH65486',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Phaeton',
 'odometer': 148377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-16',
 'seller_name': None,
 'title': 'Volkswagen Phaeton 4.2 V8 4Motion',
 'transmission': 'automatic',
 'trim': '4Motion',
 'year': 2009}
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65486%27 HTTP/1.1" 200 None
2026-03-28 18:38:33 [auto1.de] INFO: Saving data for AH65486: {'auction_closing_time': 1774885743.0, 'created_time': 1774522095.997701, 'last_price_update_time': 1774723113.538412}
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH65486') HTTP/1.1" 204 0
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH69826%27 HTTP/1.1" 200 None
2026-03-28 18:38:33 [auto1.de] INFO: Scrape type for MH69826: 0
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39197%27 HTTP/1.1" 200 None
2026-03-28 18:38:33 [auto1.de] INFO: Scrape type for TC39197: 0
2026-03-28 18:38:33 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU27466%27 HTTP/1.1" 200 None
2026-03-28 18:38:33 [auto1.de] INFO: Scrape type for EU27466: 2
2026-03-28 18:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with identifier: EU27466
2026-03-28 18:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with scrape type 2
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with scrape type 2
2026-03-28 18:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7, identifier: EU27466
2026-03-28 18:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with identifier: EU27466
2026-03-28 18:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with identifier: EU27466
2026-03-28 18:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with identifier: EU27466 to the API
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:37:47Z',
 'fuel_type': 'petrol',
 'id': 'ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU27466',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf III',
 'odometer': 192141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1995-03-20',
 'seller_name': None,
 'title': 'Volkswagen Golf III 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 1995}
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU27466%27 HTTP/1.1" 200 None
2026-03-28 18:38:34 [auto1.de] INFO: Saving data for EU27466: {'auction_closing_time': 1774885067.0, 'created_time': 1774522125.880616, 'last_price_update_time': 1774723114.131709}
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU27466') HTTP/1.1" 204 0
2026-03-28 18:38:34 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-28 18:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:35 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR48762%27 HTTP/1.1" 200 None
2026-03-28 18:38:35 [auto1.de] INFO: Scrape type for ZR48762: 0
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: HU76899
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC43890%27 HTTP/1.1" 200 None
2026-03-28 18:38:35 [auto1.de] INFO: Scrape type for BC43890: 0
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC98509%27 HTTP/1.1" 200 None
2026-03-28 18:38:35 [auto1.de] INFO: Scrape type for KC98509: 0
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ70756%27 HTTP/1.1" 200 None
2026-03-28 18:38:35 [auto1.de] INFO: Scrape type for DZ70756: 0
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: ZY67532
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67532%27 HTTP/1.1" 200 None
2026-03-28 18:38:35 [auto1.de] INFO: Scrape type for ZY67532: 1
2026-03-28 18:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY30353%27 HTTP/1.1" 200 None
2026-03-28 18:38:35 [auto1.de] INFO: Scrape type for FY30353: 0
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR55651%27 HTTP/1.1" 200 None
2026-03-28 18:38:35 [auto1.de] INFO: Scrape type for WR55651: 0
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN84486%27 HTTP/1.1" 200 None
2026-03-28 18:38:35 [auto1.de] INFO: Scrape type for RN84486: 2
2026-03-28 18:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a72d3156-6b82-5078-99f6-76c8850b5177 with identifier: RN84486
2026-03-28 18:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72d3156-6b82-5078-99f6-76c8850b5177 with scrape type 2
2026-03-28 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a72d3156-6b82-5078-99f6-76c8850b5177 with scrape type 2
2026-03-28 18:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a72d3156-6b82-5078-99f6-76c8850b5177, identifier: RN84486
2026-03-28 18:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a72d3156-6b82-5078-99f6-76c8850b5177 with identifier: RN84486
2026-03-28 18:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a72d3156-6b82-5078-99f6-76c8850b5177 with identifier: RN84486
2026-03-28 18:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a72d3156-6b82-5078-99f6-76c8850b5177 with identifier: RN84486 to the API
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:32:23Z',
 'fuel_type': 'petrol',
 'id': 'a72d3156-6b82-5078-99f6-76c8850b5177',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN84486',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 200666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-30',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2011}
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN84486%27 HTTP/1.1" 200 None
2026-03-28 18:38:35 [auto1.de] INFO: Saving data for RN84486: {'auction_closing_time': 1774884743.0, 'created_time': 1774522092.095282, 'last_price_update_time': 1774723115.835896}
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN84486') HTTP/1.1" 204 0
2026-03-28 18:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB23649%27 HTTP/1.1" 200 None
2026-03-28 18:38:35 [auto1.de] INFO: Scrape type for EB23649: 0
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS83474%27 HTTP/1.1" 200 None
2026-03-28 18:38:35 [auto1.de] INFO: Scrape type for BS83474: 0
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ64082%27 HTTP/1.1" 200 None
2026-03-28 18:38:35 [auto1.de] INFO: Scrape type for PZ64082: 0
2026-03-28 18:38:35 [auto1.de] INFO: Found listing with ID: RU04475
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU04475%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [auto1.de] INFO: Scrape type for RU04475: 2
2026-03-28 18:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e9009d8-ebe1-5290-b2d9-b027517667e6 with identifier: RU04475
2026-03-28 18:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e9009d8-ebe1-5290-b2d9-b027517667e6 with scrape type 2
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e9009d8-ebe1-5290-b2d9-b027517667e6 with scrape type 2
2026-03-28 18:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e9009d8-ebe1-5290-b2d9-b027517667e6, identifier: RU04475
2026-03-28 18:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e9009d8-ebe1-5290-b2d9-b027517667e6 with identifier: RU04475
2026-03-28 18:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e9009d8-ebe1-5290-b2d9-b027517667e6 with identifier: RU04475
2026-03-28 18:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e9009d8-ebe1-5290-b2d9-b027517667e6 with identifier: RU04475 to the API
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:00:58Z',
 'fuel_type': 'diesel',
 'id': '4e9009d8-ebe1-5290-b2d9-b027517667e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU04475',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 113428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2020}
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU04475%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [auto1.de] INFO: Saving data for RU04475: {'auction_closing_time': 1774882858.0, 'created_time': 1773400305.730523, 'last_price_update_time': 1774723116.449785}
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU04475') HTTP/1.1" 204 0
2026-03-28 18:38:36 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46932%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [auto1.de] INFO: Scrape type for CM46932: 0
2026-03-28 18:38:36 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU99321%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [auto1.de] INFO: Scrape type for YU99321: 0
2026-03-28 18:38:36 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-28 18:38:36 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-28 18:38:36 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS30478%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [auto1.de] INFO: Scrape type for BS30478: 0
2026-03-28 18:38:36 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-28 18:38:36 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR11096%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [auto1.de] INFO: Scrape type for GR11096: 0
2026-03-28 18:38:36 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-28 18:38:36 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS98384%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [auto1.de] INFO: Scrape type for VS98384: 0
2026-03-28 18:38:36 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-28 18:38:36 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69696%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [auto1.de] INFO: Scrape type for BP69696: 2
2026-03-28 18:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with identifier: BP69696
2026-03-28 18:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with scrape type 2
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with scrape type 2
2026-03-28 18:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b, identifier: BP69696
2026-03-28 18:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with identifier: BP69696
2026-03-28 18:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with identifier: BP69696
2026-03-28 18:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with identifier: BP69696 to the API
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:14:16Z',
 'fuel_type': 'petrol',
 'id': '0b59145b-d2ac-5292-8f2e-a1f9dd99288b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP69696',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 79789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69696%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [auto1.de] INFO: Saving data for BP69696: {'auction_closing_time': 1774883656.0, 'created_time': 1774521623.259345, 'last_price_update_time': 1774723116.994203}
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP69696') HTTP/1.1" 204 0
2026-03-28 18:38:37 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43090%27 HTTP/1.1" 200 None
2026-03-28 18:38:37 [auto1.de] INFO: Scrape type for UZ43090: 2
2026-03-28 18:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c8ad5bf-a3da-5911-aecd-b55272431f49 with identifier: UZ43090
2026-03-28 18:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c8ad5bf-a3da-5911-aecd-b55272431f49 with scrape type 2
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c8ad5bf-a3da-5911-aecd-b55272431f49 with scrape type 2
2026-03-28 18:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c8ad5bf-a3da-5911-aecd-b55272431f49, identifier: UZ43090
2026-03-28 18:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c8ad5bf-a3da-5911-aecd-b55272431f49 with identifier: UZ43090
2026-03-28 18:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c8ad5bf-a3da-5911-aecd-b55272431f49 with identifier: UZ43090
2026-03-28 18:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c8ad5bf-a3da-5911-aecd-b55272431f49 with identifier: UZ43090 to the API
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:14:42Z',
 'fuel_type': 'petrol',
 'id': '9c8ad5bf-a3da-5911-aecd-b55272431f49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ43090',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 131865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-26',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43090%27 HTTP/1.1" 200 None
2026-03-28 18:38:37 [auto1.de] INFO: Saving data for UZ43090: {'auction_closing_time': 1774883682.0, 'created_time': 1773383043.548498, 'last_price_update_time': 1774723117.528919}
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ43090') HTTP/1.1" 204 0
2026-03-28 18:38:37 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW30512%27 HTTP/1.1" 200 None
2026-03-28 18:38:37 [auto1.de] INFO: Scrape type for LW30512: 2
2026-03-28 18:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with identifier: LW30512
2026-03-28 18:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with scrape type 2
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with scrape type 2
2026-03-28 18:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b, identifier: LW30512
2026-03-28 18:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with identifier: LW30512
2026-03-28 18:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with identifier: LW30512
2026-03-28 18:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with identifier: LW30512 to the API
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:47:52Z',
 'fuel_type': 'diesel',
 'id': '0608d3a7-1169-5bf8-9ee0-2aecb643c36b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW30512',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 92994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-05',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.5 Blue-HDi M',
 'transmission': 'manual',
 'trim': 'M',
 'year': 2019}
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW30512%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Saving data for LW30512: {'auction_closing_time': 1774885672.0, 'created_time': 1774521932.563648, 'last_price_update_time': 1774723118.029131}
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW30512') HTTP/1.1" 204 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH30601%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for CH30601: 2
2026-03-28 18:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4c7b747-a3d1-527e-925e-df44f2b3fb23 with identifier: CH30601
2026-03-28 18:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4c7b747-a3d1-527e-925e-df44f2b3fb23 with scrape type 2
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4c7b747-a3d1-527e-925e-df44f2b3fb23 with scrape type 2
2026-03-28 18:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4c7b747-a3d1-527e-925e-df44f2b3fb23, identifier: CH30601
2026-03-28 18:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4c7b747-a3d1-527e-925e-df44f2b3fb23 with identifier: CH30601
2026-03-28 18:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4c7b747-a3d1-527e-925e-df44f2b3fb23 with identifier: CH30601
2026-03-28 18:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4c7b747-a3d1-527e-925e-df44f2b3fb23 with identifier: CH30601 to the API
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:17:11Z',
 'fuel_type': 'petrol',
 'id': 'a4c7b747-a3d1-527e-925e-df44f2b3fb23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH30601',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 144756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-08',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH30601%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Saving data for CH30601: {'auction_closing_time': 1774883831.0, 'created_time': 1774636635.286033, 'last_price_update_time': 1774723118.463387}
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH30601') HTTP/1.1" 204 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27132%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for GB27132: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:38 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD70727%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for ZD70727: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR98479%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for JR98479: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW15562%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for RW15562: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78889%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for RX78889: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB42809%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for FB42809: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV32823%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for AV32823: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU34060%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for WU34060: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT59111%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for MT59111: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD28346%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for DD28346: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12990%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for YT12990: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14305%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for VX14305: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV33102%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for HV33102: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV00892%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for NV00892: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15565%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for VZ15565: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV84531%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for CV84531: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: YU69669
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF17826%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for UF17826: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS44353%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for ZS44353: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY07029%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for ZY07029: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD89320%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for XD89320: 0
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-28 18:38:38 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA52388%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [auto1.de] INFO: Scrape type for XA52388: 2
2026-03-28 18:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c730986c-403f-50a4-a5fc-c49eb0d394fb with identifier: XA52388
2026-03-28 18:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c730986c-403f-50a4-a5fc-c49eb0d394fb with scrape type 2
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c730986c-403f-50a4-a5fc-c49eb0d394fb with scrape type 2
2026-03-28 18:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c730986c-403f-50a4-a5fc-c49eb0d394fb, identifier: XA52388
2026-03-28 18:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c730986c-403f-50a4-a5fc-c49eb0d394fb with identifier: XA52388
2026-03-28 18:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c730986c-403f-50a4-a5fc-c49eb0d394fb with identifier: XA52388
2026-03-28 18:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c730986c-403f-50a4-a5fc-c49eb0d394fb with identifier: XA52388 to the API
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:56:31Z',
 'fuel_type': 'petrol',
 'id': 'c730986c-403f-50a4-a5fc-c49eb0d394fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA52388',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 90767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-20',
 'seller_name': None,
 'title': 'BMW X2 xDrive 20i M Sport X',
 'transmission': 'automatic',
 'trim': 'M Sport X',
 'year': 2018}
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA52388%27 HTTP/1.1" 200 None
2026-03-28 18:38:39 [auto1.de] INFO: Saving data for XA52388: {'auction_closing_time': 1774886191.0, 'created_time': 1773429443.888774, 'last_price_update_time': 1774723119.408032}
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA52388') HTTP/1.1" 204 0
2026-03-28 18:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:39 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZY67532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZY67532> (referer: https://www.auto1.com/v1/car-details-view/ZY67532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19508f6-a268-51f3-84a0-d184aab8965d with identifier: ZY67532
2026-03-28 18:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19508f6-a268-51f3-84a0-d184aab8965d with scrape type 1
2026-03-28 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b19508f6-a268-51f3-84a0-d184aab8965d
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F59%252F7b594cdf71b0119d793dd50290aedf73%252Fpa%252FZY67532_691441a9a9346448a863ad3d7061baa6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_691441a9a9346448a863ad3d7061baa6.jpg already downloaded
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F59%252F7b594cdf71b0119d793dd50290aedf73%252Fpa%252FZY67532_f4104c9282a8e02cd9ece4d1e509e3b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_f4104c9282a8e02cd9ece4d1e509e3b5.jpg already downloaded
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F59%252F7b594cdf71b0119d793dd50290aedf73%252Fpa%252FZY67532_e655aadf1a56d6553fa00b17ac96e0d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_e655aadf1a56d6553fa00b17ac96e0d1.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F59%252F7b594cdf71b0119d793dd50290aedf73%252Fpa%252FZY67532_e8dcda7c4b8a419454c97fb3533ac881.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_e8dcda7c4b8a419454c97fb3533ac881.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F59%252F7b594cdf71b0119d793dd50290aedf73%252Fpa%252FZY67532_8ca8eb685789b2d06761a6a63fe8022b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_8ca8eb685789b2d06761a6a63fe8022b.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F59%252F7b594cdf71b0119d793dd50290aedf73%252Fpa%252FZY67532_7bd8bc44258ee3a35fcab454dee6646f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_7bd8bc44258ee3a35fcab454dee6646f.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F59%252F7b594cdf71b0119d793dd50290aedf73%252Fpa%252FZY67532_4c333d4cf5b91ffadd5cfcfc55abbc48.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_4c333d4cf5b91ffadd5cfcfc55abbc48.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F59%252F7b594cdf71b0119d793dd50290aedf73%252Fpa%252FZY67532_3105c298f75ccdbfdc15b2937b2f726e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_3105c298f75ccdbfdc15b2937b2f726e.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F59%252F7b594cdf71b0119d793dd50290aedf73%252Fpa%252FZY67532_24b5f9e7ed7d72a92d4545b906b9dbcc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_24b5f9e7ed7d72a92d4545b906b9dbcc.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F59%252F7b594cdf71b0119d793dd50290aedf73%252Fpa%252FZY67532_c0b7137b485cd5c5a33e558c8c1669ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_c0b7137b485cd5c5a33e558c8c1669ac.jpg already downloaded
2026-03-28 18:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b19508f6-a268-51f3-84a0-d184aab8965d, identifier: ZY67532
2026-03-28 18:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b19508f6-a268-51f3-84a0-d184aab8965d with identifier: ZY67532
2026-03-28 18:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b19508f6-a268-51f3-84a0-d184aab8965d with identifier: ZY67532
2026-03-28 18:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b19508f6-a268-51f3-84a0-d184aab8965d with identifier: ZY67532 to the API
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZY67532>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:40:31Z',
 'fuel_type': 'diesel',
 'id': 'b19508f6-a268-51f3-84a0-d184aab8965d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY67532',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'BMW',
 'model': '5er',
 'odometer': 192370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_691441a9a9346448a863ad3d7061baa6.jpg',
                'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_f4104c9282a8e02cd9ece4d1e509e3b5.jpg',
                'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_e655aadf1a56d6553fa00b17ac96e0d1.jpg',
                'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_e8dcda7c4b8a419454c97fb3533ac881.jpg',
                'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_8ca8eb685789b2d06761a6a63fe8022b.jpg',
                'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_7bd8bc44258ee3a35fcab454dee6646f.jpg',
                'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_4c333d4cf5b91ffadd5cfcfc55abbc48.jpg',
                'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_3105c298f75ccdbfdc15b2937b2f726e.jpg',
                'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_24b5f9e7ed7d72a92d4545b906b9dbcc.jpg',
                'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_c0b7137b485cd5c5a33e558c8c1669ac.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19508f6-a268-51f3-84a0-d184aab8965d/b19508f6-a268-51f3-84a0-d184aab8965d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_691441a9a9346448a863ad3d7061baa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19508f6-a268-51f3-84a0-d184aab8965d/b19508f6-a268-51f3-84a0-d184aab8965d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_f4104c9282a8e02cd9ece4d1e509e3b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19508f6-a268-51f3-84a0-d184aab8965d/b19508f6-a268-51f3-84a0-d184aab8965d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_e655aadf1a56d6553fa00b17ac96e0d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19508f6-a268-51f3-84a0-d184aab8965d/b19508f6-a268-51f3-84a0-d184aab8965d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_e8dcda7c4b8a419454c97fb3533ac881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19508f6-a268-51f3-84a0-d184aab8965d/b19508f6-a268-51f3-84a0-d184aab8965d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_8ca8eb685789b2d06761a6a63fe8022b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19508f6-a268-51f3-84a0-d184aab8965d/b19508f6-a268-51f3-84a0-d184aab8965d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_7bd8bc44258ee3a35fcab454dee6646f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19508f6-a268-51f3-84a0-d184aab8965d/b19508f6-a268-51f3-84a0-d184aab8965d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_4c333d4cf5b91ffadd5cfcfc55abbc48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19508f6-a268-51f3-84a0-d184aab8965d/b19508f6-a268-51f3-84a0-d184aab8965d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_3105c298f75ccdbfdc15b2937b2f726e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19508f6-a268-51f3-84a0-d184aab8965d/b19508f6-a268-51f3-84a0-d184aab8965d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_24b5f9e7ed7d72a92d4545b906b9dbcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b19508f6-a268-51f3-84a0-d184aab8965d/b19508f6-a268-51f3-84a0-d184aab8965d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/59/7b594cdf71b0119d793dd50290aedf73/pa/ZY67532_c0b7137b485cd5c5a33e558c8c1669ac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 525d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2013}
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67532%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [auto1.de] INFO: Saving data for ZY67532: {'created_time': 1774723121.666072, 'last_price_update_time': 1774723121.666085, 'auction_closing_time': 1774885231.0}
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY67532') HTTP/1.1" 204 0
2026-03-28 18:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:56 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83953%27 HTTP/1.1" 200 None
2026-03-28 18:38:56 [auto1.de] INFO: Scrape type for KA83953: 2
2026-03-28 18:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e5a093-2934-5d5f-b48d-ce9d9510874d with identifier: KA83953
2026-03-28 18:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e5a093-2934-5d5f-b48d-ce9d9510874d with scrape type 2
2026-03-28 18:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41e5a093-2934-5d5f-b48d-ce9d9510874d with scrape type 2
2026-03-28 18:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41e5a093-2934-5d5f-b48d-ce9d9510874d, identifier: KA83953
2026-03-28 18:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41e5a093-2934-5d5f-b48d-ce9d9510874d with identifier: KA83953
2026-03-28 18:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41e5a093-2934-5d5f-b48d-ce9d9510874d with identifier: KA83953
2026-03-28 18:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41e5a093-2934-5d5f-b48d-ce9d9510874d with identifier: KA83953 to the API
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:59:08Z',
 'fuel_type': 'petrol',
 'id': '41e5a093-2934-5d5f-b48d-ce9d9510874d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA83953',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 226093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-18',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83953%27 HTTP/1.1" 200 None
2026-03-28 18:38:56 [auto1.de] INFO: Saving data for KA83953: {'auction_closing_time': 1774886348.0, 'created_time': 1773381403.085771, 'last_price_update_time': 1774723136.717537}
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA83953') HTTP/1.1" 204 0
2026-03-28 18:38:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB97805%27 HTTP/1.1" 200 None
2026-03-28 18:38:56 [auto1.de] INFO: Scrape type for NB97805: 0
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ60217%27 HTTP/1.1" 200 None
2026-03-28 18:38:56 [auto1.de] INFO: Scrape type for BZ60217: 0
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA38517%27 HTTP/1.1" 200 None
2026-03-28 18:38:56 [auto1.de] INFO: Scrape type for AA38517: 0
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN58071%27 HTTP/1.1" 200 None
2026-03-28 18:38:56 [auto1.de] INFO: Scrape type for LN58071: 2
2026-03-28 18:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a14ae77a-a810-5a6f-a38f-55123f125b3a with identifier: LN58071
2026-03-28 18:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a14ae77a-a810-5a6f-a38f-55123f125b3a with scrape type 2
2026-03-28 18:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a14ae77a-a810-5a6f-a38f-55123f125b3a with scrape type 2
2026-03-28 18:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a14ae77a-a810-5a6f-a38f-55123f125b3a, identifier: LN58071
2026-03-28 18:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a14ae77a-a810-5a6f-a38f-55123f125b3a with identifier: LN58071
2026-03-28 18:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a14ae77a-a810-5a6f-a38f-55123f125b3a with identifier: LN58071
2026-03-28 18:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a14ae77a-a810-5a6f-a38f-55123f125b3a with identifier: LN58071 to the API
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:29Z',
 'fuel_type': 'diesel',
 'id': 'a14ae77a-a810-5a6f-a38f-55123f125b3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN58071',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 132952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2022}
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN58071%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Saving data for LN58071: {'auction_closing_time': 1774885349.0, 'created_time': 1773381909.19982, 'last_price_update_time': 1774723137.202483}
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN58071') HTTP/1.1" 204 0
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD46064%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Scrape type for BD46064: 0
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54184%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Scrape type for JP54184: 0
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG89372%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Scrape type for NG89372: 0
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80903%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Scrape type for AW80903: 2
2026-03-28 18:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd with identifier: AW80903
2026-03-28 18:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd with scrape type 2
2026-03-28 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd with scrape type 2
2026-03-28 18:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd, identifier: AW80903
2026-03-28 18:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd with identifier: AW80903
2026-03-28 18:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd with identifier: AW80903
2026-03-28 18:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd with identifier: AW80903 to the API
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:13:59Z',
 'fuel_type': 'petrol',
 'id': '56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW80903',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 133979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-31',
 'seller_name': None,
 'title': 'Hyundai ix35 1.6 FIFA World Cup Edition 2WD',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition 2WD',
 'year': 2015}
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80903%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Saving data for AW80903: {'auction_closing_time': 1774883639.0, 'created_time': 1773380884.792966, 'last_price_update_time': 1774723137.842268}
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW80903') HTTP/1.1" 204 0
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB84476%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Scrape type for FB84476: 0
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ83010%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Scrape type for VZ83010: 0
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN54723%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [auto1.de] INFO: Scrape type for VN54723: 0
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98877%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [auto1.de] INFO: Scrape type for MC98877: 0
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH53597%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [auto1.de] INFO: Scrape type for NH53597: 2
2026-03-28 18:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with identifier: NH53597
2026-03-28 18:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with scrape type 2
2026-03-28 18:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with scrape type 2
2026-03-28 18:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f0b80de-9547-533f-a1a7-ce853cabc5d5, identifier: NH53597
2026-03-28 18:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with identifier: NH53597
2026-03-28 18:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with identifier: NH53597
2026-03-28 18:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with identifier: NH53597 to the API
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:58:29Z',
 'fuel_type': 'diesel',
 'id': '4f0b80de-9547-533f-a1a7-ce853cabc5d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH53597',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 155788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-01',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH53597%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [auto1.de] INFO: Saving data for NH53597: {'auction_closing_time': 1774886309.0, 'created_time': 1774521889.511364, 'last_price_update_time': 1774723138.461298}
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH53597') HTTP/1.1" 204 0
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK11382%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [auto1.de] INFO: Scrape type for CK11382: 0
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA91230%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [auto1.de] INFO: Scrape type for PA91230: 0
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM30220%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [auto1.de] INFO: Scrape type for KM30220: 0
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC93517%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [auto1.de] INFO: Scrape type for MC93517: 0
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-28 18:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:59 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:59 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP96455%27 HTTP/1.1" 200 None
2026-03-28 18:38:59 [auto1.de] INFO: Scrape type for EP96455: 2
2026-03-28 18:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dfc44eb-76c2-5650-aca6-4143c5f63da7 with identifier: EP96455
2026-03-28 18:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dfc44eb-76c2-5650-aca6-4143c5f63da7 with scrape type 2
2026-03-28 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dfc44eb-76c2-5650-aca6-4143c5f63da7 with scrape type 2
2026-03-28 18:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dfc44eb-76c2-5650-aca6-4143c5f63da7, identifier: EP96455
2026-03-28 18:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dfc44eb-76c2-5650-aca6-4143c5f63da7 with identifier: EP96455
2026-03-28 18:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dfc44eb-76c2-5650-aca6-4143c5f63da7 with identifier: EP96455
2026-03-28 18:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dfc44eb-76c2-5650-aca6-4143c5f63da7 with identifier: EP96455 to the API
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:43:39Z',
 'fuel_type': 'petrol',
 'id': '6dfc44eb-76c2-5650-aca6-4143c5f63da7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP96455',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 168141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP96455%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Saving data for EP96455: {'auction_closing_time': 1774885419.0, 'created_time': 1774033621.58239, 'last_price_update_time': 1774723140.152779}
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP96455') HTTP/1.1" 204 0
2026-03-28 18:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE80399%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for BE80399: 2
2026-03-28 18:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d641f77-047a-55f1-a7f1-71533fde03ad with identifier: BE80399
2026-03-28 18:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d641f77-047a-55f1-a7f1-71533fde03ad with scrape type 2
2026-03-28 18:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d641f77-047a-55f1-a7f1-71533fde03ad with scrape type 2
2026-03-28 18:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d641f77-047a-55f1-a7f1-71533fde03ad, identifier: BE80399
2026-03-28 18:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d641f77-047a-55f1-a7f1-71533fde03ad with identifier: BE80399
2026-03-28 18:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d641f77-047a-55f1-a7f1-71533fde03ad with identifier: BE80399
2026-03-28 18:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d641f77-047a-55f1-a7f1-71533fde03ad with identifier: BE80399 to the API
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:24:29Z',
 'fuel_type': 'petrol',
 'id': '0d641f77-047a-55f1-a7f1-71533fde03ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE80399',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 63237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-19',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Argento',
 'transmission': 'manual',
 'trim': 'Argento',
 'year': 2004}
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE80399%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Saving data for BE80399: {'auction_closing_time': 1774884269.0, 'created_time': 1774521607.137808, 'last_price_update_time': 1774723140.599868}
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE80399') HTTP/1.1" 204 0
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC65369%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for BC65369: 0
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS51325%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for VS51325: 0
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS74193%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for PS74193: 0
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM37211%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for CM37211: 0
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM68343%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for AM68343: 0
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM38981%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for SM38981: 0
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD52714%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for WD52714: 0
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE50334%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for JE50334: 0
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK10618%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for ZK10618: 0
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA26169%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for YA26169: 0
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN16480%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for XN16480: 0
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98723%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for NX98723: 2
2026-03-28 18:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd45d8f3-fc64-5cd6-856d-506911708464 with identifier: NX98723
2026-03-28 18:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd45d8f3-fc64-5cd6-856d-506911708464 with scrape type 2
2026-03-28 18:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd45d8f3-fc64-5cd6-856d-506911708464 with scrape type 2
2026-03-28 18:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd45d8f3-fc64-5cd6-856d-506911708464, identifier: NX98723
2026-03-28 18:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd45d8f3-fc64-5cd6-856d-506911708464 with identifier: NX98723
2026-03-28 18:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd45d8f3-fc64-5cd6-856d-506911708464 with identifier: NX98723
2026-03-28 18:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd45d8f3-fc64-5cd6-856d-506911708464 with identifier: NX98723 to the API
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:38Z',
 'fuel_type': 'diesel',
 'id': 'cd45d8f3-fc64-5cd6-856d-506911708464',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX98723',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 168500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-07',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98723%27 HTTP/1.1" 200 None
2026-03-28 18:39:01 [auto1.de] INFO: Saving data for NX98723: {'auction_closing_time': 1774883858.0, 'created_time': 1774522246.687834, 'last_price_update_time': 1774723141.35025}
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX98723') HTTP/1.1" 204 0
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY28868%27 HTTP/1.1" 200 None
2026-03-28 18:39:01 [auto1.de] INFO: Scrape type for VY28868: 0
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE97424%27 HTTP/1.1" 200 None
2026-03-28 18:39:01 [auto1.de] INFO: Scrape type for DE97424: 0
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD67065%27 HTTP/1.1" 200 None
2026-03-28 18:39:01 [auto1.de] INFO: Scrape type for CD67065: 0
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH58090%27 HTTP/1.1" 200 None
2026-03-28 18:39:01 [auto1.de] INFO: Scrape type for EH58090: 0
2026-03-28 18:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:02 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:02 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS59240%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [auto1.de] INFO: Scrape type for SS59240: 0
2026-03-28 18:39:02 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-28 18:39:02 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW78905%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [auto1.de] INFO: Scrape type for BW78905: 0
2026-03-28 18:39:02 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-28 18:39:02 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB25198%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [auto1.de] INFO: Scrape type for LB25198: 0
2026-03-28 18:39:02 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV93529%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [auto1.de] INFO: Scrape type for LV93529: 2
2026-03-28 18:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43184f3f-f371-5419-a62d-32e3bc25f1bb with identifier: LV93529
2026-03-28 18:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43184f3f-f371-5419-a62d-32e3bc25f1bb with scrape type 2
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43184f3f-f371-5419-a62d-32e3bc25f1bb with scrape type 2
2026-03-28 18:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43184f3f-f371-5419-a62d-32e3bc25f1bb, identifier: LV93529
2026-03-28 18:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43184f3f-f371-5419-a62d-32e3bc25f1bb with identifier: LV93529
2026-03-28 18:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43184f3f-f371-5419-a62d-32e3bc25f1bb with identifier: LV93529
2026-03-28 18:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43184f3f-f371-5419-a62d-32e3bc25f1bb with identifier: LV93529 to the API
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:14:59Z',
 'fuel_type': 'petrol',
 'id': '43184f3f-f371-5419-a62d-32e3bc25f1bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV93529',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLC-Klasse',
 'odometer': 44203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz SLC-Klasse SLC 300 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV93529%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Saving data for LV93529: {'auction_closing_time': 1774883699.0, 'created_time': 1774521671.36499, 'last_price_update_time': 1774723143.046745}
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV93529') HTTP/1.1" 204 0
2026-03-28 18:39:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK46158%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for LK46158: 0
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27450%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for FP27450: 0
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV26500%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for RV26500: 0
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN02562%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for DN02562: 0
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV01596%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for TV01596: 0
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ83975%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for TJ83975: 0
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU94182%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for SU94182: 0
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU97238%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for MU97238: 0
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA32054%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for NA32054: 2
2026-03-28 18:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60e04dfc-7764-5782-a9ef-362e87ea85dd with identifier: NA32054
2026-03-28 18:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60e04dfc-7764-5782-a9ef-362e87ea85dd with scrape type 2
2026-03-28 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60e04dfc-7764-5782-a9ef-362e87ea85dd with scrape type 2
2026-03-28 18:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60e04dfc-7764-5782-a9ef-362e87ea85dd, identifier: NA32054
2026-03-28 18:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60e04dfc-7764-5782-a9ef-362e87ea85dd with identifier: NA32054
2026-03-28 18:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60e04dfc-7764-5782-a9ef-362e87ea85dd with identifier: NA32054
2026-03-28 18:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60e04dfc-7764-5782-a9ef-362e87ea85dd with identifier: NA32054 to the API
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-30T15:40:37Z',
 'fuel_type': 'hybrid',
 'id': '60e04dfc-7764-5782-a9ef-362e87ea85dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA32054',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 172475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seller_name': None,
 'title': 'Audi A6 50 TFSIe quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2022}
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA32054%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Saving data for NA32054: {'auction_closing_time': 1774885237.0, 'created_time': 1773917501.72531, 'last_price_update_time': 1774723143.769819}
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA32054') HTTP/1.1" 204 0
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16103%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for YT16103: 0
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ70582%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for BJ70582: 0
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW51780%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for DW51780: 0
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB08013%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for JB08013: 0
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC05500%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for HC05500: 2
2026-03-28 18:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee with identifier: HC05500
2026-03-28 18:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee with scrape type 2
2026-03-28 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee with scrape type 2
2026-03-28 18:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee, identifier: HC05500
2026-03-28 18:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee with identifier: HC05500
2026-03-28 18:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee with identifier: HC05500
2026-03-28 18:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee with identifier: HC05500 to the API
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:59:59Z',
 'fuel_type': 'diesel',
 'id': '91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC05500',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 136556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-27',
 'seller_name': None,
 'title': 'BMW 5er 520d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2017}
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC05500%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [auto1.de] INFO: Saving data for HC05500: {'auction_closing_time': 1774886399.0, 'created_time': 1773831130.041469, 'last_price_update_time': 1774723144.412652}
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC05500') HTTP/1.1" 204 0
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC44114%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [auto1.de] INFO: Scrape type for RC44114: 0
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE57502%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [auto1.de] INFO: Scrape type for AE57502: 0
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: KE06488
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE06488%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [auto1.de] INFO: Scrape type for KE06488: 1
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA86041%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [auto1.de] INFO: Scrape type for GA86041: 0
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU61840%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [auto1.de] INFO: Scrape type for SU61840: 0
2026-03-28 18:39:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:05 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:05 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-28 18:39:05 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY91581%27 HTTP/1.1" 200 None
2026-03-28 18:39:05 [auto1.de] INFO: Scrape type for BY91581: 2
2026-03-28 18:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec98b7a0-9502-5daf-9c00-2836f3add16a with identifier: BY91581
2026-03-28 18:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec98b7a0-9502-5daf-9c00-2836f3add16a with scrape type 2
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec98b7a0-9502-5daf-9c00-2836f3add16a with scrape type 2
2026-03-28 18:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec98b7a0-9502-5daf-9c00-2836f3add16a, identifier: BY91581
2026-03-28 18:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec98b7a0-9502-5daf-9c00-2836f3add16a with identifier: BY91581
2026-03-28 18:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec98b7a0-9502-5daf-9c00-2836f3add16a with identifier: BY91581
2026-03-28 18:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec98b7a0-9502-5daf-9c00-2836f3add16a with identifier: BY91581 to the API
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:07:34Z',
 'fuel_type': 'petrol',
 'id': 'ec98b7a0-9502-5daf-9c00-2836f3add16a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY91581',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 179965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Allstar',
 'transmission': 'manual',
 'trim': 'Allstar',
 'year': 2016}
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY91581%27 HTTP/1.1" 200 None
2026-03-28 18:39:05 [auto1.de] INFO: Saving data for BY91581: {'auction_closing_time': 1774883254.0, 'created_time': 1774636541.100275, 'last_price_update_time': 1774723145.853434}
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY91581') HTTP/1.1" 204 0
2026-03-28 18:39:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:05 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-28 18:39:05 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV30078%27 HTTP/1.1" 200 None
2026-03-28 18:39:05 [auto1.de] INFO: Scrape type for CV30078: 2
2026-03-28 18:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80fa6268-7311-50aa-9d3f-9d628a431f17 with identifier: CV30078
2026-03-28 18:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80fa6268-7311-50aa-9d3f-9d628a431f17 with scrape type 2
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80fa6268-7311-50aa-9d3f-9d628a431f17 with scrape type 2
2026-03-28 18:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80fa6268-7311-50aa-9d3f-9d628a431f17, identifier: CV30078
2026-03-28 18:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80fa6268-7311-50aa-9d3f-9d628a431f17 with identifier: CV30078
2026-03-28 18:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80fa6268-7311-50aa-9d3f-9d628a431f17 with identifier: CV30078
2026-03-28 18:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80fa6268-7311-50aa-9d3f-9d628a431f17 with identifier: CV30078 to the API
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T16:00:00Z',
 'fuel_type': 'diesel',
 'id': '80fa6268-7311-50aa-9d3f-9d628a431f17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV30078',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 132529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-27',
 'seller_name': None,
 'title': 'BMW X6 xDrive 40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV30078%27 HTTP/1.1" 200 None
2026-03-28 18:39:06 [auto1.de] INFO: Saving data for CV30078: {'auction_closing_time': 1774886400.0, 'created_time': 1773132463.164837, 'last_price_update_time': 1774723146.397717}
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV30078') HTTP/1.1" 204 0
2026-03-28 18:39:06 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-28 18:39:06 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90808%27 HTTP/1.1" 200 None
2026-03-28 18:39:06 [auto1.de] INFO: Scrape type for RD90808: 0
2026-03-28 18:39:06 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR33805%27 HTTP/1.1" 200 None
2026-03-28 18:39:06 [auto1.de] INFO: Scrape type for LR33805: 0
2026-03-28 18:39:06 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-28 18:39:06 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK55952%27 HTTP/1.1" 200 None
2026-03-28 18:39:06 [auto1.de] INFO: Scrape type for GK55952: 0
2026-03-28 18:39:06 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-28 18:39:06 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-28 18:39:06 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY49475%27 HTTP/1.1" 200 None
2026-03-28 18:39:06 [auto1.de] INFO: Scrape type for GY49475: 2
2026-03-28 18:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with identifier: GY49475
2026-03-28 18:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with scrape type 2
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with scrape type 2
2026-03-28 18:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae, identifier: GY49475
2026-03-28 18:39:06 [scrapy.extensions.logstats] INFO: Crawled 101 pages (at 18 pages/min), scraped 252 items (at 52 items/min)
2026-03-28 18:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-28 18:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with identifier: GY49475
2026-03-28 18:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with identifier: GY49475
2026-03-28 18:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with identifier: GY49475 to the API
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:01Z',
 'fuel_type': 'petrol',
 'id': 'dca7d81a-3126-5f52-bcf8-175ccbb1e6ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY49475',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 201796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-07-15',
 'seller_name': None,
 'title': 'Honda Civic 1.4 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2001}
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY49475%27 HTTP/1.1" 200 None
2026-03-28 18:39:06 [auto1.de] INFO: Saving data for GY49475: {'auction_closing_time': 1774883821.0, 'created_time': 1774002727.549319, 'last_price_update_time': 1774723146.894633}
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY49475') HTTP/1.1" 204 0
2026-03-28 18:39:06 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK64287%27 HTTP/1.1" 200 None
2026-03-28 18:39:06 [auto1.de] INFO: Scrape type for DK64287: 0
2026-03-28 18:39:06 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-28 18:39:06 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT00833%27 HTTP/1.1" 200 None
2026-03-28 18:39:06 [auto1.de] INFO: Scrape type for YT00833: 2
2026-03-28 18:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 745f1ea0-4904-5b8f-be6c-a8930ebdc851 with identifier: YT00833
2026-03-28 18:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 745f1ea0-4904-5b8f-be6c-a8930ebdc851 with scrape type 2
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 745f1ea0-4904-5b8f-be6c-a8930ebdc851 with scrape type 2
2026-03-28 18:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 745f1ea0-4904-5b8f-be6c-a8930ebdc851, identifier: YT00833
2026-03-28 18:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 745f1ea0-4904-5b8f-be6c-a8930ebdc851 with identifier: YT00833
2026-03-28 18:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 745f1ea0-4904-5b8f-be6c-a8930ebdc851 with identifier: YT00833
2026-03-28 18:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 745f1ea0-4904-5b8f-be6c-a8930ebdc851 with identifier: YT00833 to the API
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:34:03Z',
 'fuel_type': 'petrol',
 'id': '745f1ea0-4904-5b8f-be6c-a8930ebdc851',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT00833',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 76620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT00833%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Saving data for YT00833: {'auction_closing_time': 1774884843.0, 'created_time': 1773308238.765331, 'last_price_update_time': 1774723147.337474}
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT00833') HTTP/1.1" 204 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG01662%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for CG01662: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX83133%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for KX83133: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90006%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for TZ90006: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA89472%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for EA89472: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: US71241
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY51014%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for WY51014: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF08436%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for ZF08436: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV05136%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for PV05136: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70146%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for CR70146: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC52225%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for WC52225: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW68189%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for EW68189: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB27251%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for NB27251: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN60983%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for PN60983: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR27692%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for HR27692: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67708%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for TT67708: 0
2026-03-28 18:39:07 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68554%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Scrape type for TL68554: 2
2026-03-28 18:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with identifier: TL68554
2026-03-28 18:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with scrape type 2
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with scrape type 2
2026-03-28 18:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5, identifier: TL68554
2026-03-28 18:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with identifier: TL68554
2026-03-28 18:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with identifier: TL68554
2026-03-28 18:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with identifier: TL68554 to the API
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:44:03Z',
 'fuel_type': 'petrol',
 'id': 'a8315b0f-e112-57a0-bca8-ddb5fbd2bed5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL68554',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 50884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2020}
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68554%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [auto1.de] INFO: Saving data for TL68554: {'auction_closing_time': 1774885443.0, 'created_time': 1774521601.311613, 'last_price_update_time': 1774723148.139493}
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL68554') HTTP/1.1" 204 0
2026-03-28 18:39:08 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-28 18:39:08 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW17934%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [auto1.de] INFO: Scrape type for GW17934: 0
2026-03-28 18:39:08 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ09435%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [auto1.de] INFO: Scrape type for EZ09435: 0
2026-03-28 18:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE06488/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:09 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN53329%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Scrape type for LN53329: 0
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36521%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Scrape type for VU36521: 1
2026-03-28 18:39:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE69699%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Scrape type for UE69699: 0
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK78678%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Scrape type for LK78678: 2
2026-03-28 18:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76c4f06d-9cef-53e2-b673-c7aecafc8973 with identifier: LK78678
2026-03-28 18:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76c4f06d-9cef-53e2-b673-c7aecafc8973 with scrape type 2
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76c4f06d-9cef-53e2-b673-c7aecafc8973 with scrape type 2
2026-03-28 18:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76c4f06d-9cef-53e2-b673-c7aecafc8973, identifier: LK78678
2026-03-28 18:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76c4f06d-9cef-53e2-b673-c7aecafc8973 with identifier: LK78678
2026-03-28 18:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76c4f06d-9cef-53e2-b673-c7aecafc8973 with identifier: LK78678
2026-03-28 18:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76c4f06d-9cef-53e2-b673-c7aecafc8973 with identifier: LK78678 to the API
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:43:19Z',
 'fuel_type': 'diesel',
 'id': '76c4f06d-9cef-53e2-b673-c7aecafc8973',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK78678',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 125505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-08',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2015}
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK78678%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Saving data for LK78678: {'auction_closing_time': 1774885399.0, 'created_time': 1774636665.493812, 'last_price_update_time': 1774723149.754416}
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK78678') HTTP/1.1" 204 0
2026-03-28 18:39:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40806%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Scrape type for SN40806: 0
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD50866%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Scrape type for HD50866: 0
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY74574%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Scrape type for HY74574: 0
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72429%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Scrape type for KP72429: 0
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ14073%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Scrape type for WZ14073: 0
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC48090%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Scrape type for BC48090: 0
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV87591%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Scrape type for YV87591: 0
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-28 18:39:09 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU37583%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [auto1.de] INFO: Scrape type for VU37583: 0
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89065%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [auto1.de] INFO: Scrape type for VS89065: 0
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK06519%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [auto1.de] INFO: Scrape type for KK06519: 0
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT80809%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [auto1.de] INFO: Scrape type for NT80809: 0
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV64790%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [auto1.de] INFO: Scrape type for HV64790: 0
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12247%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [auto1.de] INFO: Scrape type for NF12247: 0
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR85001%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [auto1.de] INFO: Scrape type for LR85001: 0
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-28 18:39:10 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK79183%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [auto1.de] INFO: Scrape type for MK79183: 0
2026-03-28 18:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE06488> (referer: https://www.auto1.com/v1/car-details-view/KE06488/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d7206d6-0f40-539f-89c6-28236583b347 with identifier: KE06488
2026-03-28 18:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d7206d6-0f40-539f-89c6-28236583b347 with scrape type 1
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d7206d6-0f40-539f-89c6-28236583b347
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F6e%252F1c6ec9de35e7d5d4c3a77e03679f2ebe%252Fpa%252FKE06488_542bf3d5441ac6eedd07d89e2a973066.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_542bf3d5441ac6eedd07d89e2a973066.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F6e%252F1c6ec9de35e7d5d4c3a77e03679f2ebe%252Fpa%252FKE06488_4202f5609cd6b0f9aeb2cf771a7cafe5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_4202f5609cd6b0f9aeb2cf771a7cafe5.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F6e%252F1c6ec9de35e7d5d4c3a77e03679f2ebe%252Fpa%252FKE06488_62cf02d51147d737666d3fcd611c3f44.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_62cf02d51147d737666d3fcd611c3f44.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F6e%252F1c6ec9de35e7d5d4c3a77e03679f2ebe%252Fpa%252FKE06488_c8635582e56e65ca2174db9074903f9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_c8635582e56e65ca2174db9074903f9f.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F6e%252F1c6ec9de35e7d5d4c3a77e03679f2ebe%252Fpa%252FKE06488_a5287f5c9b24d17eddef9b44d1f437cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_a5287f5c9b24d17eddef9b44d1f437cd.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F6e%252F1c6ec9de35e7d5d4c3a77e03679f2ebe%252Fpa%252FKE06488_493141daf2409a6f539b65c9982488c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_493141daf2409a6f539b65c9982488c4.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F6e%252F1c6ec9de35e7d5d4c3a77e03679f2ebe%252Fpa%252FKE06488_535efb5a4baa32b58a85cb968193a4db.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_535efb5a4baa32b58a85cb968193a4db.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F6e%252F1c6ec9de35e7d5d4c3a77e03679f2ebe%252Fpa%252FKE06488_d841e6777fc7d7cce11f7ad58c50fed0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_d841e6777fc7d7cce11f7ad58c50fed0.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F6e%252F1c6ec9de35e7d5d4c3a77e03679f2ebe%252Fpa%252FKE06488_fc9c46cf24de9c2ea62e9562a6c643e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_fc9c46cf24de9c2ea62e9562a6c643e3.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F6e%252F1c6ec9de35e7d5d4c3a77e03679f2ebe%252Fpa%252FKE06488_db67ed1696f2db4169482b4dd281a912.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_db67ed1696f2db4169482b4dd281a912.jpg already downloaded
2026-03-28 18:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d7206d6-0f40-539f-89c6-28236583b347, identifier: KE06488
2026-03-28 18:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d7206d6-0f40-539f-89c6-28236583b347 with identifier: KE06488
2026-03-28 18:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d7206d6-0f40-539f-89c6-28236583b347 with identifier: KE06488
2026-03-28 18:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d7206d6-0f40-539f-89c6-28236583b347 with identifier: KE06488 to the API
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KE06488>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:29:11Z',
 'fuel_type': 'diesel',
 'id': '3d7206d6-0f40-539f-89c6-28236583b347',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE06488',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Kia',
 'model': 'Optima',
 'odometer': 170373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_542bf3d5441ac6eedd07d89e2a973066.jpg',
                'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_4202f5609cd6b0f9aeb2cf771a7cafe5.jpg',
                'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_62cf02d51147d737666d3fcd611c3f44.jpg',
                'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_c8635582e56e65ca2174db9074903f9f.jpg',
                'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_a5287f5c9b24d17eddef9b44d1f437cd.jpg',
                'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_493141daf2409a6f539b65c9982488c4.jpg',
                'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_535efb5a4baa32b58a85cb968193a4db.jpg',
                'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_d841e6777fc7d7cce11f7ad58c50fed0.jpg',
                'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_fc9c46cf24de9c2ea62e9562a6c643e3.jpg',
                'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_db67ed1696f2db4169482b4dd281a912.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7206d6-0f40-539f-89c6-28236583b347/3d7206d6-0f40-539f-89c6-28236583b347_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2571812,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_542bf3d5441ac6eedd07d89e2a973066.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7206d6-0f40-539f-89c6-28236583b347/3d7206d6-0f40-539f-89c6-28236583b347_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2374878,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_4202f5609cd6b0f9aeb2cf771a7cafe5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7206d6-0f40-539f-89c6-28236583b347/3d7206d6-0f40-539f-89c6-28236583b347_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2195888,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_62cf02d51147d737666d3fcd611c3f44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7206d6-0f40-539f-89c6-28236583b347/3d7206d6-0f40-539f-89c6-28236583b347_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_c8635582e56e65ca2174db9074903f9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7206d6-0f40-539f-89c6-28236583b347/3d7206d6-0f40-539f-89c6-28236583b347_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_a5287f5c9b24d17eddef9b44d1f437cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7206d6-0f40-539f-89c6-28236583b347/3d7206d6-0f40-539f-89c6-28236583b347_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_493141daf2409a6f539b65c9982488c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7206d6-0f40-539f-89c6-28236583b347/3d7206d6-0f40-539f-89c6-28236583b347_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2100740,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_535efb5a4baa32b58a85cb968193a4db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7206d6-0f40-539f-89c6-28236583b347/3d7206d6-0f40-539f-89c6-28236583b347_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_d841e6777fc7d7cce11f7ad58c50fed0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7206d6-0f40-539f-89c6-28236583b347/3d7206d6-0f40-539f-89c6-28236583b347_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_fc9c46cf24de9c2ea62e9562a6c643e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d7206d6-0f40-539f-89c6-28236583b347/3d7206d6-0f40-539f-89c6-28236583b347_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/6e/1c6ec9de35e7d5d4c3a77e03679f2ebe/pa/KE06488_db67ed1696f2db4169482b4dd281a912.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Optima 1.7 CRDi Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2014}
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE06488%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [auto1.de] INFO: Saving data for KE06488: {'created_time': 1774723151.176313, 'last_price_update_time': 1774723151.176323, 'auction_closing_time': 1774884551.0}
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE06488') HTTP/1.1" 204 0
2026-03-28 18:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VU36521/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:11 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06665%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [auto1.de] INFO: Scrape type for BW06665: 0
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44182%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [auto1.de] INFO: Scrape type for TW44182: 0
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ71204%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [auto1.de] INFO: Scrape type for RJ71204: 0
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK85869%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [auto1.de] INFO: Scrape type for RK85869: 0
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH34670%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [auto1.de] INFO: Scrape type for ZH34670: 0
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE15343%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [auto1.de] INFO: Scrape type for BE15343: 0
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD35847%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [auto1.de] INFO: Scrape type for WD35847: 0
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-28 18:39:11 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS83797%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [auto1.de] INFO: Scrape type for MS83797: 2
2026-03-28 18:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with identifier: MS83797
2026-03-28 18:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with scrape type 2
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with scrape type 2
2026-03-28 18:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba, identifier: MS83797
2026-03-28 18:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with identifier: MS83797
2026-03-28 18:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with identifier: MS83797
2026-03-28 18:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with identifier: MS83797 to the API
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:12:49Z',
 'fuel_type': 'petrol',
 'id': '5096e04a-1eb3-5c5f-be0a-a09195bf10ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS83797',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 193019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-17',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.2 TCe Stepway Celebration',
 'transmission': 'manual',
 'trim': 'Stepway Celebration',
 'year': 2017}
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS83797%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [auto1.de] INFO: Saving data for MS83797: {'auction_closing_time': 1774883569.0, 'created_time': 1774521824.53306, 'last_price_update_time': 1774723151.948541}
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS83797') HTTP/1.1" 204 0
2026-03-28 18:39:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:12 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-28 18:39:12 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD54519%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [auto1.de] INFO: Scrape type for JD54519: 2
2026-03-28 18:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82613229-5d6b-5cac-baf3-14872d15bd46 with identifier: JD54519
2026-03-28 18:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82613229-5d6b-5cac-baf3-14872d15bd46 with scrape type 2
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82613229-5d6b-5cac-baf3-14872d15bd46 with scrape type 2
2026-03-28 18:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82613229-5d6b-5cac-baf3-14872d15bd46, identifier: JD54519
2026-03-28 18:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82613229-5d6b-5cac-baf3-14872d15bd46 with identifier: JD54519
2026-03-28 18:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82613229-5d6b-5cac-baf3-14872d15bd46 with identifier: JD54519
2026-03-28 18:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82613229-5d6b-5cac-baf3-14872d15bd46 with identifier: JD54519 to the API
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:32:59Z',
 'fuel_type': 'diesel',
 'id': '82613229-5d6b-5cac-baf3-14872d15bd46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD54519',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 167835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-27',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD54519%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [auto1.de] INFO: Saving data for JD54519: {'auction_closing_time': 1774884779.0, 'created_time': 1774521924.19585, 'last_price_update_time': 1774723152.536964}
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD54519') HTTP/1.1" 204 0
2026-03-28 18:39:12 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK33490%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [auto1.de] INFO: Scrape type for XK33490: 2
2026-03-28 18:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with identifier: XK33490
2026-03-28 18:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with scrape type 2
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with scrape type 2
2026-03-28 18:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1, identifier: XK33490
2026-03-28 18:39:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with identifier: XK33490
2026-03-28 18:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with identifier: XK33490
2026-03-28 18:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with identifier: XK33490 to the API
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:59Z',
 'fuel_type': 'petrol',
 'id': '653584ff-c1e3-5e4e-985b-b7fb4c81b7f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK33490',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 56717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-19',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2019}
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK33490%27 HTTP/1.1" 200 None
2026-03-28 18:39:13 [auto1.de] INFO: Saving data for XK33490: {'auction_closing_time': 1774885919.0, 'created_time': 1774521697.438965, 'last_price_update_time': 1774723153.005422}
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK33490') HTTP/1.1" 204 0
2026-03-28 18:39:13 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-28 18:39:13 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80421%27 HTTP/1.1" 200 None
2026-03-28 18:39:13 [auto1.de] INFO: Scrape type for ZY80421: 2
2026-03-28 18:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612908d7-ef20-59ba-8b4e-6619ad523824 with identifier: ZY80421
2026-03-28 18:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612908d7-ef20-59ba-8b4e-6619ad523824 with scrape type 2
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612908d7-ef20-59ba-8b4e-6619ad523824 with scrape type 2
2026-03-28 18:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612908d7-ef20-59ba-8b4e-6619ad523824, identifier: ZY80421
2026-03-28 18:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612908d7-ef20-59ba-8b4e-6619ad523824 with identifier: ZY80421
2026-03-28 18:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612908d7-ef20-59ba-8b4e-6619ad523824 with identifier: ZY80421
2026-03-28 18:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612908d7-ef20-59ba-8b4e-6619ad523824 with identifier: ZY80421 to the API
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:32:49Z',
 'fuel_type': 'petrol',
 'id': '612908d7-ef20-59ba-8b4e-6619ad523824',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY80421',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 220116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-08',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Team Edition',
 'transmission': 'manual',
 'trim': 'Team Edition',
 'year': 2008}
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80421%27 HTTP/1.1" 200 None
2026-03-28 18:39:13 [auto1.de] INFO: Saving data for ZY80421: {'auction_closing_time': 1774884769.0, 'created_time': 1774521890.753075, 'last_price_update_time': 1774723153.437203}
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY80421') HTTP/1.1" 204 0
2026-03-28 18:39:13 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-28 18:39:13 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU85783%27 HTTP/1.1" 200 None
2026-03-28 18:39:13 [auto1.de] INFO: Scrape type for PU85783: 2
2026-03-28 18:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe931aa-3057-5dba-8493-dbe3262a6426 with identifier: PU85783
2026-03-28 18:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe931aa-3057-5dba-8493-dbe3262a6426 with scrape type 2
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe931aa-3057-5dba-8493-dbe3262a6426 with scrape type 2
2026-03-28 18:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfe931aa-3057-5dba-8493-dbe3262a6426, identifier: PU85783
2026-03-28 18:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfe931aa-3057-5dba-8493-dbe3262a6426 with identifier: PU85783
2026-03-28 18:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfe931aa-3057-5dba-8493-dbe3262a6426 with identifier: PU85783
2026-03-28 18:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfe931aa-3057-5dba-8493-dbe3262a6426 with identifier: PU85783 to the API
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:51:23Z',
 'fuel_type': 'petrol',
 'id': 'cfe931aa-3057-5dba-8493-dbe3262a6426',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU85783',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 119098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-10',
 'seller_name': None,
 'title': 'Ford B-Max 1.6 Ti-VCT SYNC Edition',
 'transmission': 'automatic',
 'trim': 'SYNC Edition',
 'year': 2016}
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU85783%27 HTTP/1.1" 200 None
2026-03-28 18:39:13 [auto1.de] INFO: Saving data for PU85783: {'auction_closing_time': 1774885883.0, 'created_time': 1774550125.718926, 'last_price_update_time': 1774723153.865529}
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU85783') HTTP/1.1" 204 0
2026-03-28 18:39:13 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN88282%27 HTTP/1.1" 200 None
2026-03-28 18:39:13 [auto1.de] INFO: Scrape type for EN88282: 2
2026-03-28 18:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c3f53be-dd34-55d0-89a4-9472a2a37450 with identifier: EN88282
2026-03-28 18:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c3f53be-dd34-55d0-89a4-9472a2a37450 with scrape type 2
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c3f53be-dd34-55d0-89a4-9472a2a37450 with scrape type 2
2026-03-28 18:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c3f53be-dd34-55d0-89a4-9472a2a37450, identifier: EN88282
2026-03-28 18:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c3f53be-dd34-55d0-89a4-9472a2a37450 with identifier: EN88282
2026-03-28 18:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c3f53be-dd34-55d0-89a4-9472a2a37450 with identifier: EN88282
2026-03-28 18:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c3f53be-dd34-55d0-89a4-9472a2a37450 with identifier: EN88282 to the API
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:58:05Z',
 'fuel_type': 'petrol',
 'id': '2c3f53be-dd34-55d0-89a4-9472a2a37450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN88282',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 205834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-13',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN88282%27 HTTP/1.1" 200 None
2026-03-28 18:39:14 [auto1.de] INFO: Saving data for EN88282: {'auction_closing_time': 1774886285.0, 'created_time': 1773946077.385918, 'last_price_update_time': 1774723154.309714}
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN88282') HTTP/1.1" 204 0
2026-03-28 18:39:14 [auto1.de] INFO: Found listing with ID: KS42383
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS42383%27 HTTP/1.1" 200 None
2026-03-28 18:39:14 [auto1.de] INFO: Scrape type for KS42383: 2
2026-03-28 18:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a55837f-c156-5368-bf89-02a38d708fc2 with identifier: KS42383
2026-03-28 18:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a55837f-c156-5368-bf89-02a38d708fc2 with scrape type 2
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a55837f-c156-5368-bf89-02a38d708fc2 with scrape type 2
2026-03-28 18:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a55837f-c156-5368-bf89-02a38d708fc2, identifier: KS42383
2026-03-28 18:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a55837f-c156-5368-bf89-02a38d708fc2 with identifier: KS42383
2026-03-28 18:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a55837f-c156-5368-bf89-02a38d708fc2 with identifier: KS42383
2026-03-28 18:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a55837f-c156-5368-bf89-02a38d708fc2 with identifier: KS42383 to the API
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:17:10Z',
 'fuel_type': 'diesel',
 'id': '1a55837f-c156-5368-bf89-02a38d708fc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS42383',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Captiva',
 'odometer': 213339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-31',
 'seller_name': None,
 'title': 'Chevrolet Captiva 2.2 Diesel D LT+',
 'transmission': 'manual',
 'trim': 'D LT+',
 'year': 2012}
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS42383%27 HTTP/1.1" 200 None
2026-03-28 18:39:14 [auto1.de] INFO: Saving data for KS42383: {'auction_closing_time': 1774883830.0, 'created_time': 1774118675.105694, 'last_price_update_time': 1774723154.752892}
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS42383') HTTP/1.1" 204 0
2026-03-28 18:39:14 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86536%27 HTTP/1.1" 200 None
2026-03-28 18:39:14 [auto1.de] INFO: Scrape type for YB86536: 0
2026-03-28 18:39:14 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-28 18:39:14 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG75722%27 HTTP/1.1" 200 None
2026-03-28 18:39:14 [auto1.de] INFO: Scrape type for FG75722: 0
2026-03-28 18:39:14 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-28 18:39:14 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG84508%27 HTTP/1.1" 200 None
2026-03-28 18:39:14 [auto1.de] INFO: Scrape type for LG84508: 2
2026-03-28 18:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef61d23f-f3fa-509e-b154-25e4e1e4805d with identifier: LG84508
2026-03-28 18:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef61d23f-f3fa-509e-b154-25e4e1e4805d with scrape type 2
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef61d23f-f3fa-509e-b154-25e4e1e4805d with scrape type 2
2026-03-28 18:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef61d23f-f3fa-509e-b154-25e4e1e4805d, identifier: LG84508
2026-03-28 18:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef61d23f-f3fa-509e-b154-25e4e1e4805d with identifier: LG84508
2026-03-28 18:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef61d23f-f3fa-509e-b154-25e4e1e4805d with identifier: LG84508
2026-03-28 18:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef61d23f-f3fa-509e-b154-25e4e1e4805d with identifier: LG84508 to the API
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:12Z',
 'fuel_type': 'diesel',
 'id': 'ef61d23f-f3fa-509e-b154-25e4e1e4805d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG84508',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 49924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-11',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Maxi Highline BlueMotion',
 'year': 2017}
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG84508%27 HTTP/1.1" 200 None
2026-03-28 18:39:15 [auto1.de] INFO: Saving data for LG84508: {'auction_closing_time': 1774883352.0, 'created_time': 1774636637.757656, 'last_price_update_time': 1774723155.209616}
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG84508') HTTP/1.1" 204 0
2026-03-28 18:39:15 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-28 18:39:15 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-28 18:39:15 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-28 18:39:15 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-28 18:39:15 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-28 18:39:15 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ43779%27 HTTP/1.1" 200 None
2026-03-28 18:39:15 [auto1.de] INFO: Scrape type for AJ43779: 0
2026-03-28 18:39:15 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-28 18:39:15 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW12612%27 HTTP/1.1" 200 None
2026-03-28 18:39:15 [auto1.de] INFO: Scrape type for UW12612: 2
2026-03-28 18:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de1cf38f-3434-515f-a864-ed303f5dc0c3 with identifier: UW12612
2026-03-28 18:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de1cf38f-3434-515f-a864-ed303f5dc0c3 with scrape type 2
2026-03-28 18:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de1cf38f-3434-515f-a864-ed303f5dc0c3 with scrape type 2
2026-03-28 18:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de1cf38f-3434-515f-a864-ed303f5dc0c3, identifier: UW12612
2026-03-28 18:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de1cf38f-3434-515f-a864-ed303f5dc0c3 with identifier: UW12612
2026-03-28 18:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de1cf38f-3434-515f-a864-ed303f5dc0c3 with identifier: UW12612
2026-03-28 18:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de1cf38f-3434-515f-a864-ed303f5dc0c3 with identifier: UW12612 to the API
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 76,
 'expiration_date': '2026-03-30T15:25:31Z',
 'fuel_type': 'diesel',
 'id': 'de1cf38f-3434-515f-a864-ed303f5dc0c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW12612',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 30394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Opel Combo 1.5 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2018}
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW12612%27 HTTP/1.1" 200 None
2026-03-28 18:39:15 [auto1.de] INFO: Saving data for UW12612: {'auction_closing_time': 1774884331.0, 'created_time': 1774522491.527599, 'last_price_update_time': 1774723155.760155}
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW12612') HTTP/1.1" 204 0
2026-03-28 18:39:15 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ54178%27 HTTP/1.1" 200 None
2026-03-28 18:39:15 [auto1.de] INFO: Scrape type for YZ54178: 0
2026-03-28 18:39:15 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-28 18:39:15 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35132%27 HTTP/1.1" 200 None
2026-03-28 18:39:15 [auto1.de] INFO: Scrape type for NR35132: 0
2026-03-28 18:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VU36521> (referer: https://www.auto1.com/v1/car-details-view/VU36521/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:15 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c59384e-d3cf-5960-90cb-ef16f1765d0a with identifier: VU36521
2026-03-28 18:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c59384e-d3cf-5960-90cb-ef16f1765d0a with scrape type 1
2026-03-28 18:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c59384e-d3cf-5960-90cb-ef16f1765d0a
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247e3ad80e0244a2ed6baf2f1e14a2da%252Fpa%252FVU36521_8e17854fb8185ac246b83df784304b1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_8e17854fb8185ac246b83df784304b1e.jpg already downloaded
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247e3ad80e0244a2ed6baf2f1e14a2da%252Fpa%252FVU36521_57e29f20b369d0012503b0a0bc80d44e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_57e29f20b369d0012503b0a0bc80d44e.jpg already downloaded
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247e3ad80e0244a2ed6baf2f1e14a2da%252Fpa%252FVU36521_3eb55356fa8c32a0d9a60473da00a991.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_3eb55356fa8c32a0d9a60473da00a991.jpg already downloaded
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247e3ad80e0244a2ed6baf2f1e14a2da%252Fpa%252FVU36521_bc20e8fd6b1978b76d85b96467bdf735.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_bc20e8fd6b1978b76d85b96467bdf735.jpg already downloaded
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247e3ad80e0244a2ed6baf2f1e14a2da%252Fpa%252FVU36521_95d331d17e500cf297f66aae167f9880.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_95d331d17e500cf297f66aae167f9880.jpg already downloaded
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247e3ad80e0244a2ed6baf2f1e14a2da%252Fpa%252FVU36521_5944e1d72b7bc1fc2f63db9b4e7c1070.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_5944e1d72b7bc1fc2f63db9b4e7c1070.jpg already downloaded
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247e3ad80e0244a2ed6baf2f1e14a2da%252Fpa%252FVU36521_e142d8a08853260a5752ec017f8e0b4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_e142d8a08853260a5752ec017f8e0b4e.jpg already downloaded
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247e3ad80e0244a2ed6baf2f1e14a2da%252Fpa%252FVU36521_b76dd40cb1dd4ac203e8cd08701bac23.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_b76dd40cb1dd4ac203e8cd08701bac23.jpg already downloaded
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247e3ad80e0244a2ed6baf2f1e14a2da%252Fpa%252FVU36521_cff678f9de75982a497919713ce80a63.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_cff678f9de75982a497919713ce80a63.jpg already downloaded
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252F7e%252F247e3ad80e0244a2ed6baf2f1e14a2da%252Fpa%252FVU36521_bcb38a320738fc38981bc9b7aba68c75.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_bcb38a320738fc38981bc9b7aba68c75.jpg already downloaded
2026-03-28 18:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c59384e-d3cf-5960-90cb-ef16f1765d0a, identifier: VU36521
2026-03-28 18:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c59384e-d3cf-5960-90cb-ef16f1765d0a with identifier: VU36521
2026-03-28 18:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c59384e-d3cf-5960-90cb-ef16f1765d0a with identifier: VU36521
2026-03-28 18:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c59384e-d3cf-5960-90cb-ef16f1765d0a with identifier: VU36521 to the API
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VU36521>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:38:53Z',
 'fuel_type': 'petrol',
 'id': '5c59384e-d3cf-5960-90cb-ef16f1765d0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU36521',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 46968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_8e17854fb8185ac246b83df784304b1e.jpg',
                'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_57e29f20b369d0012503b0a0bc80d44e.jpg',
                'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_3eb55356fa8c32a0d9a60473da00a991.jpg',
                'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_bc20e8fd6b1978b76d85b96467bdf735.jpg',
                'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_95d331d17e500cf297f66aae167f9880.jpg',
                'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_5944e1d72b7bc1fc2f63db9b4e7c1070.jpg',
                'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_e142d8a08853260a5752ec017f8e0b4e.jpg',
                'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_b76dd40cb1dd4ac203e8cd08701bac23.jpg',
                'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_cff678f9de75982a497919713ce80a63.jpg',
                'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_bcb38a320738fc38981bc9b7aba68c75.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c59384e-d3cf-5960-90cb-ef16f1765d0a/5c59384e-d3cf-5960-90cb-ef16f1765d0a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_8e17854fb8185ac246b83df784304b1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c59384e-d3cf-5960-90cb-ef16f1765d0a/5c59384e-d3cf-5960-90cb-ef16f1765d0a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_57e29f20b369d0012503b0a0bc80d44e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c59384e-d3cf-5960-90cb-ef16f1765d0a/5c59384e-d3cf-5960-90cb-ef16f1765d0a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_3eb55356fa8c32a0d9a60473da00a991.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c59384e-d3cf-5960-90cb-ef16f1765d0a/5c59384e-d3cf-5960-90cb-ef16f1765d0a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_bc20e8fd6b1978b76d85b96467bdf735.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c59384e-d3cf-5960-90cb-ef16f1765d0a/5c59384e-d3cf-5960-90cb-ef16f1765d0a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_95d331d17e500cf297f66aae167f9880.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c59384e-d3cf-5960-90cb-ef16f1765d0a/5c59384e-d3cf-5960-90cb-ef16f1765d0a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_5944e1d72b7bc1fc2f63db9b4e7c1070.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c59384e-d3cf-5960-90cb-ef16f1765d0a/5c59384e-d3cf-5960-90cb-ef16f1765d0a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_e142d8a08853260a5752ec017f8e0b4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c59384e-d3cf-5960-90cb-ef16f1765d0a/5c59384e-d3cf-5960-90cb-ef16f1765d0a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_b76dd40cb1dd4ac203e8cd08701bac23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c59384e-d3cf-5960-90cb-ef16f1765d0a/5c59384e-d3cf-5960-90cb-ef16f1765d0a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_cff678f9de75982a497919713ce80a63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c59384e-d3cf-5960-90cb-ef16f1765d0a/5c59384e-d3cf-5960-90cb-ef16f1765d0a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/7e/247e3ad80e0244a2ed6baf2f1e14a2da/pa/VU36521_bcb38a320738fc38981bc9b7aba68c75.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36521%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [auto1.de] INFO: Saving data for VU36521: {'created_time': 1774723156.5892, 'last_price_update_time': 1774723156.58921, 'auction_closing_time': 1774885133.0}
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU36521') HTTP/1.1" 204 0
2026-03-28 18:39:16 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-28 18:39:16 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-28 18:39:16 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT68556%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [auto1.de] INFO: Scrape type for LT68556: 0
2026-03-28 18:39:16 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA20304%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [auto1.de] INFO: Scrape type for PA20304: 0
2026-03-28 18:39:16 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE42269%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [auto1.de] INFO: Scrape type for KE42269: 0
2026-03-28 18:39:16 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF69391%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [auto1.de] INFO: Scrape type for RF69391: 0
2026-03-28 18:39:16 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC77037%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [auto1.de] INFO: Scrape type for AC77037: 0
2026-03-28 18:39:16 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17757%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [auto1.de] INFO: Scrape type for NS17757: 2
2026-03-28 18:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with identifier: NS17757
2026-03-28 18:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with scrape type 2
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with scrape type 2
2026-03-28 18:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0, identifier: NS17757
2026-03-28 18:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with identifier: NS17757
2026-03-28 18:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with identifier: NS17757
2026-03-28 18:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with identifier: NS17757 to the API
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:11:26Z',
 'fuel_type': 'diesel',
 'id': '12239576-3b7e-5993-be8c-0a0bfcb2f8f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS17757',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 67014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'automatic',
 'trim': '350 L3 Trend',
 'year': 2021}
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17757%27 HTTP/1.1" 200 None
2026-03-28 18:39:17 [auto1.de] INFO: Saving data for NS17757: {'auction_closing_time': 1774883486.0, 'created_time': 1774522631.747538, 'last_price_update_time': 1774723157.291855}
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS17757') HTTP/1.1" 204 0
2026-03-28 18:39:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL99453%27 HTTP/1.1" 200 None
2026-03-28 18:39:17 [auto1.de] INFO: Scrape type for LL99453: 0
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV20028%27 HTTP/1.1" 200 None
2026-03-28 18:39:17 [auto1.de] INFO: Scrape type for GV20028: 0
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT13980%27 HTTP/1.1" 200 None
2026-03-28 18:39:17 [auto1.de] INFO: Scrape type for YT13980: 0
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM28331%27 HTTP/1.1" 200 None
2026-03-28 18:39:17 [auto1.de] INFO: Scrape type for SM28331: 0
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY66672%27 HTTP/1.1" 200 None
2026-03-28 18:39:17 [auto1.de] INFO: Scrape type for XY66672: 0
2026-03-28 18:39:17 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ33844%27 HTTP/1.1" 200 None
2026-03-28 18:39:17 [auto1.de] INFO: Scrape type for XJ33844: 2
2026-03-28 18:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1912f5-56a8-59f8-8454-39d5c4842405 with identifier: XJ33844
2026-03-28 18:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1912f5-56a8-59f8-8454-39d5c4842405 with scrape type 2
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc1912f5-56a8-59f8-8454-39d5c4842405 with scrape type 2
2026-03-28 18:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc1912f5-56a8-59f8-8454-39d5c4842405, identifier: XJ33844
2026-03-28 18:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc1912f5-56a8-59f8-8454-39d5c4842405 with identifier: XJ33844
2026-03-28 18:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc1912f5-56a8-59f8-8454-39d5c4842405 with identifier: XJ33844
2026-03-28 18:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc1912f5-56a8-59f8-8454-39d5c4842405 with identifier: XJ33844 to the API
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:44:08Z',
 'fuel_type': 'diesel',
 'id': 'dc1912f5-56a8-59f8-8454-39d5c4842405',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ33844',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 167229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-08',
 'seller_name': None,
 'title': 'Peugeot 208 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ33844%27 HTTP/1.1" 200 None
2026-03-28 18:39:18 [auto1.de] INFO: Saving data for XJ33844: {'auction_closing_time': 1774885448.0, 'created_time': 1774522164.144774, 'last_price_update_time': 1774723158.649777}
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ33844') HTTP/1.1" 204 0
2026-03-28 18:39:18 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-28 18:39:18 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-28 18:39:18 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-28 18:39:18 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-28 18:39:18 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-28 18:39:18 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP66547%27 HTTP/1.1" 200 None
2026-03-28 18:39:18 [auto1.de] INFO: Scrape type for TP66547: 0
2026-03-28 18:39:18 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-28 18:39:18 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK52975%27 HTTP/1.1" 200 None
2026-03-28 18:39:18 [auto1.de] INFO: Scrape type for BK52975: 0
2026-03-28 18:39:18 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP25295%27 HTTP/1.1" 200 None
2026-03-28 18:39:18 [auto1.de] INFO: Scrape type for VP25295: 2
2026-03-28 18:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a925cbb1-bf69-5d61-a8f0-ec76ac647156 with identifier: VP25295
2026-03-28 18:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a925cbb1-bf69-5d61-a8f0-ec76ac647156 with scrape type 2
2026-03-28 18:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a925cbb1-bf69-5d61-a8f0-ec76ac647156 with scrape type 2
2026-03-28 18:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a925cbb1-bf69-5d61-a8f0-ec76ac647156, identifier: VP25295
2026-03-28 18:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a925cbb1-bf69-5d61-a8f0-ec76ac647156 with identifier: VP25295
2026-03-28 18:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a925cbb1-bf69-5d61-a8f0-ec76ac647156 with identifier: VP25295
2026-03-28 18:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a925cbb1-bf69-5d61-a8f0-ec76ac647156 with identifier: VP25295 to the API
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:07:14Z',
 'fuel_type': 'diesel',
 'id': 'a925cbb1-bf69-5d61-a8f0-ec76ac647156',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP25295',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 104089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-04',
 'seller_name': None,
 'title': 'Opel Vivaro 2.0 Diesel M Edition L2',
 'transmission': 'manual',
 'trim': 'M Edition L2',
 'year': 2020}
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP25295%27 HTTP/1.1" 200 None
2026-03-28 18:39:19 [auto1.de] INFO: Saving data for VP25295: {'auction_closing_time': 1774883234.0, 'created_time': 1774034785.766573, 'last_price_update_time': 1774723159.234362}
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP25295') HTTP/1.1" 204 0
2026-03-28 18:39:19 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-28 18:39:19 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-28 18:39:19 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-28 18:39:19 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-28 18:39:19 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-28 18:39:19 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE77804%27 HTTP/1.1" 200 None
2026-03-28 18:39:19 [auto1.de] INFO: Scrape type for DE77804: 0
2026-03-28 18:39:19 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG76834%27 HTTP/1.1" 200 None
2026-03-28 18:39:19 [auto1.de] INFO: Scrape type for RG76834: 0
2026-03-28 18:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:20 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN63665%27 HTTP/1.1" 200 None
2026-03-28 18:39:20 [auto1.de] INFO: Scrape type for MN63665: 0
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH84573%27 HTTP/1.1" 200 None
2026-03-28 18:39:20 [auto1.de] INFO: Scrape type for WH84573: 0
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL94841%27 HTTP/1.1" 200 None
2026-03-28 18:39:20 [auto1.de] INFO: Scrape type for JL94841: 0
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC01296%27 HTTP/1.1" 200 None
2026-03-28 18:39:20 [auto1.de] INFO: Scrape type for KC01296: 0
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV77064%27 HTTP/1.1" 200 None
2026-03-28 18:39:20 [auto1.de] INFO: Scrape type for MV77064: 2
2026-03-28 18:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with identifier: MV77064
2026-03-28 18:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with scrape type 2
2026-03-28 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with scrape type 2
2026-03-28 18:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713, identifier: MV77064
2026-03-28 18:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with identifier: MV77064
2026-03-28 18:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with identifier: MV77064
2026-03-28 18:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with identifier: MV77064 to the API
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:17:22Z',
 'fuel_type': 'petrol',
 'id': '7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV77064',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 96524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-02',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV77064%27 HTTP/1.1" 200 None
2026-03-28 18:39:20 [auto1.de] INFO: Saving data for MV77064: {'auction_closing_time': 1774883842.0, 'created_time': 1774522109.583671, 'last_price_update_time': 1774723160.83791}
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV77064') HTTP/1.1" 204 0
2026-03-28 18:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX99530%27 HTTP/1.1" 200 None
2026-03-28 18:39:20 [auto1.de] INFO: Scrape type for MX99530: 0
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78580%27 HTTP/1.1" 200 None
2026-03-28 18:39:20 [auto1.de] INFO: Scrape type for UC78580: 0
2026-03-28 18:39:20 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ18082%27 HTTP/1.1" 200 None
2026-03-28 18:39:21 [auto1.de] INFO: Scrape type for HZ18082: 0
2026-03-28 18:39:21 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-28 18:39:21 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-28 18:39:21 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-28 18:39:21 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV22200%27 HTTP/1.1" 200 None
2026-03-28 18:39:21 [auto1.de] INFO: Scrape type for KV22200: 0
2026-03-28 18:39:21 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-28 18:39:21 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46979%27 HTTP/1.1" 200 None
2026-03-28 18:39:21 [auto1.de] INFO: Scrape type for MV46979: 0
2026-03-28 18:39:21 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB52644%27 HTTP/1.1" 200 None
2026-03-28 18:39:21 [auto1.de] INFO: Scrape type for YB52644: 0
2026-03-28 18:39:21 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-28 18:39:21 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34786%27 HTTP/1.1" 200 None
2026-03-28 18:39:21 [auto1.de] INFO: Scrape type for SH34786: 0
2026-03-28 18:39:21 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN48846%27 HTTP/1.1" 200 None
2026-03-28 18:39:21 [auto1.de] INFO: Scrape type for WN48846: 2
2026-03-28 18:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7612d11-eb98-5f46-ad3b-e9312df7467a with identifier: WN48846
2026-03-28 18:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7612d11-eb98-5f46-ad3b-e9312df7467a with scrape type 2
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7612d11-eb98-5f46-ad3b-e9312df7467a with scrape type 2
2026-03-28 18:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7612d11-eb98-5f46-ad3b-e9312df7467a, identifier: WN48846
2026-03-28 18:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7612d11-eb98-5f46-ad3b-e9312df7467a with identifier: WN48846
2026-03-28 18:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7612d11-eb98-5f46-ad3b-e9312df7467a with identifier: WN48846
2026-03-28 18:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7612d11-eb98-5f46-ad3b-e9312df7467a with identifier: WN48846 to the API
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:36:35Z',
 'fuel_type': 'petrol',
 'id': 'a7612d11-eb98-5f46-ad3b-e9312df7467a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN48846',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 166061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-14',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2014}
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN48846%27 HTTP/1.1" 200 None
2026-03-28 18:39:21 [auto1.de] INFO: Saving data for WN48846: {'auction_closing_time': 1774884995.0, 'created_time': 1774636746.308072, 'last_price_update_time': 1774723161.50077}
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN48846') HTTP/1.1" 204 0
2026-03-28 18:39:21 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42384%27 HTTP/1.1" 200 None
2026-03-28 18:39:21 [auto1.de] INFO: Scrape type for WA42384: 2
2026-03-28 18:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9526d42-f1fe-5cdb-a85b-96087e793b12 with identifier: WA42384
2026-03-28 18:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9526d42-f1fe-5cdb-a85b-96087e793b12 with scrape type 2
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9526d42-f1fe-5cdb-a85b-96087e793b12 with scrape type 2
2026-03-28 18:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9526d42-f1fe-5cdb-a85b-96087e793b12, identifier: WA42384
2026-03-28 18:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9526d42-f1fe-5cdb-a85b-96087e793b12 with identifier: WA42384
2026-03-28 18:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9526d42-f1fe-5cdb-a85b-96087e793b12 with identifier: WA42384
2026-03-28 18:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9526d42-f1fe-5cdb-a85b-96087e793b12 with identifier: WA42384 to the API
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:54Z',
 'fuel_type': 'diesel',
 'id': 'b9526d42-f1fe-5cdb-a85b-96087e793b12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA42384',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 16263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-03',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2024}
2026-03-28 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42384%27 HTTP/1.1" 200 None
2026-03-28 18:39:22 [auto1.de] INFO: Saving data for WA42384: {'auction_closing_time': 1774884534.0, 'created_time': 1774522197.946207, 'last_price_update_time': 1774723162.07251}
2026-03-28 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA42384') HTTP/1.1" 204 0
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-28 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24808%27 HTTP/1.1" 200 None
2026-03-28 18:39:22 [auto1.de] INFO: Scrape type for UG24808: 0
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-28 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM78825%27 HTTP/1.1" 200 None
2026-03-28 18:39:22 [auto1.de] INFO: Scrape type for BM78825: 0
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-28 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD28635%27 HTTP/1.1" 200 None
2026-03-28 18:39:22 [auto1.de] INFO: Scrape type for WD28635: 0
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-28 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR91976%27 HTTP/1.1" 200 None
2026-03-28 18:39:22 [auto1.de] INFO: Scrape type for GR91976: 0
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-28 18:39:22 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:23 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:23 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78984%27 HTTP/1.1" 200 None
2026-03-28 18:39:23 [auto1.de] INFO: Scrape type for FM78984: 2
2026-03-28 18:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e0f6b8f-8693-514f-83ad-6057e8d509fd with identifier: FM78984
2026-03-28 18:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e0f6b8f-8693-514f-83ad-6057e8d509fd with scrape type 2
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e0f6b8f-8693-514f-83ad-6057e8d509fd with scrape type 2
2026-03-28 18:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e0f6b8f-8693-514f-83ad-6057e8d509fd, identifier: FM78984
2026-03-28 18:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e0f6b8f-8693-514f-83ad-6057e8d509fd with identifier: FM78984
2026-03-28 18:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e0f6b8f-8693-514f-83ad-6057e8d509fd with identifier: FM78984
2026-03-28 18:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e0f6b8f-8693-514f-83ad-6057e8d509fd with identifier: FM78984 to the API
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:57:05Z',
 'fuel_type': 'diesel',
 'id': '5e0f6b8f-8693-514f-83ad-6057e8d509fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM78984',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 180429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Prestige',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2018}
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78984%27 HTTP/1.1" 200 None
2026-03-28 18:39:23 [auto1.de] INFO: Saving data for FM78984: {'auction_closing_time': 1774886225.0, 'created_time': 1774521527.218854, 'last_price_update_time': 1774723163.616164}
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM78984') HTTP/1.1" 204 0
2026-03-28 18:39:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:23 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN62521%27 HTTP/1.1" 200 None
2026-03-28 18:39:23 [auto1.de] INFO: Scrape type for NN62521: 0
2026-03-28 18:39:23 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-28 18:39:23 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA12198%27 HTTP/1.1" 200 None
2026-03-28 18:39:23 [auto1.de] INFO: Scrape type for DA12198: 0
2026-03-28 18:39:23 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-28 18:39:23 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-28 18:39:23 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL40939%27 HTTP/1.1" 200 None
2026-03-28 18:39:23 [auto1.de] INFO: Scrape type for TL40939: 0
2026-03-28 18:39:23 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG03972%27 HTTP/1.1" 200 None
2026-03-28 18:39:23 [auto1.de] INFO: Scrape type for BG03972: 0
2026-03-28 18:39:23 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY48346%27 HTTP/1.1" 200 None
2026-03-28 18:39:23 [auto1.de] INFO: Scrape type for HY48346: 0
2026-03-28 18:39:23 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-28 18:39:23 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL44466%27 HTTP/1.1" 200 None
2026-03-28 18:39:23 [auto1.de] INFO: Scrape type for YL44466: 0
2026-03-28 18:39:23 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-28 18:39:23 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF79768%27 HTTP/1.1" 200 None
2026-03-28 18:39:23 [auto1.de] INFO: Scrape type for KF79768: 2
2026-03-28 18:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdb52312-98e2-5243-ae12-319f19f84c31 with identifier: KF79768
2026-03-28 18:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdb52312-98e2-5243-ae12-319f19f84c31 with scrape type 2
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdb52312-98e2-5243-ae12-319f19f84c31 with scrape type 2
2026-03-28 18:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdb52312-98e2-5243-ae12-319f19f84c31, identifier: KF79768
2026-03-28 18:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdb52312-98e2-5243-ae12-319f19f84c31 with identifier: KF79768
2026-03-28 18:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdb52312-98e2-5243-ae12-319f19f84c31 with identifier: KF79768
2026-03-28 18:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdb52312-98e2-5243-ae12-319f19f84c31 with identifier: KF79768 to the API
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:49:41Z',
 'fuel_type': 'petrol',
 'id': 'bdb52312-98e2-5243-ae12-319f19f84c31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF79768',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 196056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-31',
 'seller_name': None,
 'title': 'Audi A1 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF79768%27 HTTP/1.1" 200 None
2026-03-28 18:39:24 [auto1.de] INFO: Saving data for KF79768: {'auction_closing_time': 1774885781.0, 'created_time': 1774521895.79806, 'last_price_update_time': 1774723164.214745}
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF79768') HTTP/1.1" 204 0
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX46071%27 HTTP/1.1" 200 None
2026-03-28 18:39:24 [auto1.de] INFO: Scrape type for CX46071: 0
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC54286%27 HTTP/1.1" 200 None
2026-03-28 18:39:24 [auto1.de] INFO: Scrape type for PC54286: 0
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB91178%27 HTTP/1.1" 200 None
2026-03-28 18:39:24 [auto1.de] INFO: Scrape type for JB91178: 0
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ50241%27 HTTP/1.1" 200 None
2026-03-28 18:39:24 [auto1.de] INFO: Scrape type for SZ50241: 0
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13548%27 HTTP/1.1" 200 None
2026-03-28 18:39:24 [auto1.de] INFO: Scrape type for RR13548: 0
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG47191%27 HTTP/1.1" 200 None
2026-03-28 18:39:24 [auto1.de] INFO: Scrape type for TG47191: 2
2026-03-28 18:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with identifier: TG47191
2026-03-28 18:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with scrape type 2
2026-03-28 18:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with scrape type 2
2026-03-28 18:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1, identifier: TG47191
2026-03-28 18:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with identifier: TG47191
2026-03-28 18:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with identifier: TG47191
2026-03-28 18:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with identifier: TG47191 to the API
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:19:51Z',
 'fuel_type': 'petrol',
 'id': 'fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG47191',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 208620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-31',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2008}
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG47191%27 HTTP/1.1" 200 None
2026-03-28 18:39:24 [auto1.de] INFO: Saving data for TG47191: {'auction_closing_time': 1774883991.0, 'created_time': 1774034980.84504, 'last_price_update_time': 1774723164.846685}
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG47191') HTTP/1.1" 204 0
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-28 18:39:24 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW82332%27 HTTP/1.1" 200 None
2026-03-28 18:39:24 [auto1.de] INFO: Scrape type for RW82332: 2
2026-03-28 18:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with identifier: RW82332
2026-03-28 18:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with scrape type 2
2026-03-28 18:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with scrape type 2
2026-03-28 18:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33, identifier: RW82332
2026-03-28 18:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with identifier: RW82332
2026-03-28 18:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with identifier: RW82332
2026-03-28 18:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with identifier: RW82332 to the API
2026-03-28 18:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:50:55Z',
 'fuel_type': 'petrol',
 'id': '6b80cd1b-b103-5c3f-8aa8-1e961a218e33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW82332',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 64132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-12',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2015}
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW82332%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [auto1.de] INFO: Saving data for RW82332: {'auction_closing_time': 1774885855.0, 'created_time': 1774522296.620677, 'last_price_update_time': 1774723166.165401}
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW82332') HTTP/1.1" 204 0
2026-03-28 18:39:26 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-28 18:39:26 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV10923%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [auto1.de] INFO: Scrape type for ZV10923: 0
2026-03-28 18:39:26 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-28 18:39:26 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN11150%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [auto1.de] INFO: Scrape type for YN11150: 2
2026-03-28 18:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d47f2394-b127-55c2-870b-e69723767512 with identifier: YN11150
2026-03-28 18:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d47f2394-b127-55c2-870b-e69723767512 with scrape type 2
2026-03-28 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d47f2394-b127-55c2-870b-e69723767512 with scrape type 2
2026-03-28 18:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d47f2394-b127-55c2-870b-e69723767512, identifier: YN11150
2026-03-28 18:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d47f2394-b127-55c2-870b-e69723767512 with identifier: YN11150
2026-03-28 18:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d47f2394-b127-55c2-870b-e69723767512 with identifier: YN11150
2026-03-28 18:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d47f2394-b127-55c2-870b-e69723767512 with identifier: YN11150 to the API
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:00:11Z',
 'fuel_type': 'petrol',
 'id': 'd47f2394-b127-55c2-870b-e69723767512',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN11150',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 45610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-18',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Edition 100',
 'transmission': 'manual',
 'trim': 'Edition 100',
 'year': 2018}
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN11150%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [auto1.de] INFO: Saving data for YN11150: {'auction_closing_time': 1774882811.0, 'created_time': 1774521938.857293, 'last_price_update_time': 1774723166.625859}
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN11150') HTTP/1.1" 204 0
2026-03-28 18:39:26 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-28 18:39:26 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55380%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [auto1.de] INFO: Scrape type for LV55380: 0
2026-03-28 18:39:26 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ95747%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [auto1.de] INFO: Scrape type for HZ95747: 0
2026-03-28 18:39:26 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ73659%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [auto1.de] INFO: Scrape type for RJ73659: 0
2026-03-28 18:39:26 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-28 18:39:26 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS97689%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [auto1.de] INFO: Scrape type for BS97689: 0
2026-03-28 18:39:26 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ03157%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [auto1.de] INFO: Scrape type for FZ03157: 0
2026-03-28 18:39:26 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-28 18:39:26 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-28 18:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:27 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:27 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD43211%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [auto1.de] INFO: Scrape type for HD43211: 0
2026-03-28 18:39:27 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD76424%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [auto1.de] INFO: Scrape type for BD76424: 2
2026-03-28 18:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 252a5b09-c158-5aa1-88db-cb4a031271d7 with identifier: BD76424
2026-03-28 18:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 252a5b09-c158-5aa1-88db-cb4a031271d7 with scrape type 2
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 252a5b09-c158-5aa1-88db-cb4a031271d7 with scrape type 2
2026-03-28 18:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 252a5b09-c158-5aa1-88db-cb4a031271d7, identifier: BD76424
2026-03-28 18:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 252a5b09-c158-5aa1-88db-cb4a031271d7 with identifier: BD76424
2026-03-28 18:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 252a5b09-c158-5aa1-88db-cb4a031271d7 with identifier: BD76424
2026-03-28 18:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 252a5b09-c158-5aa1-88db-cb4a031271d7 with identifier: BD76424 to the API
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-30T15:34:51Z',
 'fuel_type': 'petrol',
 'id': '252a5b09-c158-5aa1-88db-cb4a031271d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD76424',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 105369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-21',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2019}
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD76424%27 HTTP/1.1" 200 None
2026-03-28 18:39:28 [auto1.de] INFO: Saving data for BD76424: {'auction_closing_time': 1774884891.0, 'created_time': 1773945748.069152, 'last_price_update_time': 1774723168.062783}
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD76424') HTTP/1.1" 204 0
2026-03-28 18:39:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:28 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71563%27 HTTP/1.1" 200 None
2026-03-28 18:39:28 [auto1.de] INFO: Scrape type for KZ71563: 0
2026-03-28 18:39:28 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL45023%27 HTTP/1.1" 200 None
2026-03-28 18:39:28 [auto1.de] INFO: Scrape type for SL45023: 0
2026-03-28 18:39:28 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK80095%27 HTTP/1.1" 200 None
2026-03-28 18:39:28 [auto1.de] INFO: Scrape type for LK80095: 0
2026-03-28 18:39:28 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-28 18:39:28 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-28 18:39:28 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75545%27 HTTP/1.1" 200 None
2026-03-28 18:39:28 [auto1.de] INFO: Scrape type for YR75545: 0
2026-03-28 18:39:28 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-28 18:39:28 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA14963%27 HTTP/1.1" 200 None
2026-03-28 18:39:28 [auto1.de] INFO: Scrape type for HA14963: 0
2026-03-28 18:39:28 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM30450%27 HTTP/1.1" 200 None
2026-03-28 18:39:28 [auto1.de] INFO: Scrape type for CM30450: 2
2026-03-28 18:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db2e181e-743a-5f4b-9171-9e0ec8f50619 with identifier: CM30450
2026-03-28 18:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db2e181e-743a-5f4b-9171-9e0ec8f50619 with scrape type 2
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db2e181e-743a-5f4b-9171-9e0ec8f50619 with scrape type 2
2026-03-28 18:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db2e181e-743a-5f4b-9171-9e0ec8f50619, identifier: CM30450
2026-03-28 18:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db2e181e-743a-5f4b-9171-9e0ec8f50619 with identifier: CM30450
2026-03-28 18:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db2e181e-743a-5f4b-9171-9e0ec8f50619 with identifier: CM30450
2026-03-28 18:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db2e181e-743a-5f4b-9171-9e0ec8f50619 with identifier: CM30450 to the API
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:30:45Z',
 'fuel_type': 'diesel',
 'id': 'db2e181e-743a-5f4b-9171-9e0ec8f50619',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM30450',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 156152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM30450%27 HTTP/1.1" 200 None
2026-03-28 18:39:28 [auto1.de] INFO: Saving data for CM30450: {'auction_closing_time': 1774884645.0, 'created_time': 1774002320.389249, 'last_price_update_time': 1774723168.673064}
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM30450') HTTP/1.1" 204 0
2026-03-28 18:39:28 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-28 18:39:28 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP38143%27 HTTP/1.1" 200 None
2026-03-28 18:39:28 [auto1.de] INFO: Scrape type for BP38143: 0
2026-03-28 18:39:28 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX32204%27 HTTP/1.1" 200 None
2026-03-28 18:39:28 [auto1.de] INFO: Scrape type for GX32204: 2
2026-03-28 18:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30df28bb-8bda-51c7-b7c1-07c6ff626245 with identifier: GX32204
2026-03-28 18:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30df28bb-8bda-51c7-b7c1-07c6ff626245 with scrape type 2
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30df28bb-8bda-51c7-b7c1-07c6ff626245 with scrape type 2
2026-03-28 18:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30df28bb-8bda-51c7-b7c1-07c6ff626245, identifier: GX32204
2026-03-28 18:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30df28bb-8bda-51c7-b7c1-07c6ff626245 with identifier: GX32204
2026-03-28 18:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30df28bb-8bda-51c7-b7c1-07c6ff626245 with identifier: GX32204
2026-03-28 18:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30df28bb-8bda-51c7-b7c1-07c6ff626245 with identifier: GX32204 to the API
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:11:40Z',
 'fuel_type': 'diesel',
 'id': '30df28bb-8bda-51c7-b7c1-07c6ff626245',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX32204',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 121240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-08',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX32204%27 HTTP/1.1" 200 None
2026-03-28 18:39:29 [auto1.de] INFO: Saving data for GX32204: {'auction_closing_time': 1774883500.0, 'created_time': 1774033971.482983, 'last_price_update_time': 1774723169.121597}
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX32204') HTTP/1.1" 204 0
2026-03-28 18:39:29 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-28 18:39:29 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-28 18:39:29 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-28 18:39:29 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-28 18:39:29 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25928%27 HTTP/1.1" 200 None
2026-03-28 18:39:29 [auto1.de] INFO: Scrape type for UA25928: 2
2026-03-28 18:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with identifier: UA25928
2026-03-28 18:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with scrape type 2
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with scrape type 2
2026-03-28 18:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62b3fb57-2898-58b7-b0a6-a3d5520b4883, identifier: UA25928
2026-03-28 18:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with identifier: UA25928
2026-03-28 18:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with identifier: UA25928
2026-03-28 18:39:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with identifier: UA25928 to the API
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:10:11Z',
 'fuel_type': 'petrol',
 'id': '62b3fb57-2898-58b7-b0a6-a3d5520b4883',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA25928',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 131658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-30',
 'seller_name': None,
 'title': 'BMW 3er 325i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2006}
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25928%27 HTTP/1.1" 200 None
2026-03-28 18:39:29 [auto1.de] INFO: Saving data for UA25928: {'auction_closing_time': 1774883411.0, 'created_time': 1774522813.919324, 'last_price_update_time': 1774723169.741035}
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA25928') HTTP/1.1" 204 0
2026-03-28 18:39:29 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT24864%27 HTTP/1.1" 200 None
2026-03-28 18:39:29 [auto1.de] INFO: Scrape type for GT24864: 2
2026-03-28 18:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d78ae10-c22e-5193-8245-4e06fddae7d3 with identifier: GT24864
2026-03-28 18:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d78ae10-c22e-5193-8245-4e06fddae7d3 with scrape type 2
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d78ae10-c22e-5193-8245-4e06fddae7d3 with scrape type 2
2026-03-28 18:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d78ae10-c22e-5193-8245-4e06fddae7d3, identifier: GT24864
2026-03-28 18:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d78ae10-c22e-5193-8245-4e06fddae7d3 with identifier: GT24864
2026-03-28 18:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d78ae10-c22e-5193-8245-4e06fddae7d3 with identifier: GT24864
2026-03-28 18:39:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d78ae10-c22e-5193-8245-4e06fddae7d3 with identifier: GT24864 to the API
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:34Z',
 'fuel_type': 'petrol',
 'id': '8d78ae10-c22e-5193-8245-4e06fddae7d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT24864',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 38158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2021}
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT24864%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Saving data for GT24864: {'auction_closing_time': 1774886254.0, 'created_time': 1774522648.065157, 'last_price_update_time': 1774723170.214466}
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT24864') HTTP/1.1" 204 0
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB57575%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Scrape type for HB57575: 0
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF58190%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Scrape type for UF58190: 0
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG65874%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Scrape type for GG65874: 0
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV42869%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Scrape type for RV42869: 0
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15164%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Scrape type for TB15164: 0
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL15511%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Scrape type for AL15511: 0
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA93244%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Scrape type for ZA93244: 2
2026-03-28 18:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b6ee588-5e0b-5011-979b-c0fe9064406c with identifier: ZA93244
2026-03-28 18:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b6ee588-5e0b-5011-979b-c0fe9064406c with scrape type 2
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b6ee588-5e0b-5011-979b-c0fe9064406c with scrape type 2
2026-03-28 18:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b6ee588-5e0b-5011-979b-c0fe9064406c, identifier: ZA93244
2026-03-28 18:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b6ee588-5e0b-5011-979b-c0fe9064406c with identifier: ZA93244
2026-03-28 18:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b6ee588-5e0b-5011-979b-c0fe9064406c with identifier: ZA93244
2026-03-28 18:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b6ee588-5e0b-5011-979b-c0fe9064406c with identifier: ZA93244 to the API
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:59:52Z',
 'fuel_type': 'petrol',
 'id': '9b6ee588-5e0b-5011-979b-c0fe9064406c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA93244',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 102521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-15',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA93244%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Saving data for ZA93244: {'auction_closing_time': 1774886392.0, 'created_time': 1774636768.764003, 'last_price_update_time': 1774723170.756599}
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA93244') HTTP/1.1" 204 0
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM92203%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Scrape type for WM92203: 0
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82435%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Scrape type for PS82435: 0
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN06101%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Scrape type for CN06101: 0
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: NK87306
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK87306%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Scrape type for NK87306: 1
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG36538%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Scrape type for DG36538: 0
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG20268%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Scrape type for KG20268: 0
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-28 18:39:30 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90215%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [auto1.de] INFO: Scrape type for UZ90215: 0
2026-03-28 18:39:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:31 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU93536%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [auto1.de] INFO: Scrape type for HU93536: 0
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF09029%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [auto1.de] INFO: Scrape type for GF09029: 0
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ10151%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [auto1.de] INFO: Scrape type for PZ10151: 0
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: JC65588
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE03495%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [auto1.de] INFO: Scrape type for AE03495: 2
2026-03-28 18:39:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with identifier: AE03495
2026-03-28 18:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with scrape type 2
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with scrape type 2
2026-03-28 18:39:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4, identifier: AE03495
2026-03-28 18:39:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with identifier: AE03495
2026-03-28 18:39:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with identifier: AE03495
2026-03-28 18:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with identifier: AE03495 to the API
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:36:12Z',
 'fuel_type': 'diesel',
 'id': '1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE03495',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 133856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-23',
 'seller_name': None,
 'title': 'Audi A5 Sportback 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE03495%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [auto1.de] INFO: Saving data for AE03495: {'auction_closing_time': 1774884972.0, 'created_time': 1774521494.378935, 'last_price_update_time': 1774723171.756302}
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE03495') HTTP/1.1" 204 0
2026-03-28 18:39:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP24575%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [auto1.de] INFO: Scrape type for BP24575: 0
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY22593%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [auto1.de] INFO: Scrape type for VY22593: 0
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG87332%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [auto1.de] INFO: Scrape type for LG87332: 0
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW77788%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [auto1.de] INFO: Scrape type for SW77788: 0
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42199%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [auto1.de] INFO: Scrape type for XT42199: 0
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA64656%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [auto1.de] INFO: Scrape type for JA64656: 0
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-28 18:39:31 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-28 18:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:32 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:32 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-28 18:39:32 [auto1.de] INFO: Found listing with ID: RM72626
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM72626%27 HTTP/1.1" 200 None
2026-03-28 18:39:32 [auto1.de] INFO: Scrape type for RM72626: 2
2026-03-28 18:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20fd10a1-15e7-5bed-9eaf-14872445ed25 with identifier: RM72626
2026-03-28 18:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20fd10a1-15e7-5bed-9eaf-14872445ed25 with scrape type 2
2026-03-28 18:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20fd10a1-15e7-5bed-9eaf-14872445ed25 with scrape type 2
2026-03-28 18:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20fd10a1-15e7-5bed-9eaf-14872445ed25, identifier: RM72626
2026-03-28 18:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20fd10a1-15e7-5bed-9eaf-14872445ed25 with identifier: RM72626
2026-03-28 18:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20fd10a1-15e7-5bed-9eaf-14872445ed25 with identifier: RM72626
2026-03-28 18:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20fd10a1-15e7-5bed-9eaf-14872445ed25 with identifier: RM72626 to the API
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:21:56Z',
 'fuel_type': 'diesel',
 'id': '20fd10a1-15e7-5bed-9eaf-14872445ed25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM72626',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 179216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-30',
 'seller_name': None,
 'title': 'Opel Vivaro 2.0 CDTI Kasten L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,7t',
 'year': 2012}
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM72626%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [auto1.de] INFO: Saving data for RM72626: {'auction_closing_time': 1774884116.0, 'created_time': 1773381169.44772, 'last_price_update_time': 1774723173.380198}
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM72626') HTTP/1.1" 204 0
2026-03-28 18:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:33 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS43563%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [auto1.de] INFO: Scrape type for XS43563: 2
2026-03-28 18:39:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f74628-013a-543b-97f9-e050c19bc70e with identifier: XS43563
2026-03-28 18:39:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81f74628-013a-543b-97f9-e050c19bc70e with scrape type 2
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81f74628-013a-543b-97f9-e050c19bc70e with scrape type 2
2026-03-28 18:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81f74628-013a-543b-97f9-e050c19bc70e, identifier: XS43563
2026-03-28 18:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81f74628-013a-543b-97f9-e050c19bc70e with identifier: XS43563
2026-03-28 18:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81f74628-013a-543b-97f9-e050c19bc70e with identifier: XS43563
2026-03-28 18:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81f74628-013a-543b-97f9-e050c19bc70e with identifier: XS43563 to the API
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:32:00Z',
 'fuel_type': 'petrol',
 'id': '81f74628-013a-543b-97f9-e050c19bc70e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS43563',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 92183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-12',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2017}
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS43563%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [auto1.de] INFO: Saving data for XS43563: {'auction_closing_time': 1774884720.0, 'created_time': 1774522020.128607, 'last_price_update_time': 1774723173.94686}
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS43563') HTTP/1.1" 204 0
2026-03-28 18:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK87306/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:33 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB65040%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [auto1.de] INFO: Scrape type for VB65040: 0
2026-03-28 18:39:33 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-28 18:39:33 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-28 18:39:33 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-28 18:39:33 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-28 18:39:33 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH95210%27 HTTP/1.1" 200 None
2026-03-28 18:39:34 [auto1.de] INFO: Scrape type for UH95210: 2
2026-03-28 18:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b20eb71d-629e-5e70-a761-54561d5e66f0 with identifier: UH95210
2026-03-28 18:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b20eb71d-629e-5e70-a761-54561d5e66f0 with scrape type 2
2026-03-28 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b20eb71d-629e-5e70-a761-54561d5e66f0 with scrape type 2
2026-03-28 18:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b20eb71d-629e-5e70-a761-54561d5e66f0, identifier: UH95210
2026-03-28 18:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b20eb71d-629e-5e70-a761-54561d5e66f0 with identifier: UH95210
2026-03-28 18:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b20eb71d-629e-5e70-a761-54561d5e66f0 with identifier: UH95210
2026-03-28 18:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b20eb71d-629e-5e70-a761-54561d5e66f0 with identifier: UH95210 to the API
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:43:20Z',
 'fuel_type': 'diesel',
 'id': 'b20eb71d-629e-5e70-a761-54561d5e66f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH95210',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 151560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-24',
 'seller_name': None,
 'title': 'BMW 5er 535d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH95210%27 HTTP/1.1" 200 None
2026-03-28 18:39:34 [auto1.de] INFO: Saving data for UH95210: {'auction_closing_time': 1774885400.0, 'created_time': 1774350587.324075, 'last_price_update_time': 1774723174.466887}
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH95210') HTTP/1.1" 204 0
2026-03-28 18:39:34 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT81151%27 HTTP/1.1" 200 None
2026-03-28 18:39:34 [auto1.de] INFO: Scrape type for GT81151: 2
2026-03-28 18:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd25ecaa-5dd7-5ac7-bd02-669695c638bb with identifier: GT81151
2026-03-28 18:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd25ecaa-5dd7-5ac7-bd02-669695c638bb with scrape type 2
2026-03-28 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd25ecaa-5dd7-5ac7-bd02-669695c638bb with scrape type 2
2026-03-28 18:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd25ecaa-5dd7-5ac7-bd02-669695c638bb, identifier: GT81151
2026-03-28 18:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd25ecaa-5dd7-5ac7-bd02-669695c638bb with identifier: GT81151
2026-03-28 18:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd25ecaa-5dd7-5ac7-bd02-669695c638bb with identifier: GT81151
2026-03-28 18:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd25ecaa-5dd7-5ac7-bd02-669695c638bb with identifier: GT81151 to the API
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:29:52Z',
 'fuel_type': 'diesel',
 'id': 'cd25ecaa-5dd7-5ac7-bd02-669695c638bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT81151',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 266127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-31',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2016}
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT81151%27 HTTP/1.1" 200 None
2026-03-28 18:39:34 [auto1.de] INFO: Saving data for GT81151: {'auction_closing_time': 1774884592.0, 'created_time': 1773945997.534217, 'last_price_update_time': 1774723174.958815}
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT81151') HTTP/1.1" 204 0
2026-03-28 18:39:34 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-28 18:39:34 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR69108%27 HTTP/1.1" 200 None
2026-03-28 18:39:34 [auto1.de] INFO: Scrape type for DR69108: 0
2026-03-28 18:39:34 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE02336%27 HTTP/1.1" 200 None
2026-03-28 18:39:35 [auto1.de] INFO: Scrape type for FE02336: 0
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ48017%27 HTTP/1.1" 200 None
2026-03-28 18:39:35 [auto1.de] INFO: Scrape type for MJ48017: 0
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG94250%27 HTTP/1.1" 200 None
2026-03-28 18:39:35 [auto1.de] INFO: Scrape type for MG94250: 0
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG55582%27 HTTP/1.1" 200 None
2026-03-28 18:39:35 [auto1.de] INFO: Scrape type for FG55582: 2
2026-03-28 18:39:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a18a460-e9df-5093-9042-55aa5d39d04b with identifier: FG55582
2026-03-28 18:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a18a460-e9df-5093-9042-55aa5d39d04b with scrape type 2
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a18a460-e9df-5093-9042-55aa5d39d04b with scrape type 2
2026-03-28 18:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a18a460-e9df-5093-9042-55aa5d39d04b, identifier: FG55582
2026-03-28 18:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a18a460-e9df-5093-9042-55aa5d39d04b with identifier: FG55582
2026-03-28 18:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a18a460-e9df-5093-9042-55aa5d39d04b with identifier: FG55582
2026-03-28 18:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a18a460-e9df-5093-9042-55aa5d39d04b with identifier: FG55582 to the API
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:17:20Z',
 'fuel_type': 'petrol',
 'id': '0a18a460-e9df-5093-9042-55aa5d39d04b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG55582',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 108085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-05',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG55582%27 HTTP/1.1" 200 None
2026-03-28 18:39:35 [auto1.de] INFO: Saving data for FG55582: {'auction_closing_time': 1774883840.0, 'created_time': 1774636728.053953, 'last_price_update_time': 1774723175.47267}
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG55582') HTTP/1.1" 204 0
2026-03-28 18:39:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99785%27 HTTP/1.1" 200 None
2026-03-28 18:39:35 [auto1.de] INFO: Scrape type for YK99785: 0
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH51511%27 HTTP/1.1" 200 None
2026-03-28 18:39:35 [auto1.de] INFO: Scrape type for CH51511: 0
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR34047%27 HTTP/1.1" 200 None
2026-03-28 18:39:35 [auto1.de] INFO: Scrape type for GR34047: 0
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71981%27 HTTP/1.1" 200 None
2026-03-28 18:39:35 [auto1.de] INFO: Scrape type for GE71981: 0
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX17782%27 HTTP/1.1" 200 None
2026-03-28 18:39:35 [auto1.de] INFO: Scrape type for RX17782: 0
2026-03-28 18:39:35 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB32538%27 HTTP/1.1" 200 None
2026-03-28 18:39:35 [auto1.de] INFO: Scrape type for KB32538: 2
2026-03-28 18:39:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 071cb01b-3ab6-5913-99bf-5cfcde11d767 with identifier: KB32538
2026-03-28 18:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 071cb01b-3ab6-5913-99bf-5cfcde11d767 with scrape type 2
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 071cb01b-3ab6-5913-99bf-5cfcde11d767 with scrape type 2
2026-03-28 18:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 071cb01b-3ab6-5913-99bf-5cfcde11d767, identifier: KB32538
2026-03-28 18:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 071cb01b-3ab6-5913-99bf-5cfcde11d767 with identifier: KB32538
2026-03-28 18:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 071cb01b-3ab6-5913-99bf-5cfcde11d767 with identifier: KB32538
2026-03-28 18:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 071cb01b-3ab6-5913-99bf-5cfcde11d767 with identifier: KB32538 to the API
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:43Z',
 'fuel_type': 'petrol',
 'id': '071cb01b-3ab6-5913-99bf-5cfcde11d767',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB32538',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 113398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-17',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2017}
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB32538%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [auto1.de] INFO: Saving data for KB32538: {'auction_closing_time': 1774883863.0, 'created_time': 1774522249.387904, 'last_price_update_time': 1774723176.105459}
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB32538') HTTP/1.1" 204 0
2026-03-28 18:39:36 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR65686%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [auto1.de] INFO: Scrape type for FR65686: 0
2026-03-28 18:39:36 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN13100%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [auto1.de] INFO: Scrape type for SN13100: 2
2026-03-28 18:39:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5edc0772-3a9a-52f2-9586-fe59203fabc7 with identifier: SN13100
2026-03-28 18:39:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5edc0772-3a9a-52f2-9586-fe59203fabc7 with scrape type 2
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5edc0772-3a9a-52f2-9586-fe59203fabc7 with scrape type 2
2026-03-28 18:39:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5edc0772-3a9a-52f2-9586-fe59203fabc7, identifier: SN13100
2026-03-28 18:39:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5edc0772-3a9a-52f2-9586-fe59203fabc7 with identifier: SN13100
2026-03-28 18:39:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5edc0772-3a9a-52f2-9586-fe59203fabc7 with identifier: SN13100
2026-03-28 18:39:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5edc0772-3a9a-52f2-9586-fe59203fabc7 with identifier: SN13100 to the API
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:55:42Z',
 'fuel_type': 'petrol',
 'id': '5edc0772-3a9a-52f2-9586-fe59203fabc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN13100',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 195096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-09-30',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2001}
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN13100%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [auto1.de] INFO: Saving data for SN13100: {'auction_closing_time': 1774886142.0, 'created_time': 1773381580.527758, 'last_price_update_time': 1774723176.655419}
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN13100') HTTP/1.1" 204 0
2026-03-28 18:39:36 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-28 18:39:36 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-28 18:39:36 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV05588%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [auto1.de] INFO: Scrape type for SV05588: 2
2026-03-28 18:39:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07f75396-3e9a-5b99-8376-69ae72c8a864 with identifier: SV05588
2026-03-28 18:39:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07f75396-3e9a-5b99-8376-69ae72c8a864 with scrape type 2
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07f75396-3e9a-5b99-8376-69ae72c8a864 with scrape type 2
2026-03-28 18:39:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07f75396-3e9a-5b99-8376-69ae72c8a864, identifier: SV05588
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07f75396-3e9a-5b99-8376-69ae72c8a864 with identifier: SV05588
2026-03-28 18:39:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07f75396-3e9a-5b99-8376-69ae72c8a864 with identifier: SV05588
2026-03-28 18:39:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07f75396-3e9a-5b99-8376-69ae72c8a864 with identifier: SV05588 to the API
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:18Z',
 'fuel_type': 'diesel',
 'id': '07f75396-3e9a-5b99-8376-69ae72c8a864',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV05588',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 64815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-17',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten EcoProfi FWD',
 'transmission': 'manual',
 'trim': 'Kasten EcoProfi FWD',
 'year': 2020}
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV05588%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Saving data for SV05588: {'auction_closing_time': 1774883958.0, 'created_time': 1774636644.439762, 'last_price_update_time': 1774723177.088966}
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV05588') HTTP/1.1" 204 0
2026-03-28 18:39:37 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE51747%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for RE51747: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW87907%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for MW87907: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85495%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for VR85495: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW64157%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for XW64157: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04767%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for MM04767: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05555%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for RT05555: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77748%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for JZ77748: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC69827%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for HC69827: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50819%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for TH50819: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY47977%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for XY47977: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV79476%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for VV79476: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY86490%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for HY86490: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG24612%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for AG24612: 2
2026-03-28 18:39:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with identifier: AG24612
2026-03-28 18:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with scrape type 2
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with scrape type 2
2026-03-28 18:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc, identifier: AG24612
2026-03-28 18:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with identifier: AG24612
2026-03-28 18:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with identifier: AG24612
2026-03-28 18:39:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with identifier: AG24612 to the API
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:16Z',
 'fuel_type': 'diesel',
 'id': '83c72ebc-8b5c-5269-8ab5-656ab2f051bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG24612',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 204163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-04',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2021}
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG24612%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Saving data for AG24612: {'auction_closing_time': 1774883776.0, 'created_time': 1774521374.437965, 'last_price_update_time': 1774723177.752245}
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG24612') HTTP/1.1" 204 0
2026-03-28 18:39:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK73701%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for BK73701: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA42625%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for TA42625: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC63536%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for JC63536: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55096%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for NV55096: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF30370%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for XF30370: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE47018%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for JE47018: 0
2026-03-28 18:39:37 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ13004%27 HTTP/1.1" 200 None
2026-03-28 18:39:37 [auto1.de] INFO: Scrape type for AJ13004: 0
2026-03-28 18:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK87306> (referer: https://www.auto1.com/v1/car-details-view/NK87306/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9d39253-9880-5844-83b8-106224df9ffb with identifier: NK87306
2026-03-28 18:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d39253-9880-5844-83b8-106224df9ffb with scrape type 1
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9d39253-9880-5844-83b8-106224df9ffb
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F66%252Fdc667401065e45f8a75945db582b9fad%252Fpa%252FNK87306_d9a33fc3343589a63eb8f6682095144e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_d9a33fc3343589a63eb8f6682095144e.jpg already downloaded
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F66%252Fdc667401065e45f8a75945db582b9fad%252Fpa%252FNK87306_f04109c9a90d9cfb962d55d49c39801e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_f04109c9a90d9cfb962d55d49c39801e.jpg already downloaded
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F66%252Fdc667401065e45f8a75945db582b9fad%252Fpa%252FNK87306_2e89e898ed98c3380de734b4e84d6b0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_2e89e898ed98c3380de734b4e84d6b0f.jpg already downloaded
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F66%252Fdc667401065e45f8a75945db582b9fad%252Fpa%252FNK87306_f48bc1d847aec7bd63a0d91d73186dc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_f48bc1d847aec7bd63a0d91d73186dc8.jpg already downloaded
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F66%252Fdc667401065e45f8a75945db582b9fad%252Fpa%252FNK87306_08fdf13cbccadb20370f5f69d019ecd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_08fdf13cbccadb20370f5f69d019ecd2.jpg already downloaded
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F66%252Fdc667401065e45f8a75945db582b9fad%252Fpa%252FNK87306_91853ef56669404603b5f4c08b0895fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_91853ef56669404603b5f4c08b0895fa.jpg already downloaded
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F66%252Fdc667401065e45f8a75945db582b9fad%252Fpa%252FNK87306_1e201291330f759421018fb2b790865e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_1e201291330f759421018fb2b790865e.jpg already downloaded
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F66%252Fdc667401065e45f8a75945db582b9fad%252Fpa%252FNK87306_b8499130535309af35e7a68a6bb5c668.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_b8499130535309af35e7a68a6bb5c668.jpg already downloaded
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F66%252Fdc667401065e45f8a75945db582b9fad%252Fpa%252FNK87306_5e4663c00c91dead2b293b24d7a948b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_5e4663c00c91dead2b293b24d7a948b7.jpg already downloaded
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F66%252Fdc667401065e45f8a75945db582b9fad%252Fpa%252FNK87306_f5f48eb192ba757d63dbb07657f73a7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_f5f48eb192ba757d63dbb07657f73a7f.jpg already downloaded
2026-03-28 18:39:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9d39253-9880-5844-83b8-106224df9ffb, identifier: NK87306
2026-03-28 18:39:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9d39253-9880-5844-83b8-106224df9ffb with identifier: NK87306
2026-03-28 18:39:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9d39253-9880-5844-83b8-106224df9ffb with identifier: NK87306
2026-03-28 18:39:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9d39253-9880-5844-83b8-106224df9ffb with identifier: NK87306 to the API
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NK87306>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:27:40Z',
 'fuel_type': 'diesel',
 'id': 'b9d39253-9880-5844-83b8-106224df9ffb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK87306',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 232200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_d9a33fc3343589a63eb8f6682095144e.jpg',
                'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_f04109c9a90d9cfb962d55d49c39801e.jpg',
                'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_2e89e898ed98c3380de734b4e84d6b0f.jpg',
                'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_f48bc1d847aec7bd63a0d91d73186dc8.jpg',
                'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_08fdf13cbccadb20370f5f69d019ecd2.jpg',
                'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_91853ef56669404603b5f4c08b0895fa.jpg',
                'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_1e201291330f759421018fb2b790865e.jpg',
                'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_b8499130535309af35e7a68a6bb5c668.jpg',
                'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_5e4663c00c91dead2b293b24d7a948b7.jpg',
                'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_f5f48eb192ba757d63dbb07657f73a7f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d39253-9880-5844-83b8-106224df9ffb/b9d39253-9880-5844-83b8-106224df9ffb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_d9a33fc3343589a63eb8f6682095144e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d39253-9880-5844-83b8-106224df9ffb/b9d39253-9880-5844-83b8-106224df9ffb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_f04109c9a90d9cfb962d55d49c39801e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d39253-9880-5844-83b8-106224df9ffb/b9d39253-9880-5844-83b8-106224df9ffb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_2e89e898ed98c3380de734b4e84d6b0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d39253-9880-5844-83b8-106224df9ffb/b9d39253-9880-5844-83b8-106224df9ffb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_f48bc1d847aec7bd63a0d91d73186dc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d39253-9880-5844-83b8-106224df9ffb/b9d39253-9880-5844-83b8-106224df9ffb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_08fdf13cbccadb20370f5f69d019ecd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d39253-9880-5844-83b8-106224df9ffb/b9d39253-9880-5844-83b8-106224df9ffb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_91853ef56669404603b5f4c08b0895fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d39253-9880-5844-83b8-106224df9ffb/b9d39253-9880-5844-83b8-106224df9ffb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_1e201291330f759421018fb2b790865e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d39253-9880-5844-83b8-106224df9ffb/b9d39253-9880-5844-83b8-106224df9ffb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_b8499130535309af35e7a68a6bb5c668.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d39253-9880-5844-83b8-106224df9ffb/b9d39253-9880-5844-83b8-106224df9ffb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_5e4663c00c91dead2b293b24d7a948b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d39253-9880-5844-83b8-106224df9ffb/b9d39253-9880-5844-83b8-106224df9ffb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/66/dc667401065e45f8a75945db582b9fad/pa/NK87306_f5f48eb192ba757d63dbb07657f73a7f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2016}
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK87306%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [auto1.de] INFO: Saving data for NK87306: {'created_time': 1774723178.711827, 'last_price_update_time': 1774723178.711839, 'auction_closing_time': 1774884460.0}
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK87306') HTTP/1.1" 204 0
2026-03-28 18:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:42 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:42 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW80784%27 HTTP/1.1" 200 None
2026-03-28 18:39:42 [auto1.de] INFO: Scrape type for MW80784: 0
2026-03-28 18:39:42 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU99299%27 HTTP/1.1" 200 None
2026-03-28 18:39:42 [auto1.de] INFO: Scrape type for KU99299: 0
2026-03-28 18:39:42 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-28 18:39:42 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV46611%27 HTTP/1.1" 200 None
2026-03-28 18:39:42 [auto1.de] INFO: Scrape type for EV46611: 0
2026-03-28 18:39:42 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN35459%27 HTTP/1.1" 200 None
2026-03-28 18:39:42 [auto1.de] INFO: Scrape type for TN35459: 0
2026-03-28 18:39:42 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY59950%27 HTTP/1.1" 200 None
2026-03-28 18:39:42 [auto1.de] INFO: Scrape type for HY59950: 0
2026-03-28 18:39:42 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK45675%27 HTTP/1.1" 200 None
2026-03-28 18:39:42 [auto1.de] INFO: Scrape type for PK45675: 2
2026-03-28 18:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9927601-b027-57a0-ab5e-d6e4476d9d3a with identifier: PK45675
2026-03-28 18:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9927601-b027-57a0-ab5e-d6e4476d9d3a with scrape type 2
2026-03-28 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9927601-b027-57a0-ab5e-d6e4476d9d3a with scrape type 2
2026-03-28 18:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9927601-b027-57a0-ab5e-d6e4476d9d3a, identifier: PK45675
2026-03-28 18:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9927601-b027-57a0-ab5e-d6e4476d9d3a with identifier: PK45675
2026-03-28 18:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9927601-b027-57a0-ab5e-d6e4476d9d3a with identifier: PK45675
2026-03-28 18:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9927601-b027-57a0-ab5e-d6e4476d9d3a with identifier: PK45675 to the API
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:15:15Z',
 'fuel_type': 'diesel',
 'id': 'a9927601-b027-57a0-ab5e-d6e4476d9d3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK45675',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 158328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-22',
 'seller_name': None,
 'title': 'Fiat Doblo 1.6 JTDM SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2022}
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK45675%27 HTTP/1.1" 200 None
2026-03-28 18:39:43 [auto1.de] INFO: Saving data for PK45675: {'auction_closing_time': 1774883715.0, 'created_time': 1773341079.141209, 'last_price_update_time': 1774723183.287616}
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK45675') HTTP/1.1" 204 0
2026-03-28 18:39:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:43 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-28 18:39:43 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-28 18:39:43 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT59921%27 HTTP/1.1" 200 None
2026-03-28 18:39:43 [auto1.de] INFO: Scrape type for TT59921: 0
2026-03-28 18:39:43 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC51823%27 HTTP/1.1" 200 None
2026-03-28 18:39:43 [auto1.de] INFO: Scrape type for DC51823: 0
2026-03-28 18:39:43 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM63646%27 HTTP/1.1" 200 None
2026-03-28 18:39:43 [auto1.de] INFO: Scrape type for SM63646: 0
2026-03-28 18:39:43 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA91024%27 HTTP/1.1" 200 None
2026-03-28 18:39:43 [auto1.de] INFO: Scrape type for HA91024: 2
2026-03-28 18:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f64602ff-fd85-51d2-909c-91fd23602e31 with identifier: HA91024
2026-03-28 18:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f64602ff-fd85-51d2-909c-91fd23602e31 with scrape type 2
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f64602ff-fd85-51d2-909c-91fd23602e31 with scrape type 2
2026-03-28 18:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f64602ff-fd85-51d2-909c-91fd23602e31, identifier: HA91024
2026-03-28 18:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f64602ff-fd85-51d2-909c-91fd23602e31 with identifier: HA91024
2026-03-28 18:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f64602ff-fd85-51d2-909c-91fd23602e31 with identifier: HA91024
2026-03-28 18:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f64602ff-fd85-51d2-909c-91fd23602e31 with identifier: HA91024 to the API
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:22:39Z',
 'fuel_type': 'petrol',
 'id': 'f64602ff-fd85-51d2-909c-91fd23602e31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA91024',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 97823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-23',
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA91024%27 HTTP/1.1" 200 None
2026-03-28 18:39:43 [auto1.de] INFO: Saving data for HA91024: {'auction_closing_time': 1774884159.0, 'created_time': 1773426992.937684, 'last_price_update_time': 1774723183.776714}
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA91024') HTTP/1.1" 204 0
2026-03-28 18:39:43 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-28 18:39:43 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-28 18:39:43 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-28 18:39:43 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-28 18:39:43 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-28 18:39:43 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-28 18:39:43 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC24735%27 HTTP/1.1" 200 None
2026-03-28 18:39:43 [auto1.de] INFO: Scrape type for KC24735: 2
2026-03-28 18:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c70beb9-612b-56f2-a0c6-a15c442ec3a2 with identifier: KC24735
2026-03-28 18:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c70beb9-612b-56f2-a0c6-a15c442ec3a2 with scrape type 2
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c70beb9-612b-56f2-a0c6-a15c442ec3a2 with scrape type 2
2026-03-28 18:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c70beb9-612b-56f2-a0c6-a15c442ec3a2, identifier: KC24735
2026-03-28 18:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c70beb9-612b-56f2-a0c6-a15c442ec3a2 with identifier: KC24735
2026-03-28 18:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c70beb9-612b-56f2-a0c6-a15c442ec3a2 with identifier: KC24735
2026-03-28 18:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c70beb9-612b-56f2-a0c6-a15c442ec3a2 with identifier: KC24735 to the API
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:19:38Z',
 'fuel_type': 'petrol',
 'id': '7c70beb9-612b-56f2-a0c6-a15c442ec3a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC24735',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 97298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-26',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2014}
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC24735%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [auto1.de] INFO: Saving data for KC24735: {'auction_closing_time': 1774883978.0, 'created_time': 1774636650.200132, 'last_price_update_time': 1774723184.380729}
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC24735') HTTP/1.1" 204 0
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98394%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [auto1.de] INFO: Scrape type for KX98394: 0
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX71576%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [auto1.de] INFO: Scrape type for LX71576: 0
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88968%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [auto1.de] INFO: Scrape type for PE88968: 0
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG79588%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [auto1.de] INFO: Scrape type for FG79588: 0
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE79625%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [auto1.de] INFO: Scrape type for ZE79625: 0
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02117%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [auto1.de] INFO: Scrape type for AA02117: 0
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-28 18:39:44 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK47596%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [auto1.de] INFO: Scrape type for PK47596: 2
2026-03-28 18:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baab9b2f-039a-52fb-abf3-07c3f721100b with identifier: PK47596
2026-03-28 18:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baab9b2f-039a-52fb-abf3-07c3f721100b with scrape type 2
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baab9b2f-039a-52fb-abf3-07c3f721100b with scrape type 2
2026-03-28 18:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baab9b2f-039a-52fb-abf3-07c3f721100b, identifier: PK47596
2026-03-28 18:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baab9b2f-039a-52fb-abf3-07c3f721100b with identifier: PK47596
2026-03-28 18:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baab9b2f-039a-52fb-abf3-07c3f721100b with identifier: PK47596
2026-03-28 18:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baab9b2f-039a-52fb-abf3-07c3f721100b with identifier: PK47596 to the API
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:27:50Z',
 'fuel_type': 'petrol',
 'id': 'baab9b2f-039a-52fb-abf3-07c3f721100b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK47596',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 137780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-08',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK47596%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [auto1.de] INFO: Saving data for PK47596: {'auction_closing_time': 1774884470.0, 'created_time': 1773382550.999582, 'last_price_update_time': 1774723184.931333}
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK47596') HTTP/1.1" 204 0
2026-03-28 18:39:45 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-28 18:39:45 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-28 18:39:45 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT31566%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [auto1.de] INFO: Scrape type for FT31566: 0
2026-03-28 18:39:45 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK24290%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [auto1.de] INFO: Scrape type for HK24290: 2
2026-03-28 18:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7592c7d5-31cb-5f74-b010-bc6d4d3a0946 with identifier: HK24290
2026-03-28 18:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7592c7d5-31cb-5f74-b010-bc6d4d3a0946 with scrape type 2
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7592c7d5-31cb-5f74-b010-bc6d4d3a0946 with scrape type 2
2026-03-28 18:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7592c7d5-31cb-5f74-b010-bc6d4d3a0946, identifier: HK24290
2026-03-28 18:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7592c7d5-31cb-5f74-b010-bc6d4d3a0946 with identifier: HK24290
2026-03-28 18:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7592c7d5-31cb-5f74-b010-bc6d4d3a0946 with identifier: HK24290
2026-03-28 18:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7592c7d5-31cb-5f74-b010-bc6d4d3a0946 with identifier: HK24290 to the API
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:44:42Z',
 'fuel_type': 'petrol',
 'id': '7592c7d5-31cb-5f74-b010-bc6d4d3a0946',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK24290',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 114237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-29',
 'seller_name': None,
 'title': 'Nissan Note 1.4 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2008}
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK24290%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [auto1.de] INFO: Saving data for HK24290: {'auction_closing_time': 1774885482.0, 'created_time': 1774636635.648595, 'last_price_update_time': 1774723185.476952}
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK24290') HTTP/1.1" 204 0
2026-03-28 18:39:45 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW56593%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [auto1.de] INFO: Scrape type for LW56593: 0
2026-03-28 18:39:45 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG58212%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [auto1.de] INFO: Scrape type for TG58212: 0
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:46 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:46 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN45666%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [auto1.de] INFO: Scrape type for AN45666: 0
2026-03-28 18:39:46 [auto1.de] INFO: Found listing with ID: JN51648
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN51648%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [auto1.de] INFO: Scrape type for JN51648: 2
2026-03-28 18:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710f1986-f0f9-5004-8090-081117d5ab97 with identifier: JN51648
2026-03-28 18:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710f1986-f0f9-5004-8090-081117d5ab97 with scrape type 2
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710f1986-f0f9-5004-8090-081117d5ab97 with scrape type 2
2026-03-28 18:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 710f1986-f0f9-5004-8090-081117d5ab97, identifier: JN51648
2026-03-28 18:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 710f1986-f0f9-5004-8090-081117d5ab97 with identifier: JN51648
2026-03-28 18:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 710f1986-f0f9-5004-8090-081117d5ab97 with identifier: JN51648
2026-03-28 18:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 710f1986-f0f9-5004-8090-081117d5ab97 with identifier: JN51648 to the API
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:42:23Z',
 'fuel_type': 'petrol',
 'id': '710f1986-f0f9-5004-8090-081117d5ab97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN51648',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 151287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-21',
 'seller_name': None,
 'title': 'BMW 4er 440i Gran Coupé xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2018}
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN51648%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [auto1.de] INFO: Saving data for JN51648: {'auction_closing_time': 1774885343.0, 'created_time': 1774350977.65969, 'last_price_update_time': 1774723186.9436}
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN51648') HTTP/1.1" 204 0
2026-03-28 18:39:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:46 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK98414%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [auto1.de] INFO: Scrape type for KK98414: 0
2026-03-28 18:39:46 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-28 18:39:46 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-28 18:39:46 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS10539%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [auto1.de] INFO: Scrape type for LS10539: 0
2026-03-28 18:39:46 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL72774%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for WL72774: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91304%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for MW91304: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37955%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for MX37955: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY19816%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for UY19816: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR60138%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for AR60138: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH29152%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for AH29152: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP86406%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for LP86406: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD93182%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for MD93182: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT28740%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for DT28740: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ44442%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for FZ44442: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY19608%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for NY19608: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE70317%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for VE70317: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY55181%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for AY55181: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR18060%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for SR18060: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL50005%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for VL50005: 2
2026-03-28 18:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a7ac99b-5265-5002-b0ca-93a2fade221a with identifier: VL50005
2026-03-28 18:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a7ac99b-5265-5002-b0ca-93a2fade221a with scrape type 2
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a7ac99b-5265-5002-b0ca-93a2fade221a with scrape type 2
2026-03-28 18:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a7ac99b-5265-5002-b0ca-93a2fade221a, identifier: VL50005
2026-03-28 18:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a7ac99b-5265-5002-b0ca-93a2fade221a with identifier: VL50005
2026-03-28 18:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a7ac99b-5265-5002-b0ca-93a2fade221a with identifier: VL50005
2026-03-28 18:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a7ac99b-5265-5002-b0ca-93a2fade221a with identifier: VL50005 to the API
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:55:16Z',
 'fuel_type': 'petrol',
 'id': '6a7ac99b-5265-5002-b0ca-93a2fade221a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL50005',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 95969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-04',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL50005%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Saving data for VL50005: {'auction_closing_time': 1774886116.0, 'created_time': 1774522563.185792, 'last_price_update_time': 1774723187.670057}
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL50005') HTTP/1.1" 204 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR62561%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for XR62561: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX51383%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for DX51383: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65960%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for ZM65960: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL66452%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Scrape type for TL66452: 0
2026-03-28 18:39:47 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-28 18:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:49 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK26503%27 HTTP/1.1" 200 None
2026-03-28 18:39:49 [auto1.de] INFO: Scrape type for WK26503: 0
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28152%27 HTTP/1.1" 200 None
2026-03-28 18:39:49 [auto1.de] INFO: Scrape type for UK28152: 0
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG43270%27 HTTP/1.1" 200 None
2026-03-28 18:39:49 [auto1.de] INFO: Scrape type for BG43270: 0
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX94588%27 HTTP/1.1" 200 None
2026-03-28 18:39:49 [auto1.de] INFO: Scrape type for SX94588: 0
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU59623%27 HTTP/1.1" 200 None
2026-03-28 18:39:49 [auto1.de] INFO: Scrape type for RU59623: 0
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB64139%27 HTTP/1.1" 200 None
2026-03-28 18:39:49 [auto1.de] INFO: Scrape type for DB64139: 0
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ68996%27 HTTP/1.1" 200 None
2026-03-28 18:39:49 [auto1.de] INFO: Scrape type for YJ68996: 2
2026-03-28 18:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed762c0-1db0-5d02-abf7-8173230a8bcc with identifier: YJ68996
2026-03-28 18:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed762c0-1db0-5d02-abf7-8173230a8bcc with scrape type 2
2026-03-28 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ed762c0-1db0-5d02-abf7-8173230a8bcc with scrape type 2
2026-03-28 18:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ed762c0-1db0-5d02-abf7-8173230a8bcc, identifier: YJ68996
2026-03-28 18:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ed762c0-1db0-5d02-abf7-8173230a8bcc with identifier: YJ68996
2026-03-28 18:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ed762c0-1db0-5d02-abf7-8173230a8bcc with identifier: YJ68996
2026-03-28 18:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ed762c0-1db0-5d02-abf7-8173230a8bcc with identifier: YJ68996 to the API
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:33:27Z',
 'fuel_type': 'petrol',
 'id': '8ed762c0-1db0-5d02-abf7-8173230a8bcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ68996',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 105732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-29',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ68996%27 HTTP/1.1" 200 None
2026-03-28 18:39:49 [auto1.de] INFO: Saving data for YJ68996: {'auction_closing_time': 1774884807.0, 'created_time': 1774001928.599849, 'last_price_update_time': 1774723189.64452}
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ68996') HTTP/1.1" 204 0
2026-03-28 18:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX66232%27 HTTP/1.1" 200 None
2026-03-28 18:39:49 [auto1.de] INFO: Scrape type for HX66232: 0
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP10978%27 HTTP/1.1" 200 None
2026-03-28 18:39:49 [auto1.de] INFO: Scrape type for HP10978: 0
2026-03-28 18:39:49 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW72943%27 HTTP/1.1" 200 None
2026-03-28 18:39:49 [auto1.de] INFO: Scrape type for CW72943: 2
2026-03-28 18:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e07916f-c93b-531c-bdf4-70781d17b4de with identifier: CW72943
2026-03-28 18:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e07916f-c93b-531c-bdf4-70781d17b4de with scrape type 2
2026-03-28 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e07916f-c93b-531c-bdf4-70781d17b4de with scrape type 2
2026-03-28 18:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e07916f-c93b-531c-bdf4-70781d17b4de, identifier: CW72943
2026-03-28 18:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e07916f-c93b-531c-bdf4-70781d17b4de with identifier: CW72943
2026-03-28 18:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e07916f-c93b-531c-bdf4-70781d17b4de with identifier: CW72943
2026-03-28 18:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e07916f-c93b-531c-bdf4-70781d17b4de with identifier: CW72943 to the API
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:05:36Z',
 'fuel_type': 'petrol',
 'id': '1e07916f-c93b-531c-bdf4-70781d17b4de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW72943',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 151047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-24',
 'seller_name': None,
 'title': 'Fiat 500C 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2012}
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW72943%27 HTTP/1.1" 200 None
2026-03-28 18:39:50 [auto1.de] INFO: Saving data for CW72943: {'auction_closing_time': 1774883136.0, 'created_time': 1774521595.197411, 'last_price_update_time': 1774723190.21314}
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW72943') HTTP/1.1" 204 0
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX47984%27 HTTP/1.1" 200 None
2026-03-28 18:39:50 [auto1.de] INFO: Scrape type for NX47984: 0
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR64184%27 HTTP/1.1" 200 None
2026-03-28 18:39:50 [auto1.de] INFO: Scrape type for BR64184: 0
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA25019%27 HTTP/1.1" 200 None
2026-03-28 18:39:50 [auto1.de] INFO: Scrape type for GA25019: 0
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH89346%27 HTTP/1.1" 200 None
2026-03-28 18:39:50 [auto1.de] INFO: Scrape type for YH89346: 0
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ06587%27 HTTP/1.1" 200 None
2026-03-28 18:39:50 [auto1.de] INFO: Scrape type for CJ06587: 0
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV89701%27 HTTP/1.1" 200 None
2026-03-28 18:39:50 [auto1.de] INFO: Scrape type for DV89701: 0
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94434%27 HTTP/1.1" 200 None
2026-03-28 18:39:50 [auto1.de] INFO: Scrape type for SM94434: 0
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-28 18:39:50 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS13699%27 HTTP/1.1" 200 None
2026-03-28 18:39:50 [auto1.de] INFO: Scrape type for CS13699: 0
2026-03-28 18:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:51 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:51 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-28 18:39:51 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-28 18:39:51 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-28 18:39:51 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-28 18:39:51 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35504%27 HTTP/1.1" 200 None
2026-03-28 18:39:51 [auto1.de] INFO: Scrape type for WJ35504: 0
2026-03-28 18:39:51 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-28 18:39:51 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER72643%27 HTTP/1.1" 200 None
2026-03-28 18:39:51 [auto1.de] INFO: Scrape type for ER72643: 0
2026-03-28 18:39:51 [auto1.de] INFO: Found listing with ID: CL03732
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL03732%27 HTTP/1.1" 200 None
2026-03-28 18:39:51 [auto1.de] INFO: Scrape type for CL03732: 2
2026-03-28 18:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0 with identifier: CL03732
2026-03-28 18:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0 with scrape type 2
2026-03-28 18:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0 with scrape type 2
2026-03-28 18:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0, identifier: CL03732
2026-03-28 18:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0 with identifier: CL03732
2026-03-28 18:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0 with identifier: CL03732
2026-03-28 18:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0 with identifier: CL03732 to the API
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:52:43Z',
 'fuel_type': 'diesel',
 'id': '7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL03732',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 214671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-08',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL03732%27 HTTP/1.1" 200 None
2026-03-28 18:39:51 [auto1.de] INFO: Saving data for CL03732: {'auction_closing_time': 1774885963.0, 'created_time': 1774031765.653242, 'last_price_update_time': 1774723191.733751}
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL03732') HTTP/1.1" 204 0
2026-03-28 18:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:51 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX80115%27 HTTP/1.1" 200 None
2026-03-28 18:39:51 [auto1.de] INFO: Scrape type for PX80115: 2
2026-03-28 18:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7611aa3f-9b4b-59d1-8b74-402dac8441ea with identifier: PX80115
2026-03-28 18:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7611aa3f-9b4b-59d1-8b74-402dac8441ea with scrape type 2
2026-03-28 18:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7611aa3f-9b4b-59d1-8b74-402dac8441ea with scrape type 2
2026-03-28 18:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7611aa3f-9b4b-59d1-8b74-402dac8441ea, identifier: PX80115
2026-03-28 18:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7611aa3f-9b4b-59d1-8b74-402dac8441ea with identifier: PX80115
2026-03-28 18:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7611aa3f-9b4b-59d1-8b74-402dac8441ea with identifier: PX80115
2026-03-28 18:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7611aa3f-9b4b-59d1-8b74-402dac8441ea with identifier: PX80115 to the API
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:45:43Z',
 'fuel_type': 'petrol',
 'id': '7611aa3f-9b4b-59d1-8b74-402dac8441ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX80115',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Splash',
 'odometer': 33272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-06',
 'seller_name': None,
 'title': 'Suzuki Splash 1.2 Club',
 'transmission': 'automatic',
 'trim': 'Club',
 'year': 2012}
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX80115%27 HTTP/1.1" 200 None
2026-03-28 18:39:52 [auto1.de] INFO: Saving data for PX80115: {'auction_closing_time': 1774885543.0, 'created_time': 1774521690.849647, 'last_price_update_time': 1774723192.28459}
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX80115') HTTP/1.1" 204 0
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW76305%27 HTTP/1.1" 200 None
2026-03-28 18:39:52 [auto1.de] INFO: Scrape type for YW76305: 0
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT78842%27 HTTP/1.1" 200 None
2026-03-28 18:39:52 [auto1.de] INFO: Scrape type for FT78842: 0
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ10234%27 HTTP/1.1" 200 None
2026-03-28 18:39:52 [auto1.de] INFO: Scrape type for RJ10234: 0
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE32981%27 HTTP/1.1" 200 None
2026-03-28 18:39:52 [auto1.de] INFO: Scrape type for XE32981: 0
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23937%27 HTTP/1.1" 200 None
2026-03-28 18:39:52 [auto1.de] INFO: Scrape type for PR23937: 0
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU49323%27 HTTP/1.1" 200 None
2026-03-28 18:39:52 [auto1.de] INFO: Scrape type for GU49323: 0
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73268%27 HTTP/1.1" 200 None
2026-03-28 18:39:52 [auto1.de] INFO: Scrape type for PU73268: 0
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ53815%27 HTTP/1.1" 200 None
2026-03-28 18:39:52 [auto1.de] INFO: Scrape type for VZ53815: 2
2026-03-28 18:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01108ae5-919a-5fcc-9c44-aba621086f73 with identifier: VZ53815
2026-03-28 18:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01108ae5-919a-5fcc-9c44-aba621086f73 with scrape type 2
2026-03-28 18:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01108ae5-919a-5fcc-9c44-aba621086f73 with scrape type 2
2026-03-28 18:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01108ae5-919a-5fcc-9c44-aba621086f73, identifier: VZ53815
2026-03-28 18:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01108ae5-919a-5fcc-9c44-aba621086f73 with identifier: VZ53815
2026-03-28 18:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01108ae5-919a-5fcc-9c44-aba621086f73 with identifier: VZ53815
2026-03-28 18:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01108ae5-919a-5fcc-9c44-aba621086f73 with identifier: VZ53815 to the API
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:01:27Z',
 'fuel_type': 'petrol',
 'id': '01108ae5-919a-5fcc-9c44-aba621086f73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ53815',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 189216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-07-22',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8 Pacific',
 'transmission': 'manual',
 'trim': 'Pacific',
 'year': 1996}
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ53815%27 HTTP/1.1" 200 None
2026-03-28 18:39:52 [auto1.de] INFO: Saving data for VZ53815: {'auction_closing_time': 1774882887.0, 'created_time': 1774034603.878871, 'last_price_update_time': 1774723192.856809}
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ53815') HTTP/1.1" 204 0
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC74080%27 HTTP/1.1" 200 None
2026-03-28 18:39:52 [auto1.de] INFO: Scrape type for FC74080: 0
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ91667%27 HTTP/1.1" 200 None
2026-03-28 18:39:52 [auto1.de] INFO: Scrape type for NZ91667: 0
2026-03-28 18:39:52 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54065%27 HTTP/1.1" 200 None
2026-03-28 18:39:53 [auto1.de] INFO: Scrape type for HH54065: 0
2026-03-28 18:39:53 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ43142%27 HTTP/1.1" 200 None
2026-03-28 18:39:53 [auto1.de] INFO: Scrape type for VJ43142: 2
2026-03-28 18:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 406b3bbd-2e71-53bf-8730-52f7f46bba54 with identifier: VJ43142
2026-03-28 18:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 406b3bbd-2e71-53bf-8730-52f7f46bba54 with scrape type 2
2026-03-28 18:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 406b3bbd-2e71-53bf-8730-52f7f46bba54 with scrape type 2
2026-03-28 18:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 406b3bbd-2e71-53bf-8730-52f7f46bba54, identifier: VJ43142
2026-03-28 18:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 406b3bbd-2e71-53bf-8730-52f7f46bba54 with identifier: VJ43142
2026-03-28 18:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 406b3bbd-2e71-53bf-8730-52f7f46bba54 with identifier: VJ43142
2026-03-28 18:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 406b3bbd-2e71-53bf-8730-52f7f46bba54 with identifier: VJ43142 to the API
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:41:56Z',
 'fuel_type': 'petrol',
 'id': '406b3bbd-2e71-53bf-8730-52f7f46bba54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ43142',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 8500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-21',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2023}
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ43142%27 HTTP/1.1" 200 None
2026-03-28 18:39:53 [auto1.de] INFO: Saving data for VJ43142: {'auction_closing_time': 1774885316.0, 'created_time': 1774522649.588899, 'last_price_update_time': 1774723193.452647}
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ43142') HTTP/1.1" 204 0
2026-03-28 18:39:53 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-28 18:39:53 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-28 18:39:53 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY94594%27 HTTP/1.1" 200 None
2026-03-28 18:39:53 [auto1.de] INFO: Scrape type for AY94594: 0
2026-03-28 18:39:53 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-28 18:39:53 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-28 18:39:53 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-28 18:39:53 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-28 18:39:53 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE56014%27 HTTP/1.1" 200 None
2026-03-28 18:39:53 [auto1.de] INFO: Scrape type for GE56014: 0
2026-03-28 18:39:53 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-28 18:39:53 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-28 18:39:53 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-28 18:39:53 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-28 18:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:54 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77915%27 HTTP/1.1" 200 None
2026-03-28 18:39:54 [auto1.de] INFO: Scrape type for DW77915: 0
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS80830%27 HTTP/1.1" 200 None
2026-03-28 18:39:54 [auto1.de] INFO: Scrape type for RS80830: 0
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT78165%27 HTTP/1.1" 200 None
2026-03-28 18:39:54 [auto1.de] INFO: Scrape type for AT78165: 0
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB00511%27 HTTP/1.1" 200 None
2026-03-28 18:39:54 [auto1.de] INFO: Scrape type for ZB00511: 0
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR01639%27 HTTP/1.1" 200 None
2026-03-28 18:39:54 [auto1.de] INFO: Scrape type for ZR01639: 0
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: LK12622
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12622%27 HTTP/1.1" 200 None
2026-03-28 18:39:54 [auto1.de] INFO: Scrape type for LK12622: 2
2026-03-28 18:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38903159-416f-5f85-8a70-45e6cbe00e81 with identifier: LK12622
2026-03-28 18:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38903159-416f-5f85-8a70-45e6cbe00e81 with scrape type 2
2026-03-28 18:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38903159-416f-5f85-8a70-45e6cbe00e81 with scrape type 2
2026-03-28 18:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38903159-416f-5f85-8a70-45e6cbe00e81, identifier: LK12622
2026-03-28 18:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38903159-416f-5f85-8a70-45e6cbe00e81 with identifier: LK12622
2026-03-28 18:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38903159-416f-5f85-8a70-45e6cbe00e81 with identifier: LK12622
2026-03-28 18:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38903159-416f-5f85-8a70-45e6cbe00e81 with identifier: LK12622 to the API
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:21:29Z',
 'fuel_type': 'petrol',
 'id': '38903159-416f-5f85-8a70-45e6cbe00e81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK12622',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 118433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-24',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12622%27 HTTP/1.1" 200 None
2026-03-28 18:39:54 [auto1.de] INFO: Saving data for LK12622: {'auction_closing_time': 1774884089.0, 'created_time': 1774118667.923489, 'last_price_update_time': 1774723194.886787}
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK12622') HTTP/1.1" 204 0
2026-03-28 18:39:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-28 18:39:54 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN50855%27 HTTP/1.1" 200 None
2026-03-28 18:39:55 [auto1.de] INFO: Scrape type for VN50855: 0
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU52980%27 HTTP/1.1" 200 None
2026-03-28 18:39:55 [auto1.de] INFO: Scrape type for JU52980: 0
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM78973%27 HTTP/1.1" 200 None
2026-03-28 18:39:55 [auto1.de] INFO: Scrape type for CM78973: 2
2026-03-28 18:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c71af1f0-6c73-54a3-a5d1-652370f79286 with identifier: CM78973
2026-03-28 18:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c71af1f0-6c73-54a3-a5d1-652370f79286 with scrape type 2
2026-03-28 18:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c71af1f0-6c73-54a3-a5d1-652370f79286 with scrape type 2
2026-03-28 18:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c71af1f0-6c73-54a3-a5d1-652370f79286, identifier: CM78973
2026-03-28 18:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c71af1f0-6c73-54a3-a5d1-652370f79286 with identifier: CM78973
2026-03-28 18:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c71af1f0-6c73-54a3-a5d1-652370f79286 with identifier: CM78973
2026-03-28 18:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c71af1f0-6c73-54a3-a5d1-652370f79286 with identifier: CM78973 to the API
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:40:18Z',
 'fuel_type': 'diesel',
 'id': 'c71af1f0-6c73-54a3-a5d1-652370f79286',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM78973',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 212016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-28',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM78973%27 HTTP/1.1" 200 None
2026-03-28 18:39:55 [auto1.de] INFO: Saving data for CM78973: {'auction_closing_time': 1774885218.0, 'created_time': 1773429234.930424, 'last_price_update_time': 1774723195.455503}
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM78973') HTTP/1.1" 204 0
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX22671%27 HTTP/1.1" 200 None
2026-03-28 18:39:55 [auto1.de] INFO: Scrape type for EX22671: 0
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV45616%27 HTTP/1.1" 200 None
2026-03-28 18:39:55 [auto1.de] INFO: Scrape type for HV45616: 0
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT40648%27 HTTP/1.1" 200 None
2026-03-28 18:39:55 [auto1.de] INFO: Scrape type for TT40648: 0
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP25437%27 HTTP/1.1" 200 None
2026-03-28 18:39:55 [auto1.de] INFO: Scrape type for PP25437: 0
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-28 18:39:55 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ20795%27 HTTP/1.1" 200 None
2026-03-28 18:39:55 [auto1.de] INFO: Scrape type for TJ20795: 2
2026-03-28 18:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85741e5a-37a3-560e-b20b-461fec280f9a with identifier: TJ20795
2026-03-28 18:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85741e5a-37a3-560e-b20b-461fec280f9a with scrape type 2
2026-03-28 18:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85741e5a-37a3-560e-b20b-461fec280f9a with scrape type 2
2026-03-28 18:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85741e5a-37a3-560e-b20b-461fec280f9a, identifier: TJ20795
2026-03-28 18:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85741e5a-37a3-560e-b20b-461fec280f9a with identifier: TJ20795
2026-03-28 18:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85741e5a-37a3-560e-b20b-461fec280f9a with identifier: TJ20795
2026-03-28 18:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85741e5a-37a3-560e-b20b-461fec280f9a with identifier: TJ20795 to the API
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:18:20Z',
 'fuel_type': 'petrol',
 'id': '85741e5a-37a3-560e-b20b-461fec280f9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ20795',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 193370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-19',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-28 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ20795%27 HTTP/1.1" 200 None
2026-03-28 18:39:56 [auto1.de] INFO: Saving data for TJ20795: {'auction_closing_time': 1774883900.0, 'created_time': 1774522498.830778, 'last_price_update_time': 1774723196.056879}
2026-03-28 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ20795') HTTP/1.1" 204 0
2026-03-28 18:39:56 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-28 18:39:56 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-28 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE19125%27 HTTP/1.1" 200 None
2026-03-28 18:39:56 [auto1.de] INFO: Scrape type for XE19125: 0
2026-03-28 18:39:56 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-28 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN10929%27 HTTP/1.1" 200 None
2026-03-28 18:39:56 [auto1.de] INFO: Scrape type for GN10929: 0
2026-03-28 18:39:56 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-28 18:39:56 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-28 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE66083%27 HTTP/1.1" 200 None
2026-03-28 18:39:56 [auto1.de] INFO: Scrape type for YE66083: 0
2026-03-28 18:39:56 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-28 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK08323%27 HTTP/1.1" 200 None
2026-03-28 18:39:56 [auto1.de] INFO: Scrape type for AK08323: 0
2026-03-28 18:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:57 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 6004 | hits on page: 40
2026-03-28 18:39:57 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-28 18:39:57 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW69862%27 HTTP/1.1" 200 None
2026-03-28 18:39:57 [auto1.de] INFO: Scrape type for GW69862: 2
2026-03-28 18:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d768c9b-67bd-5f58-acc2-e14e5ae740df with identifier: GW69862
2026-03-28 18:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d768c9b-67bd-5f58-acc2-e14e5ae740df with scrape type 2
2026-03-28 18:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d768c9b-67bd-5f58-acc2-e14e5ae740df with scrape type 2
2026-03-28 18:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d768c9b-67bd-5f58-acc2-e14e5ae740df, identifier: GW69862
2026-03-28 18:39:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d768c9b-67bd-5f58-acc2-e14e5ae740df with identifier: GW69862
2026-03-28 18:39:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d768c9b-67bd-5f58-acc2-e14e5ae740df with identifier: GW69862
2026-03-28 18:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d768c9b-67bd-5f58-acc2-e14e5ae740df with identifier: GW69862 to the API
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:15:53Z',
 'fuel_type': 'petrol',
 'id': '6d768c9b-67bd-5f58-acc2-e14e5ae740df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW69862',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 184111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-22',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW69862%27 HTTP/1.1" 200 None
2026-03-28 18:39:57 [auto1.de] INFO: Saving data for GW69862: {'auction_closing_time': 1774883753.0, 'created_time': 1774034315.890104, 'last_price_update_time': 1774723197.762737}
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW69862') HTTP/1.1" 204 0
2026-03-28 18:39:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:57 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-28 18:39:57 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-28 18:39:57 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK47916%27 HTTP/1.1" 200 None
2026-03-28 18:39:57 [auto1.de] INFO: Scrape type for AK47916: 0
2026-03-28 18:39:57 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-28 18:39:57 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW24568%27 HTTP/1.1" 200 None
2026-03-28 18:39:57 [auto1.de] INFO: Scrape type for JW24568: 0
2026-03-28 18:39:57 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE74286%27 HTTP/1.1" 200 None
2026-03-28 18:39:57 [auto1.de] INFO: Scrape type for NE74286: 2
2026-03-28 18:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fffbbe34-7db5-56c9-b937-9b4385b4acdd with identifier: NE74286
2026-03-28 18:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fffbbe34-7db5-56c9-b937-9b4385b4acdd with scrape type 2
2026-03-28 18:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fffbbe34-7db5-56c9-b937-9b4385b4acdd with scrape type 2
2026-03-28 18:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fffbbe34-7db5-56c9-b937-9b4385b4acdd, identifier: NE74286
2026-03-28 18:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fffbbe34-7db5-56c9-b937-9b4385b4acdd with identifier: NE74286
2026-03-28 18:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fffbbe34-7db5-56c9-b937-9b4385b4acdd with identifier: NE74286
2026-03-28 18:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fffbbe34-7db5-56c9-b937-9b4385b4acdd with identifier: NE74286 to the API
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:20:56Z',
 'fuel_type': 'petrol',
 'id': 'fffbbe34-7db5-56c9-b937-9b4385b4acdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE74286',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Tonale',
 'odometer': 17610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seller_name': None,
 'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Sprint',
 'transmission': 'automatic',
 'trim': 'Sprint',
 'year': 2022}
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE74286%27 HTTP/1.1" 200 None
2026-03-28 18:39:58 [auto1.de] INFO: Saving data for NE74286: {'auction_closing_time': 1774884056.0, 'created_time': 1774522089.061562, 'last_price_update_time': 1774723198.331723}
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE74286') HTTP/1.1" 204 0
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW78451%27 HTTP/1.1" 200 None
2026-03-28 18:39:58 [auto1.de] INFO: Scrape type for AW78451: 0
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB25738%27 HTTP/1.1" 200 None
2026-03-28 18:39:58 [auto1.de] INFO: Scrape type for RB25738: 0
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC43990%27 HTTP/1.1" 200 None
2026-03-28 18:39:58 [auto1.de] INFO: Scrape type for ZC43990: 2
2026-03-28 18:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6a322c4-87d2-50a9-aa69-6b9ffd087780 with identifier: ZC43990
2026-03-28 18:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6a322c4-87d2-50a9-aa69-6b9ffd087780 with scrape type 2
2026-03-28 18:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6a322c4-87d2-50a9-aa69-6b9ffd087780 with scrape type 2
2026-03-28 18:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6a322c4-87d2-50a9-aa69-6b9ffd087780, identifier: ZC43990
2026-03-28 18:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6a322c4-87d2-50a9-aa69-6b9ffd087780 with identifier: ZC43990
2026-03-28 18:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6a322c4-87d2-50a9-aa69-6b9ffd087780 with identifier: ZC43990
2026-03-28 18:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6a322c4-87d2-50a9-aa69-6b9ffd087780 with identifier: ZC43990 to the API
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:08Z',
 'fuel_type': 'diesel',
 'id': 'f6a322c4-87d2-50a9-aa69-6b9ffd087780',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC43990',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 75089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-07',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi EcoBlue Mild-Hybrid ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2021}
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC43990%27 HTTP/1.1" 200 None
2026-03-28 18:39:58 [auto1.de] INFO: Saving data for ZC43990: {'auction_closing_time': 1774883228.0, 'created_time': 1774118992.997021, 'last_price_update_time': 1774723198.794126}
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC43990') HTTP/1.1" 204 0
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR21062%27 HTTP/1.1" 200 None
2026-03-28 18:39:58 [auto1.de] INFO: Scrape type for ZR21062: 0
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV70498%27 HTTP/1.1" 200 None
2026-03-28 18:39:58 [auto1.de] INFO: Scrape type for WV70498: 0
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH23061%27 HTTP/1.1" 200 None
2026-03-28 18:39:58 [auto1.de] INFO: Scrape type for ZH23061: 0
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM72305%27 HTTP/1.1" 200 None
2026-03-28 18:39:58 [auto1.de] INFO: Scrape type for KM72305: 0
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ33260%27 HTTP/1.1" 200 None
2026-03-28 18:39:58 [auto1.de] INFO: Scrape type for RZ33260: 0
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX17488%27 HTTP/1.1" 200 None
2026-03-28 18:39:58 [auto1.de] INFO: Scrape type for FX17488: 0
2026-03-28 18:39:58 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW05211%27 HTTP/1.1" 200 None
2026-03-28 18:39:58 [auto1.de] INFO: Scrape type for DW05211: 2
2026-03-28 18:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4775d05d-cad3-522a-8687-67eaae32a76c with identifier: DW05211
2026-03-28 18:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4775d05d-cad3-522a-8687-67eaae32a76c with scrape type 2
2026-03-28 18:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4775d05d-cad3-522a-8687-67eaae32a76c with scrape type 2
2026-03-28 18:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4775d05d-cad3-522a-8687-67eaae32a76c, identifier: DW05211
2026-03-28 18:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4775d05d-cad3-522a-8687-67eaae32a76c with identifier: DW05211
2026-03-28 18:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4775d05d-cad3-522a-8687-67eaae32a76c with identifier: DW05211
2026-03-28 18:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4775d05d-cad3-522a-8687-67eaae32a76c with identifier: DW05211 to the API
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:55:12Z',
 'fuel_type': 'diesel',
 'id': '4775d05d-cad3-522a-8687-67eaae32a76c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW05211',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 238483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-18',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2020}
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW05211%27 HTTP/1.1" 200 None
2026-03-28 18:39:59 [auto1.de] INFO: Saving data for DW05211: {'auction_closing_time': 1774886112.0, 'created_time': 1774521710.379405, 'last_price_update_time': 1774723199.329319}
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW05211') HTTP/1.1" 204 0
2026-03-28 18:39:59 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-28 18:39:59 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM41961%27 HTTP/1.1" 200 None
2026-03-28 18:39:59 [auto1.de] INFO: Scrape type for AM41961: 0
2026-03-28 18:39:59 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA98436%27 HTTP/1.1" 200 None
2026-03-28 18:39:59 [auto1.de] INFO: Scrape type for AA98436: 0
2026-03-28 18:39:59 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU94869%27 HTTP/1.1" 200 None
2026-03-28 18:39:59 [auto1.de] INFO: Scrape type for PU94869: 2
2026-03-28 18:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1eeb515-13b6-55ee-b704-c114df9ff25d with identifier: PU94869
2026-03-28 18:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1eeb515-13b6-55ee-b704-c114df9ff25d with scrape type 2
2026-03-28 18:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1eeb515-13b6-55ee-b704-c114df9ff25d with scrape type 2
2026-03-28 18:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1eeb515-13b6-55ee-b704-c114df9ff25d, identifier: PU94869
2026-03-28 18:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1eeb515-13b6-55ee-b704-c114df9ff25d with identifier: PU94869
2026-03-28 18:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1eeb515-13b6-55ee-b704-c114df9ff25d with identifier: PU94869
2026-03-28 18:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1eeb515-13b6-55ee-b704-c114df9ff25d with identifier: PU94869 to the API
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:15:02Z',
 'fuel_type': 'petrol',
 'id': 'c1eeb515-13b6-55ee-b704-c114df9ff25d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU94869',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 100414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU94869%27 HTTP/1.1" 200 None
2026-03-28 18:39:59 [auto1.de] INFO: Saving data for PU94869: {'auction_closing_time': 1774883702.0, 'created_time': 1774636625.29264, 'last_price_update_time': 1774723199.908629}
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU94869') HTTP/1.1" 204 0
2026-03-28 18:39:59 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-28 18:39:59 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG01413%27 HTTP/1.1" 200 None
2026-03-28 18:39:59 [auto1.de] INFO: Scrape type for WG01413: 0
2026-03-28 18:39:59 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-28 18:39:59 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS45157%27 HTTP/1.1" 200 None
2026-03-28 18:39:59 [auto1.de] INFO: Scrape type for RS45157: 0
2026-03-28 18:39:59 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05581%27 HTTP/1.1" 200 None
2026-03-28 18:39:59 [auto1.de] INFO: Scrape type for TW05581: 0
2026-03-28 18:39:59 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-28 18:39:59 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL43028%27 HTTP/1.1" 200 None
2026-03-28 18:39:59 [auto1.de] INFO: Scrape type for VL43028: 0
2026-03-28 18:39:59 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP84428%27 HTTP/1.1" 200 None
2026-03-28 18:40:00 [auto1.de] INFO: Scrape type for UP84428: 0
2026-03-28 18:40:00 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU86679%27 HTTP/1.1" 200 None
2026-03-28 18:40:00 [auto1.de] INFO: Scrape type for XU86679: 0
2026-03-28 18:40:00 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-28 18:40:00 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-28 18:40:00 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY60165%27 HTTP/1.1" 200 None
2026-03-28 18:40:00 [auto1.de] INFO: Scrape type for YY60165: 0
2026-03-28 18:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:00 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 6004 | hits on page: 40
2026-03-28 18:40:00 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-28 18:40:00 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-28 18:40:00 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ29661%27 HTTP/1.1" 200 None
2026-03-28 18:40:00 [auto1.de] INFO: Scrape type for VJ29661: 0
2026-03-28 18:40:00 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL95475%27 HTTP/1.1" 200 None
2026-03-28 18:40:00 [auto1.de] INFO: Scrape type for HL95475: 0
2026-03-28 18:40:00 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL67777%27 HTTP/1.1" 200 None
2026-03-28 18:40:00 [auto1.de] INFO: Scrape type for EL67777: 0
2026-03-28 18:40:00 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-28 18:40:00 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN92590%27 HTTP/1.1" 200 None
2026-03-28 18:40:00 [auto1.de] INFO: Scrape type for LN92590: 2
2026-03-28 18:40:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with identifier: LN92590
2026-03-28 18:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with scrape type 2
2026-03-28 18:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with scrape type 2
2026-03-28 18:40:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9, identifier: LN92590
2026-03-28 18:40:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with identifier: LN92590
2026-03-28 18:40:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with identifier: LN92590
2026-03-28 18:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with identifier: LN92590 to the API
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:48:44Z',
 'fuel_type': 'diesel',
 'id': 'b90e1bb0-d68d-51ed-81fd-a660fe52cdf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN92590',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 259899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-01',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Individual',
 'transmission': 'automatic',
 'trim': 'Individual',
 'year': 2016}
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN92590%27 HTTP/1.1" 200 None
2026-03-28 18:40:01 [auto1.de] INFO: Saving data for LN92590: {'auction_closing_time': 1774885724.0, 'created_time': 1774522519.204727, 'last_price_update_time': 1774723201.220958}
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN92590') HTTP/1.1" 204 0
2026-03-28 18:40:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX48590%27 HTTP/1.1" 200 None
2026-03-28 18:40:01 [auto1.de] INFO: Scrape type for UX48590: 0
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ09616%27 HTTP/1.1" 200 None
2026-03-28 18:40:01 [auto1.de] INFO: Scrape type for HJ09616: 0
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB75427%27 HTTP/1.1" 200 None
2026-03-28 18:40:01 [auto1.de] INFO: Scrape type for RB75427: 0
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45396%27 HTTP/1.1" 200 None
2026-03-28 18:40:01 [auto1.de] INFO: Scrape type for SG45396: 0
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR24224%27 HTTP/1.1" 200 None
2026-03-28 18:40:01 [auto1.de] INFO: Scrape type for UR24224: 0
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: TP00598
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV23538%27 HTTP/1.1" 200 None
2026-03-28 18:40:01 [auto1.de] INFO: Scrape type for SV23538: 0
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE54360%27 HTTP/1.1" 200 None
2026-03-28 18:40:01 [auto1.de] INFO: Scrape type for DE54360: 0
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH15947%27 HTTP/1.1" 200 None
2026-03-28 18:40:01 [auto1.de] INFO: Scrape type for XH15947: 0
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK47364%27 HTTP/1.1" 200 None
2026-03-28 18:40:01 [auto1.de] INFO: Scrape type for LK47364: 2
2026-03-28 18:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa54504c-538f-5e19-aeb0-9935aa3a8c49 with identifier: LK47364
2026-03-28 18:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa54504c-538f-5e19-aeb0-9935aa3a8c49 with scrape type 2
2026-03-28 18:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa54504c-538f-5e19-aeb0-9935aa3a8c49 with scrape type 2
2026-03-28 18:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa54504c-538f-5e19-aeb0-9935aa3a8c49, identifier: LK47364
2026-03-28 18:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa54504c-538f-5e19-aeb0-9935aa3a8c49 with identifier: LK47364
2026-03-28 18:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa54504c-538f-5e19-aeb0-9935aa3a8c49 with identifier: LK47364
2026-03-28 18:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa54504c-538f-5e19-aeb0-9935aa3a8c49 with identifier: LK47364 to the API
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:06:18Z',
 'fuel_type': 'diesel',
 'id': 'fa54504c-538f-5e19-aeb0-9935aa3a8c49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK47364',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 106353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-28',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2019}
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK47364%27 HTTP/1.1" 200 None
2026-03-28 18:40:01 [auto1.de] INFO: Saving data for LK47364: {'auction_closing_time': 1774883178.0, 'created_time': 1774550180.456238, 'last_price_update_time': 1774723201.927646}
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK47364') HTTP/1.1" 204 0
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-28 18:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:03 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 6004 | hits on page: 40
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43424%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for HA43424: 0
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC46474%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for ZC46474: 2
2026-03-28 18:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47fe68f0-819e-5086-ae22-e304773452dc with identifier: ZC46474
2026-03-28 18:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fe68f0-819e-5086-ae22-e304773452dc with scrape type 2
2026-03-28 18:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47fe68f0-819e-5086-ae22-e304773452dc with scrape type 2
2026-03-28 18:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47fe68f0-819e-5086-ae22-e304773452dc, identifier: ZC46474
2026-03-28 18:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47fe68f0-819e-5086-ae22-e304773452dc with identifier: ZC46474
2026-03-28 18:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47fe68f0-819e-5086-ae22-e304773452dc with identifier: ZC46474
2026-03-28 18:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47fe68f0-819e-5086-ae22-e304773452dc with identifier: ZC46474 to the API
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:33:46Z',
 'fuel_type': 'petrol',
 'id': '47fe68f0-819e-5086-ae22-e304773452dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC46474',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 201684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-27',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 Futura X',
 'transmission': 'manual',
 'trim': 'Futura X',
 'year': 2006}
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC46474%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Saving data for ZC46474: {'auction_closing_time': 1774884826.0, 'created_time': 1774034542.096155, 'last_price_update_time': 1774723203.641903}
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC46474') HTTP/1.1" 204 0
2026-03-28 18:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK86210%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for AK86210: 0
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE85756%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for CE85756: 0
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63810%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for TP63810: 0
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV42513%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for XV42513: 2
2026-03-28 18:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd9a485c-99e3-571b-a7fe-61c04238e6eb with identifier: XV42513
2026-03-28 18:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd9a485c-99e3-571b-a7fe-61c04238e6eb with scrape type 2
2026-03-28 18:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd9a485c-99e3-571b-a7fe-61c04238e6eb with scrape type 2
2026-03-28 18:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd9a485c-99e3-571b-a7fe-61c04238e6eb, identifier: XV42513
2026-03-28 18:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd9a485c-99e3-571b-a7fe-61c04238e6eb with identifier: XV42513
2026-03-28 18:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd9a485c-99e3-571b-a7fe-61c04238e6eb with identifier: XV42513
2026-03-28 18:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd9a485c-99e3-571b-a7fe-61c04238e6eb with identifier: XV42513 to the API
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:17:55Z',
 'fuel_type': 'diesel',
 'id': 'cd9a485c-99e3-571b-a7fe-61c04238e6eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV42513',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T4 Kombi',
 'odometer': 405975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-06-22',
 'seller_name': None,
 'title': 'Volkswagen T4 Kombi 2.5 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 1998}
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV42513%27 HTTP/1.1" 200 None
2026-03-28 18:40:04 [auto1.de] INFO: Saving data for XV42513: {'auction_closing_time': 1774883875.0, 'created_time': 1774521679.778747, 'last_price_update_time': 1774723204.15942}
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV42513') HTTP/1.1" 204 0
2026-03-28 18:40:04 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-28 18:40:04 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ35506%27 HTTP/1.1" 200 None
2026-03-28 18:40:04 [auto1.de] INFO: Scrape type for WZ35506: 0
2026-03-28 18:40:04 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ24379%27 HTTP/1.1" 200 None
2026-03-28 18:40:04 [auto1.de] INFO: Scrape type for XJ24379: 2
2026-03-28 18:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb817ec-6b32-507f-8a33-f88269222622 with identifier: XJ24379
2026-03-28 18:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb817ec-6b32-507f-8a33-f88269222622 with scrape type 2
2026-03-28 18:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acb817ec-6b32-507f-8a33-f88269222622 with scrape type 2
2026-03-28 18:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acb817ec-6b32-507f-8a33-f88269222622, identifier: XJ24379
2026-03-28 18:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acb817ec-6b32-507f-8a33-f88269222622 with identifier: XJ24379
2026-03-28 18:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acb817ec-6b32-507f-8a33-f88269222622 with identifier: XJ24379
2026-03-28 18:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acb817ec-6b32-507f-8a33-f88269222622 with identifier: XJ24379 to the API
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:49:50Z',
 'fuel_type': 'diesel',
 'id': 'acb817ec-6b32-507f-8a33-f88269222622',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ24379',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 292533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-16',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 TDCi Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ24379%27 HTTP/1.1" 200 None
2026-03-28 18:40:04 [auto1.de] INFO: Saving data for XJ24379: {'auction_closing_time': 1774885790.0, 'created_time': 1774636623.984213, 'last_price_update_time': 1774723204.749197}
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ24379') HTTP/1.1" 204 0
2026-03-28 18:40:04 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA72326%27 HTTP/1.1" 200 None
2026-03-28 18:40:04 [auto1.de] INFO: Scrape type for JA72326: 0
2026-03-28 18:40:04 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV81199%27 HTTP/1.1" 200 None
2026-03-28 18:40:04 [auto1.de] INFO: Scrape type for CV81199: 0
2026-03-28 18:40:04 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL87720%27 HTTP/1.1" 200 None
2026-03-28 18:40:04 [auto1.de] INFO: Scrape type for CL87720: 2
2026-03-28 18:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with identifier: CL87720
2026-03-28 18:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with scrape type 2
2026-03-28 18:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with scrape type 2
2026-03-28 18:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee5596a6-f10b-506e-9f8a-8eaa2fee8398, identifier: CL87720
2026-03-28 18:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with identifier: CL87720
2026-03-28 18:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with identifier: CL87720
2026-03-28 18:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with identifier: CL87720 to the API
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-30T15:03:23Z',
 'fuel_type': 'diesel',
 'id': 'ee5596a6-f10b-506e-9f8a-8eaa2fee8398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL87720',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 179760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2021}
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL87720%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Saving data for CL87720: {'auction_closing_time': 1774883003.0, 'created_time': 1774521893.25755, 'last_price_update_time': 1774723205.235789}
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL87720') HTTP/1.1" 204 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD49252%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for GD49252: 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN39495%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for WN39495: 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04240%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for HC04240: 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF94363%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for XF94363: 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK46360%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for CK46360: 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV88353%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for NV88353: 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD16829%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for SD16829: 2
2026-03-28 18:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd95f98a-fd1a-5f17-b6a9-a915b666da37 with identifier: SD16829
2026-03-28 18:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd95f98a-fd1a-5f17-b6a9-a915b666da37 with scrape type 2
2026-03-28 18:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd95f98a-fd1a-5f17-b6a9-a915b666da37 with scrape type 2
2026-03-28 18:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd95f98a-fd1a-5f17-b6a9-a915b666da37, identifier: SD16829
2026-03-28 18:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd95f98a-fd1a-5f17-b6a9-a915b666da37 with identifier: SD16829
2026-03-28 18:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd95f98a-fd1a-5f17-b6a9-a915b666da37 with identifier: SD16829
2026-03-28 18:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd95f98a-fd1a-5f17-b6a9-a915b666da37 with identifier: SD16829 to the API
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:13:08Z',
 'fuel_type': 'diesel',
 'id': 'cd95f98a-fd1a-5f17-b6a9-a915b666da37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD16829',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 231272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-27',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2020}
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD16829%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Saving data for SD16829: {'auction_closing_time': 1774883588.0, 'created_time': 1773687047.979033, 'last_price_update_time': 1774723205.795431}
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD16829') HTTP/1.1" 204 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS93004%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for CS93004: 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF41308%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for KF41308: 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK64393%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for LK64393: 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD22353%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for FD22353: 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN30485%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for VN30485: 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD36670%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Scrape type for SD36670: 0
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE98596%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Scrape type for WE98596: 2
2026-03-28 18:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a461d4e9-6994-521f-9ad6-1bfe0e49da20 with identifier: WE98596
2026-03-28 18:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a461d4e9-6994-521f-9ad6-1bfe0e49da20 with scrape type 2
2026-03-28 18:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a461d4e9-6994-521f-9ad6-1bfe0e49da20 with scrape type 2
2026-03-28 18:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a461d4e9-6994-521f-9ad6-1bfe0e49da20, identifier: WE98596
2026-03-28 18:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a461d4e9-6994-521f-9ad6-1bfe0e49da20 with identifier: WE98596
2026-03-28 18:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a461d4e9-6994-521f-9ad6-1bfe0e49da20 with identifier: WE98596
2026-03-28 18:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a461d4e9-6994-521f-9ad6-1bfe0e49da20 with identifier: WE98596 to the API
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:47:50Z',
 'fuel_type': 'petrol',
 'id': 'a461d4e9-6994-521f-9ad6-1bfe0e49da20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE98596',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 163083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-27',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE98596%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Saving data for WE98596: {'auction_closing_time': 1774885670.0, 'created_time': 1774035232.832191, 'last_price_update_time': 1774723206.444014}
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE98596') HTTP/1.1" 204 0
2026-03-28 18:40:06 [scrapy.extensions.logstats] INFO: Crawled 124 pages (at 23 pages/min), scraped 324 items (at 72 items/min)
2026-03-28 18:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-28 18:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:06 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 6004 | hits on page: 40
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ62547%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Scrape type for AJ62547: 2
2026-03-28 18:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd962045-a104-51c0-a1b3-aa3c90ceebfe with identifier: AJ62547
2026-03-28 18:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd962045-a104-51c0-a1b3-aa3c90ceebfe with scrape type 2
2026-03-28 18:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd962045-a104-51c0-a1b3-aa3c90ceebfe with scrape type 2
2026-03-28 18:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd962045-a104-51c0-a1b3-aa3c90ceebfe, identifier: AJ62547
2026-03-28 18:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd962045-a104-51c0-a1b3-aa3c90ceebfe with identifier: AJ62547
2026-03-28 18:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd962045-a104-51c0-a1b3-aa3c90ceebfe with identifier: AJ62547
2026-03-28 18:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd962045-a104-51c0-a1b3-aa3c90ceebfe with identifier: AJ62547 to the API
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:23:04Z',
 'fuel_type': 'diesel',
 'id': 'cd962045-a104-51c0-a1b3-aa3c90ceebfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ62547',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 212372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion Tech',
 'year': 2016}
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ62547%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Saving data for AJ62547: {'auction_closing_time': 1774884184.0, 'created_time': 1773387326.317656, 'last_price_update_time': 1774723207.168081}
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ62547') HTTP/1.1" 204 0
2026-03-28 18:40:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU66110%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for GU66110: 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80803%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for AW80803: 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH52991%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for BH52991: 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL23415%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for AL23415: 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: VS72441
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY72629%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for KY72629: 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME89657%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for ME89657: 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT27495%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for TT27495: 2
2026-03-28 18:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da10f0f6-2187-5e77-b695-35c081abfd46 with identifier: TT27495
2026-03-28 18:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da10f0f6-2187-5e77-b695-35c081abfd46 with scrape type 2
2026-03-28 18:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da10f0f6-2187-5e77-b695-35c081abfd46 with scrape type 2
2026-03-28 18:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da10f0f6-2187-5e77-b695-35c081abfd46, identifier: TT27495
2026-03-28 18:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da10f0f6-2187-5e77-b695-35c081abfd46 with identifier: TT27495
2026-03-28 18:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da10f0f6-2187-5e77-b695-35c081abfd46 with identifier: TT27495
2026-03-28 18:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da10f0f6-2187-5e77-b695-35c081abfd46 with identifier: TT27495 to the API
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:02:24Z',
 'fuel_type': 'petrol',
 'id': 'da10f0f6-2187-5e77-b695-35c081abfd46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT27495',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 186762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-26',
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT27495%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Saving data for TT27495: {'auction_closing_time': 1774882944.0, 'created_time': 1773136860.511477, 'last_price_update_time': 1774723207.736228}
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT27495') HTTP/1.1" 204 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ05712%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for GJ05712: 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM99082%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for ZM99082: 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD50097%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for BD50097: 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ59032%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for FJ59032: 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG98454%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for FG98454: 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85601%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for LM85601: 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU55815%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for XU55815: 0
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD03678%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for CD03678: 2
2026-03-28 18:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bacc78c-8797-5a4e-b48c-daf4c8d89674 with identifier: CD03678
2026-03-28 18:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bacc78c-8797-5a4e-b48c-daf4c8d89674 with scrape type 2
2026-03-28 18:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bacc78c-8797-5a4e-b48c-daf4c8d89674 with scrape type 2
2026-03-28 18:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bacc78c-8797-5a4e-b48c-daf4c8d89674, identifier: CD03678
2026-03-28 18:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bacc78c-8797-5a4e-b48c-daf4c8d89674 with identifier: CD03678
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 18:40:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bacc78c-8797-5a4e-b48c-daf4c8d89674 with identifier: CD03678
2026-03-28 18:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bacc78c-8797-5a4e-b48c-daf4c8d89674 with identifier: CD03678 to the API
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:42:49Z',
 'fuel_type': 'gas',
 'id': '8bacc78c-8797-5a4e-b48c-daf4c8d89674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD03678',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 13382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-07-23',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2025}
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD03678%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [auto1.de] INFO: Saving data for CD03678: {'auction_closing_time': 1774885369.0, 'created_time': 1774033506.75049, 'last_price_update_time': 1774723208.533666}
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD03678') HTTP/1.1" 204 0
2026-03-28 18:40:08 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC14916%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [auto1.de] INFO: Scrape type for EC14916: 0
2026-03-28 18:40:08 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX31470%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [auto1.de] INFO: Scrape type for YX31470: 0
2026-03-28 18:40:08 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-28 18:40:08 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK08111%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [auto1.de] INFO: Scrape type for MK08111: 0
2026-03-28 18:40:08 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP02134%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [auto1.de] INFO: Scrape type for FP02134: 0
2026-03-28 18:40:08 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-28 18:40:08 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-28 18:40:08 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-28 18:40:08 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE87725%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [auto1.de] INFO: Scrape type for UE87725: 0
2026-03-28 18:40:08 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC46979%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [auto1.de] INFO: Scrape type for NC46979: 0
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:09 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 6004 | hits on page: 40
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC92552%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [auto1.de] INFO: Scrape type for XC92552: 0
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42370%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [auto1.de] INFO: Scrape type for UC42370: 0
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV16405%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [auto1.de] INFO: Scrape type for WV16405: 0
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN34178%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [auto1.de] INFO: Scrape type for LN34178: 0
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT49963%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [auto1.de] INFO: Scrape type for BT49963: 0
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA68147%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [auto1.de] INFO: Scrape type for SA68147: 0
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32105%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [auto1.de] INFO: Scrape type for PR32105: 0
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC33817%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [auto1.de] INFO: Scrape type for WC33817: 0
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP89368%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [auto1.de] INFO: Scrape type for MP89368: 0
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX08537%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [auto1.de] INFO: Scrape type for FX08537: 0
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35717%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [auto1.de] INFO: Scrape type for PB35717: 0
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV26171%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [auto1.de] INFO: Scrape type for PV26171: 0
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW84791%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [auto1.de] INFO: Scrape type for RW84791: 0
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-28 18:40:09 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB58565%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [auto1.de] INFO: Scrape type for VB58565: 0
2026-03-28 18:40:10 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-28 18:40:10 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-28 18:40:10 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK27182%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [auto1.de] INFO: Scrape type for EK27182: 0
2026-03-28 18:40:10 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-28 18:40:10 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ06184%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [auto1.de] INFO: Scrape type for ZJ06184: 2
2026-03-28 18:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with identifier: ZJ06184
2026-03-28 18:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with scrape type 2
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with scrape type 2
2026-03-28 18:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2, identifier: ZJ06184
2026-03-28 18:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with identifier: ZJ06184
2026-03-28 18:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with identifier: ZJ06184
2026-03-28 18:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with identifier: ZJ06184 to the API
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:28Z',
 'fuel_type': 'petrol',
 'id': 'a41e0dfb-aba5-5720-8e88-ddac7d34d0f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ06184',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 38802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-12',
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2024}
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ06184%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [auto1.de] INFO: Saving data for ZJ06184: {'auction_closing_time': 1774884208.0, 'created_time': 1774521559.878471, 'last_price_update_time': 1774723210.476638}
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ06184') HTTP/1.1" 204 0
2026-03-28 18:40:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:10 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59666%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [auto1.de] INFO: Scrape type for NL59666: 0
2026-03-28 18:40:10 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-28 18:40:10 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-28 18:40:10 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS67551%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [auto1.de] INFO: Scrape type for MS67551: 0
2026-03-28 18:40:10 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU48960%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [auto1.de] INFO: Scrape type for BU48960: 0
2026-03-28 18:40:10 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-28 18:40:10 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW20696%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [auto1.de] INFO: Scrape type for ZW20696: 0
2026-03-28 18:40:10 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15707%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [auto1.de] INFO: Scrape type for RP15707: 0
2026-03-28 18:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:11 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 6005 | hits on page: 40
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15707%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Scrape type for RP15707: 0
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF33056%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Scrape type for SF33056: 0
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV16812%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Scrape type for ZV16812: 0
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: CE31107
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR33136%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Scrape type for CR33136: 0
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB95771%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Scrape type for FB95771: 0
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH26087%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Scrape type for TH26087: 0
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB29224%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Scrape type for EB29224: 0
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU07666%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Scrape type for VU07666: 0
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17125%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Scrape type for UD17125: 0
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT29520%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Scrape type for KT29520: 0
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ27200%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Scrape type for JZ27200: 0
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ36931%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Scrape type for EZ36931: 0
2026-03-28 18:40:11 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90003%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Scrape type for RD90003: 2
2026-03-28 18:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e28ca1b8-ac01-5dd1-8a88-c297b1710988 with identifier: RD90003
2026-03-28 18:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e28ca1b8-ac01-5dd1-8a88-c297b1710988 with scrape type 2
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e28ca1b8-ac01-5dd1-8a88-c297b1710988 with scrape type 2
2026-03-28 18:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e28ca1b8-ac01-5dd1-8a88-c297b1710988, identifier: RD90003
2026-03-28 18:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e28ca1b8-ac01-5dd1-8a88-c297b1710988 with identifier: RD90003
2026-03-28 18:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e28ca1b8-ac01-5dd1-8a88-c297b1710988 with identifier: RD90003
2026-03-28 18:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e28ca1b8-ac01-5dd1-8a88-c297b1710988 with identifier: RD90003 to the API
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:00:38Z',
 'fuel_type': 'petrol',
 'id': 'e28ca1b8-ac01-5dd1-8a88-c297b1710988',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD90003',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 76273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-25',
 'seller_name': None,
 'title': 'BMW 3er 335i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90003%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Saving data for RD90003: {'auction_closing_time': 1774882838.0, 'created_time': 1773945959.49454, 'last_price_update_time': 1774723212.291865}
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD90003') HTTP/1.1" 204 0
2026-03-28 18:40:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17316%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for NS17316: 0
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA79270%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for UA79270: 0
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT34266%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for HT34266: 0
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS63557%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for LS63557: 0
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA34239%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for GA34239: 0
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62580%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for CK62580: 0
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS18464%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for AS18464: 0
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24708%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for MD24708: 0
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE68456%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for WE68456: 0
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH37191%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for JH37191: 0
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-28 18:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:13 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 6005 | hits on page: 40
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: BX95848
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD48947%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [auto1.de] INFO: Scrape type for GD48947: 0
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB93381%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [auto1.de] INFO: Scrape type for SB93381: 0
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13516%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [auto1.de] INFO: Scrape type for ZY13516: 0
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS04882%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [auto1.de] INFO: Scrape type for DS04882: 0
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF58718%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [auto1.de] INFO: Scrape type for DF58718: 0
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW18097%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [auto1.de] INFO: Scrape type for VW18097: 0
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT06802%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [auto1.de] INFO: Scrape type for PT06802: 2
2026-03-28 18:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f08ea15-f122-5917-bb28-6d28a2170e40 with identifier: PT06802
2026-03-28 18:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f08ea15-f122-5917-bb28-6d28a2170e40 with scrape type 2
2026-03-28 18:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f08ea15-f122-5917-bb28-6d28a2170e40 with scrape type 2
2026-03-28 18:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f08ea15-f122-5917-bb28-6d28a2170e40, identifier: PT06802
2026-03-28 18:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f08ea15-f122-5917-bb28-6d28a2170e40 with identifier: PT06802
2026-03-28 18:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f08ea15-f122-5917-bb28-6d28a2170e40 with identifier: PT06802
2026-03-28 18:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f08ea15-f122-5917-bb28-6d28a2170e40 with identifier: PT06802 to the API
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:54Z',
 'fuel_type': 'diesel',
 'id': '0f08ea15-f122-5917-bb28-6d28a2170e40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT06802',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 157435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-19',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT06802%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Saving data for PT06802: {'auction_closing_time': 1774883334.0, 'created_time': 1773341717.801121, 'last_price_update_time': 1774723214.171035}
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT06802') HTTP/1.1" 204 0
2026-03-28 18:40:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND71699%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Scrape type for ND71699: 0
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC89129%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Scrape type for XC89129: 0
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV32986%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Scrape type for DV32986: 0
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR51740%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Scrape type for YR51740: 0
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK34206%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Scrape type for HK34206: 0
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA63684%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Scrape type for WA63684: 0
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK33698%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Scrape type for DK33698: 0
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS76993%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Scrape type for FS76993: 0
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX53792%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Scrape type for BX53792: 2
2026-03-28 18:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2e1ca8-bccc-5452-8bbb-396034b0b682 with identifier: BX53792
2026-03-28 18:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2e1ca8-bccc-5452-8bbb-396034b0b682 with scrape type 2
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da2e1ca8-bccc-5452-8bbb-396034b0b682 with scrape type 2
2026-03-28 18:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da2e1ca8-bccc-5452-8bbb-396034b0b682, identifier: BX53792
2026-03-28 18:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da2e1ca8-bccc-5452-8bbb-396034b0b682 with identifier: BX53792
2026-03-28 18:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da2e1ca8-bccc-5452-8bbb-396034b0b682 with identifier: BX53792
2026-03-28 18:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da2e1ca8-bccc-5452-8bbb-396034b0b682 with identifier: BX53792 to the API
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 114,
 'expiration_date': '2026-03-30T15:06:17Z',
 'fuel_type': 'petrol',
 'id': 'da2e1ca8-bccc-5452-8bbb-396034b0b682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX53792',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 64874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.5 TSI Style Maxi',
 'transmission': 'automatic',
 'trim': 'Style Maxi',
 'year': 2021}
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX53792%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Saving data for BX53792: {'auction_closing_time': 1774883177.0, 'created_time': 1774636545.749979, 'last_price_update_time': 1774723214.850747}
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX53792') HTTP/1.1" 204 0
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40485%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Scrape type for RS40485: 2
2026-03-28 18:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with identifier: RS40485
2026-03-28 18:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with scrape type 2
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with scrape type 2
2026-03-28 18:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2, identifier: RS40485
2026-03-28 18:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with identifier: RS40485
2026-03-28 18:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with identifier: RS40485
2026-03-28 18:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with identifier: RS40485 to the API
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:47:57Z',
 'fuel_type': 'petrol',
 'id': '76b9b278-bbcc-58a8-9c0a-36292b7fd2a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS40485',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 194739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2016}
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40485%27 HTTP/1.1" 200 None
2026-03-28 18:40:15 [auto1.de] INFO: Saving data for RS40485: {'auction_closing_time': 1774885677.0, 'created_time': 1774118528.496655, 'last_price_update_time': 1774723215.392311}
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS40485') HTTP/1.1" 204 0
2026-03-28 18:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:16 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 6005 | hits on page: 40
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR87592%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for AR87592: 0
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS96919%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for FS96919: 0
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56575%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for MK56575: 0
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA77246%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for EA77246: 0
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD35692%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for SD35692: 0
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: EE67524
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV26734%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for XV26734: 0
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG69344%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for NG69344: 0
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW88785%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for ZW88785: 0
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG80172%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for UG80172: 0
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP74565%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for EP74565: 0
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN13458%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for DN13458: 0
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC95378%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for AC95378: 0
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN38152%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for LN38152: 0
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-28 18:40:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:17 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 6005 | hits on page: 40
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS72291%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [auto1.de] INFO: Scrape type for YS72291: 0
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ83325%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [auto1.de] INFO: Scrape type for EJ83325: 0
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR97485%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [auto1.de] INFO: Scrape type for HR97485: 0
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY91019%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [auto1.de] INFO: Scrape type for HY91019: 2
2026-03-28 18:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90541646-e078-58c3-993c-2b9fad0b9fee with identifier: HY91019
2026-03-28 18:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90541646-e078-58c3-993c-2b9fad0b9fee with scrape type 2
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90541646-e078-58c3-993c-2b9fad0b9fee with scrape type 2
2026-03-28 18:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90541646-e078-58c3-993c-2b9fad0b9fee, identifier: HY91019
2026-03-28 18:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90541646-e078-58c3-993c-2b9fad0b9fee with identifier: HY91019
2026-03-28 18:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90541646-e078-58c3-993c-2b9fad0b9fee with identifier: HY91019
2026-03-28 18:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90541646-e078-58c3-993c-2b9fad0b9fee with identifier: HY91019 to the API
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:54:44Z',
 'fuel_type': 'diesel',
 'id': '90541646-e078-58c3-993c-2b9fad0b9fee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY91019',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 223433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-12',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 CDTI DPF Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY91019%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [auto1.de] INFO: Saving data for HY91019: {'auction_closing_time': 1774886084.0, 'created_time': 1774550143.984592, 'last_price_update_time': 1774723217.998759}
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY91019') HTTP/1.1" 204 0
2026-03-28 18:40:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD62787%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for PD62787: 0
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY28796%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for ZY28796: 0
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL68687%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for EL68687: 0
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB37125%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for RB37125: 0
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG33600%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for MG33600: 0
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB28206%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for SB28206: 2
2026-03-28 18:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with identifier: SB28206
2026-03-28 18:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with scrape type 2
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with scrape type 2
2026-03-28 18:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33, identifier: SB28206
2026-03-28 18:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with identifier: SB28206
2026-03-28 18:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with identifier: SB28206
2026-03-28 18:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with identifier: SB28206 to the API
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 460,
 'expiration_date': '2026-03-30T15:49:23Z',
 'fuel_type': 'petrol',
 'id': '99764afe-bacb-5dcb-9d8b-3e41dfeabf33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB28206',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 96205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-05',
 'seller_name': None,
 'title': 'Porsche Panamera GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB28206%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Saving data for SB28206: {'auction_closing_time': 1774885763.0, 'created_time': 1773427608.849925, 'last_price_update_time': 1774723218.805848}
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB28206') HTTP/1.1" 204 0
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59851%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for UA59851: 0
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN24423%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for GN24423: 0
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN78451%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for AN78451: 0
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW23884%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for UW23884: 0
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD27320%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for MD27320: 0
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX93586%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for EX93586: 0
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65942%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for CA65942: 0
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV85283%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for NV85283: 0
2026-03-28 18:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:19 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 6005 | hits on page: 40
2026-03-28 18:40:19 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP12697%27 HTTP/1.1" 200 None
2026-03-28 18:40:19 [auto1.de] INFO: Scrape type for KP12697: 0
2026-03-28 18:40:19 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74953%27 HTTP/1.1" 200 None
2026-03-28 18:40:19 [auto1.de] INFO: Scrape type for UY74953: 2
2026-03-28 18:40:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9721ed22-61f8-579a-86ea-8b999fbc939a with identifier: UY74953
2026-03-28 18:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9721ed22-61f8-579a-86ea-8b999fbc939a with scrape type 2
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9721ed22-61f8-579a-86ea-8b999fbc939a with scrape type 2
2026-03-28 18:40:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9721ed22-61f8-579a-86ea-8b999fbc939a, identifier: UY74953
2026-03-28 18:40:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9721ed22-61f8-579a-86ea-8b999fbc939a with identifier: UY74953
2026-03-28 18:40:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9721ed22-61f8-579a-86ea-8b999fbc939a with identifier: UY74953
2026-03-28 18:40:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9721ed22-61f8-579a-86ea-8b999fbc939a with identifier: UY74953 to the API
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:18Z',
 'fuel_type': 'petrol',
 'id': '9721ed22-61f8-579a-86ea-8b999fbc939a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY74953',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 116889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-18',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2019}
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74953%27 HTTP/1.1" 200 None
2026-03-28 18:40:20 [auto1.de] INFO: Saving data for UY74953: {'auction_closing_time': 1774885578.0, 'created_time': 1774521387.225599, 'last_price_update_time': 1774723220.505994}
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY74953') HTTP/1.1" 204 0
2026-03-28 18:40:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:20 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB26055%27 HTTP/1.1" 200 None
2026-03-28 18:40:20 [auto1.de] INFO: Scrape type for UB26055: 0
2026-03-28 18:40:20 [auto1.de] INFO: Found listing with ID: VL71663
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL71663%27 HTTP/1.1" 200 None
2026-03-28 18:40:20 [auto1.de] INFO: Scrape type for VL71663: 2
2026-03-28 18:40:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e with identifier: VL71663
2026-03-28 18:40:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e with scrape type 2
2026-03-28 18:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e with scrape type 2
2026-03-28 18:40:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e, identifier: VL71663
2026-03-28 18:40:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e with identifier: VL71663
2026-03-28 18:40:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e with identifier: VL71663
2026-03-28 18:40:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e with identifier: VL71663 to the API
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:44:40Z',
 'fuel_type': 'petrol',
 'id': '2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL71663',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 75847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-22',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2010}
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL71663%27 HTTP/1.1" 200 None
2026-03-28 18:40:21 [auto1.de] INFO: Saving data for VL71663: {'auction_closing_time': 1774885480.0, 'created_time': 1773399800.307125, 'last_price_update_time': 1774723221.042114}
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL71663') HTTP/1.1" 204 0
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54532%27 HTTP/1.1" 200 None
2026-03-28 18:40:21 [auto1.de] INFO: Scrape type for JP54532: 2
2026-03-28 18:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea650558-1c08-5add-b2b7-ada85aaec06c with identifier: JP54532
2026-03-28 18:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea650558-1c08-5add-b2b7-ada85aaec06c with scrape type 2
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea650558-1c08-5add-b2b7-ada85aaec06c with scrape type 2
2026-03-28 18:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea650558-1c08-5add-b2b7-ada85aaec06c, identifier: JP54532
2026-03-28 18:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea650558-1c08-5add-b2b7-ada85aaec06c with identifier: JP54532
2026-03-28 18:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea650558-1c08-5add-b2b7-ada85aaec06c with identifier: JP54532
2026-03-28 18:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea650558-1c08-5add-b2b7-ada85aaec06c with identifier: JP54532 to the API
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:58:09Z',
 'fuel_type': 'diesel',
 'id': 'ea650558-1c08-5add-b2b7-ada85aaec06c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP54532',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 137806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-19',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54532%27 HTTP/1.1" 200 None
2026-03-28 18:40:21 [auto1.de] INFO: Saving data for JP54532: {'auction_closing_time': 1774886289.0, 'created_time': 1774636655.872037, 'last_price_update_time': 1774723221.513892}
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP54532') HTTP/1.1" 204 0
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ93554%27 HTTP/1.1" 200 None
2026-03-28 18:40:21 [auto1.de] INFO: Scrape type for DJ93554: 0
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU40384%27 HTTP/1.1" 200 None
2026-03-28 18:40:21 [auto1.de] INFO: Scrape type for NU40384: 0
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU60494%27 HTTP/1.1" 200 None
2026-03-28 18:40:21 [auto1.de] INFO: Scrape type for GU60494: 0
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX70218%27 HTTP/1.1" 200 None
2026-03-28 18:40:21 [auto1.de] INFO: Scrape type for MX70218: 0
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP31898%27 HTTP/1.1" 200 None
2026-03-28 18:40:21 [auto1.de] INFO: Scrape type for EP31898: 0
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83336%27 HTTP/1.1" 200 None
2026-03-28 18:40:21 [auto1.de] INFO: Scrape type for EE83336: 0
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE21325%27 HTTP/1.1" 200 None
2026-03-28 18:40:21 [auto1.de] INFO: Scrape type for GE21325: 0
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ31328%27 HTTP/1.1" 200 None
2026-03-28 18:40:21 [auto1.de] INFO: Scrape type for MJ31328: 2
2026-03-28 18:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b84099-821b-510d-88bb-cf736ad45bc1 with identifier: MJ31328
2026-03-28 18:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b84099-821b-510d-88bb-cf736ad45bc1 with scrape type 2
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44b84099-821b-510d-88bb-cf736ad45bc1 with scrape type 2
2026-03-28 18:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44b84099-821b-510d-88bb-cf736ad45bc1, identifier: MJ31328
2026-03-28 18:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44b84099-821b-510d-88bb-cf736ad45bc1 with identifier: MJ31328
2026-03-28 18:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44b84099-821b-510d-88bb-cf736ad45bc1 with identifier: MJ31328
2026-03-28 18:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44b84099-821b-510d-88bb-cf736ad45bc1 with identifier: MJ31328 to the API
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:09:57Z',
 'fuel_type': 'diesel',
 'id': '44b84099-821b-510d-88bb-cf736ad45bc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ31328',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 136968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ31328%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [auto1.de] INFO: Saving data for MJ31328: {'auction_closing_time': 1774883397.0, 'created_time': 1773916683.896658, 'last_price_update_time': 1774723222.093247}
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ31328') HTTP/1.1" 204 0
2026-03-28 18:40:22 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS82974%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [auto1.de] INFO: Scrape type for XS82974: 2
2026-03-28 18:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff3586be-9a23-5b56-b884-b1a75f68d30d with identifier: XS82974
2026-03-28 18:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff3586be-9a23-5b56-b884-b1a75f68d30d with scrape type 2
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff3586be-9a23-5b56-b884-b1a75f68d30d with scrape type 2
2026-03-28 18:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff3586be-9a23-5b56-b884-b1a75f68d30d, identifier: XS82974
2026-03-28 18:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff3586be-9a23-5b56-b884-b1a75f68d30d with identifier: XS82974
2026-03-28 18:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff3586be-9a23-5b56-b884-b1a75f68d30d with identifier: XS82974
2026-03-28 18:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff3586be-9a23-5b56-b884-b1a75f68d30d with identifier: XS82974 to the API
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:23:33Z',
 'fuel_type': 'petrol',
 'id': 'ff3586be-9a23-5b56-b884-b1a75f68d30d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS82974',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 70814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-30',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Soleil',
 'transmission': 'manual',
 'trim': 'Soleil',
 'year': 2019}
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS82974%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [auto1.de] INFO: Saving data for XS82974: {'auction_closing_time': 1774884213.0, 'created_time': 1773307592.426424, 'last_price_update_time': 1774723222.659907}
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS82974') HTTP/1.1" 204 0
2026-03-28 18:40:22 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-28 18:40:22 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE81199%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [auto1.de] INFO: Scrape type for AE81199: 0
2026-03-28 18:40:22 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-28 18:40:22 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT53290%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [auto1.de] INFO: Scrape type for DT53290: 0
2026-03-28 18:40:22 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-28 18:40:22 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-28 18:40:22 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV53612%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [auto1.de] INFO: Scrape type for XV53612: 0
2026-03-28 18:40:22 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ28276%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [auto1.de] INFO: Scrape type for HJ28276: 0
2026-03-28 18:40:22 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ72456%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [auto1.de] INFO: Scrape type for FJ72456: 0
2026-03-28 18:40:22 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP66388%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [auto1.de] INFO: Scrape type for ZP66388: 0
2026-03-28 18:40:22 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44643%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [auto1.de] INFO: Scrape type for YH44643: 0
2026-03-28 18:40:22 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT78073%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [auto1.de] INFO: Scrape type for PT78073: 0
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:33 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 6005 | hits on page: 40
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP08522%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [auto1.de] INFO: Scrape type for JP08522: 0
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21750%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [auto1.de] INFO: Scrape type for YJ21750: 0
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72083%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [auto1.de] INFO: Scrape type for JJ72083: 0
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN91045%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [auto1.de] INFO: Scrape type for CN91045: 2
2026-03-28 18:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0af9f807-30ca-590c-a7a9-913ce2c6a807 with identifier: CN91045
2026-03-28 18:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af9f807-30ca-590c-a7a9-913ce2c6a807 with scrape type 2
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0af9f807-30ca-590c-a7a9-913ce2c6a807 with scrape type 2
2026-03-28 18:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0af9f807-30ca-590c-a7a9-913ce2c6a807, identifier: CN91045
2026-03-28 18:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0af9f807-30ca-590c-a7a9-913ce2c6a807 with identifier: CN91045
2026-03-28 18:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0af9f807-30ca-590c-a7a9-913ce2c6a807 with identifier: CN91045
2026-03-28 18:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0af9f807-30ca-590c-a7a9-913ce2c6a807 with identifier: CN91045 to the API
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:51:18Z',
 'fuel_type': 'petrol',
 'id': '0af9f807-30ca-590c-a7a9-913ce2c6a807',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN91045',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 136643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-18',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN91045%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [auto1.de] INFO: Saving data for CN91045: {'auction_closing_time': 1774885878.0, 'created_time': 1773945746.769541, 'last_price_update_time': 1774723233.855869}
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN91045') HTTP/1.1" 204 0
2026-03-28 18:40:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC44419%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [auto1.de] INFO: Scrape type for YC44419: 0
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM29891%27 HTTP/1.1" 200 None
2026-03-28 18:40:34 [auto1.de] INFO: Scrape type for MM29891: 0
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX18884%27 HTTP/1.1" 200 None
2026-03-28 18:40:34 [auto1.de] INFO: Scrape type for CX18884: 2
2026-03-28 18:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32 with identifier: CX18884
2026-03-28 18:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32 with scrape type 2
2026-03-28 18:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32 with scrape type 2
2026-03-28 18:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32, identifier: CX18884
2026-03-28 18:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32 with identifier: CX18884
2026-03-28 18:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32 with identifier: CX18884
2026-03-28 18:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32 with identifier: CX18884 to the API
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:14Z',
 'fuel_type': 'diesel',
 'id': 'c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX18884',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 151166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-02',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition 4x4',
 'transmission': 'manual',
 'trim': 'Ambition 4x4',
 'year': 2016}
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX18884%27 HTTP/1.1" 200 None
2026-03-28 18:40:34 [auto1.de] INFO: Saving data for CX18884: {'auction_closing_time': 1774885514.0, 'created_time': 1774034375.286087, 'last_price_update_time': 1774723234.448431}
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX18884') HTTP/1.1" 204 0
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ82092%27 HTTP/1.1" 200 None
2026-03-28 18:40:34 [auto1.de] INFO: Scrape type for VJ82092: 0
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ42381%27 HTTP/1.1" 200 None
2026-03-28 18:40:34 [auto1.de] INFO: Scrape type for WZ42381: 0
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36219%27 HTTP/1.1" 200 None
2026-03-28 18:40:34 [auto1.de] INFO: Scrape type for CD36219: 0
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC57954%27 HTTP/1.1" 200 None
2026-03-28 18:40:34 [auto1.de] INFO: Scrape type for MC57954: 0
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03695%27 HTTP/1.1" 200 None
2026-03-28 18:40:34 [auto1.de] INFO: Scrape type for VV03695: 0
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92494%27 HTTP/1.1" 200 None
2026-03-28 18:40:34 [auto1.de] INFO: Scrape type for MV92494: 0
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE71125%27 HTTP/1.1" 200 None
2026-03-28 18:40:34 [auto1.de] INFO: Scrape type for AE71125: 0
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-28 18:40:34 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP65815%27 HTTP/1.1" 200 None
2026-03-28 18:40:34 [auto1.de] INFO: Scrape type for RP65815: 2
2026-03-28 18:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c74e39d6-1e5d-5c78-824b-6fbb34392ee6 with identifier: RP65815
2026-03-28 18:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c74e39d6-1e5d-5c78-824b-6fbb34392ee6 with scrape type 2
2026-03-28 18:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c74e39d6-1e5d-5c78-824b-6fbb34392ee6 with scrape type 2
2026-03-28 18:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c74e39d6-1e5d-5c78-824b-6fbb34392ee6, identifier: RP65815
2026-03-28 18:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c74e39d6-1e5d-5c78-824b-6fbb34392ee6 with identifier: RP65815
2026-03-28 18:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c74e39d6-1e5d-5c78-824b-6fbb34392ee6 with identifier: RP65815
2026-03-28 18:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c74e39d6-1e5d-5c78-824b-6fbb34392ee6 with identifier: RP65815 to the API
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:13:05Z',
 'fuel_type': 'diesel',
 'id': 'c74e39d6-1e5d-5c78-824b-6fbb34392ee6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP65815',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 331867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-27',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2008}
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP65815%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [auto1.de] INFO: Saving data for RP65815: {'auction_closing_time': 1774883585.0, 'created_time': 1774550186.889014, 'last_price_update_time': 1774723235.031152}
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP65815') HTTP/1.1" 204 0
2026-03-28 18:40:35 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ41620%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [auto1.de] INFO: Scrape type for MJ41620: 0
2026-03-28 18:40:35 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV65540%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [auto1.de] INFO: Scrape type for HV65540: 0
2026-03-28 18:40:35 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS05974%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [auto1.de] INFO: Scrape type for TS05974: 0
2026-03-28 18:40:35 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-28 18:40:35 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME33936%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [auto1.de] INFO: Scrape type for ME33936: 0
2026-03-28 18:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:37 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 6006 | hits on page: 40
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME33936%27 HTTP/1.1" 200 None
2026-03-28 18:40:37 [auto1.de] INFO: Scrape type for ME33936: 0
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU80256%27 HTTP/1.1" 200 None
2026-03-28 18:40:37 [auto1.de] INFO: Scrape type for CU80256: 0
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG19497%27 HTTP/1.1" 200 None
2026-03-28 18:40:37 [auto1.de] INFO: Scrape type for DG19497: 0
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH86896%27 HTTP/1.1" 200 None
2026-03-28 18:40:37 [auto1.de] INFO: Scrape type for NH86896: 0
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB80286%27 HTTP/1.1" 200 None
2026-03-28 18:40:37 [auto1.de] INFO: Scrape type for CB80286: 0
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV38848%27 HTTP/1.1" 200 None
2026-03-28 18:40:37 [auto1.de] INFO: Scrape type for WV38848: 0
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH59786%27 HTTP/1.1" 200 None
2026-03-28 18:40:37 [auto1.de] INFO: Scrape type for RH59786: 2
2026-03-28 18:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d5d2bbf-0582-56ee-9195-0e9f85242ec5 with identifier: RH59786
2026-03-28 18:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d5d2bbf-0582-56ee-9195-0e9f85242ec5 with scrape type 2
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d5d2bbf-0582-56ee-9195-0e9f85242ec5 with scrape type 2
2026-03-28 18:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d5d2bbf-0582-56ee-9195-0e9f85242ec5, identifier: RH59786
2026-03-28 18:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d5d2bbf-0582-56ee-9195-0e9f85242ec5 with identifier: RH59786
2026-03-28 18:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d5d2bbf-0582-56ee-9195-0e9f85242ec5 with identifier: RH59786
2026-03-28 18:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d5d2bbf-0582-56ee-9195-0e9f85242ec5 with identifier: RH59786 to the API
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-30T15:59:23Z',
 'fuel_type': 'petrol',
 'id': '7d5d2bbf-0582-56ee-9195-0e9f85242ec5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH59786',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 47414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2021}
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH59786%27 HTTP/1.1" 200 None
2026-03-28 18:40:37 [auto1.de] INFO: Saving data for RH59786: {'auction_closing_time': 1774886363.0, 'created_time': 1774636703.76946, 'last_price_update_time': 1774723237.839323}
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH59786') HTTP/1.1" 204 0
2026-03-28 18:40:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG97713%27 HTTP/1.1" 200 None
2026-03-28 18:40:37 [auto1.de] INFO: Scrape type for LG97713: 2
2026-03-28 18:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35e4167-adde-526d-894f-cb321b7beb29 with identifier: LG97713
2026-03-28 18:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35e4167-adde-526d-894f-cb321b7beb29 with scrape type 2
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b35e4167-adde-526d-894f-cb321b7beb29 with scrape type 2
2026-03-28 18:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b35e4167-adde-526d-894f-cb321b7beb29, identifier: LG97713
2026-03-28 18:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b35e4167-adde-526d-894f-cb321b7beb29 with identifier: LG97713
2026-03-28 18:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b35e4167-adde-526d-894f-cb321b7beb29 with identifier: LG97713
2026-03-28 18:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b35e4167-adde-526d-894f-cb321b7beb29 with identifier: LG97713 to the API
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:22Z',
 'fuel_type': 'petrol',
 'id': 'b35e4167-adde-526d-894f-cb321b7beb29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG97713',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 178105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-21',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG97713%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [auto1.de] INFO: Saving data for LG97713: {'auction_closing_time': 1774883302.0, 'created_time': 1773383640.909864, 'last_price_update_time': 1774723238.412865}
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG97713') HTTP/1.1" 204 0
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN24396%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [auto1.de] INFO: Scrape type for HN24396: 0
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21744%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [auto1.de] INFO: Scrape type for RX21744: 0
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS84197%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [auto1.de] INFO: Scrape type for PS84197: 0
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD49468%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [auto1.de] INFO: Scrape type for KD49468: 0
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV56275%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [auto1.de] INFO: Scrape type for MV56275: 2
2026-03-28 18:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6189e685-b492-5397-8129-9f814bfe874c with identifier: MV56275
2026-03-28 18:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6189e685-b492-5397-8129-9f814bfe874c with scrape type 2
2026-03-28 18:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6189e685-b492-5397-8129-9f814bfe874c with scrape type 2
2026-03-28 18:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6189e685-b492-5397-8129-9f814bfe874c, identifier: MV56275
2026-03-28 18:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6189e685-b492-5397-8129-9f814bfe874c with identifier: MV56275
2026-03-28 18:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6189e685-b492-5397-8129-9f814bfe874c with identifier: MV56275
2026-03-28 18:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6189e685-b492-5397-8129-9f814bfe874c with identifier: MV56275 to the API
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:00:51Z',
 'fuel_type': 'petrol',
 'id': '6189e685-b492-5397-8129-9f814bfe874c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV56275',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 151634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-30',
 'seller_name': None,
 'title': 'Honda Jazz 1.2 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2011}
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV56275%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [auto1.de] INFO: Saving data for MV56275: {'auction_closing_time': 1774882851.0, 'created_time': 1774521560.807268, 'last_price_update_time': 1774723238.955685}
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV56275') HTTP/1.1" 204 0
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17279%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [auto1.de] INFO: Scrape type for UD17279: 0
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE18178%27 HTTP/1.1" 200 None
2026-03-28 18:40:39 [auto1.de] INFO: Scrape type for TE18178: 2
2026-03-28 18:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79dffafe-0f64-5b51-9798-089d607e652c with identifier: TE18178
2026-03-28 18:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79dffafe-0f64-5b51-9798-089d607e652c with scrape type 2
2026-03-28 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79dffafe-0f64-5b51-9798-089d607e652c with scrape type 2
2026-03-28 18:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79dffafe-0f64-5b51-9798-089d607e652c, identifier: TE18178
2026-03-28 18:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79dffafe-0f64-5b51-9798-089d607e652c with identifier: TE18178
2026-03-28 18:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79dffafe-0f64-5b51-9798-089d607e652c with identifier: TE18178
2026-03-28 18:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79dffafe-0f64-5b51-9798-089d607e652c with identifier: TE18178 to the API
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:20:54Z',
 'fuel_type': 'diesel',
 'id': '79dffafe-0f64-5b51-9798-089d607e652c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE18178',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 165027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-27',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
 'transmission': 'manual',
 'trim': 'Allure L1',
 'year': 2020}
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE18178%27 HTTP/1.1" 200 None
2026-03-28 18:40:39 [auto1.de] INFO: Saving data for TE18178: {'auction_closing_time': 1774884054.0, 'created_time': 1774522019.192393, 'last_price_update_time': 1774723239.475896}
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE18178') HTTP/1.1" 204 0
2026-03-28 18:40:39 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77332%27 HTTP/1.1" 200 None
2026-03-28 18:40:39 [auto1.de] INFO: Scrape type for UR77332: 0
2026-03-28 18:40:39 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG53647%27 HTTP/1.1" 200 None
2026-03-28 18:40:39 [auto1.de] INFO: Scrape type for AG53647: 0
2026-03-28 18:40:39 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-28 18:40:39 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73613%27 HTTP/1.1" 200 None
2026-03-28 18:40:39 [auto1.de] INFO: Scrape type for MR73613: 0
2026-03-28 18:40:39 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-28 18:40:39 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-28 18:40:39 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-28 18:40:39 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA92521%27 HTTP/1.1" 200 None
2026-03-28 18:40:39 [auto1.de] INFO: Scrape type for TA92521: 0
2026-03-28 18:40:39 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM70147%27 HTTP/1.1" 200 None
2026-03-28 18:40:39 [auto1.de] INFO: Scrape type for JM70147: 0
2026-03-28 18:40:39 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-28 18:40:39 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA13205%27 HTTP/1.1" 200 None
2026-03-28 18:40:39 [auto1.de] INFO: Scrape type for LA13205: 2
2026-03-28 18:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e3a79fc-f092-5a6f-9873-aa603862f30e with identifier: LA13205
2026-03-28 18:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e3a79fc-f092-5a6f-9873-aa603862f30e with scrape type 2
2026-03-28 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e3a79fc-f092-5a6f-9873-aa603862f30e with scrape type 2
2026-03-28 18:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e3a79fc-f092-5a6f-9873-aa603862f30e, identifier: LA13205
2026-03-28 18:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e3a79fc-f092-5a6f-9873-aa603862f30e with identifier: LA13205
2026-03-28 18:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e3a79fc-f092-5a6f-9873-aa603862f30e with identifier: LA13205
2026-03-28 18:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e3a79fc-f092-5a6f-9873-aa603862f30e with identifier: LA13205 to the API
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:45:58Z',
 'fuel_type': 'petrol',
 'id': '3e3a79fc-f092-5a6f-9873-aa603862f30e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA13205',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 28601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-23',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 MyLive',
 'transmission': 'manual',
 'trim': 'MyLive',
 'year': 2011}
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA13205%27 HTTP/1.1" 200 None
2026-03-28 18:40:40 [auto1.de] INFO: Saving data for LA13205: {'auction_closing_time': 1774885558.0, 'created_time': 1774522544.785169, 'last_price_update_time': 1774723240.129629}
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA13205') HTTP/1.1" 204 0
2026-03-28 18:40:40 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76571%27 HTTP/1.1" 200 None
2026-03-28 18:40:40 [auto1.de] INFO: Scrape type for GZ76571: 0
2026-03-28 18:40:40 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN25126%27 HTTP/1.1" 200 None
2026-03-28 18:40:40 [auto1.de] INFO: Scrape type for RN25126: 0
2026-03-28 18:40:40 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD52891%27 HTTP/1.1" 200 None
2026-03-28 18:40:40 [auto1.de] INFO: Scrape type for HD52891: 0
2026-03-28 18:40:40 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS16825%27 HTTP/1.1" 200 None
2026-03-28 18:40:40 [auto1.de] INFO: Scrape type for NS16825: 0
2026-03-28 18:40:40 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP73203%27 HTTP/1.1" 200 None
2026-03-28 18:40:40 [auto1.de] INFO: Scrape type for CP73203: 0
2026-03-28 18:40:40 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA95211%27 HTTP/1.1" 200 None
2026-03-28 18:40:40 [auto1.de] INFO: Scrape type for TA95211: 2
2026-03-28 18:40:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56cd4d27-6c7f-5503-a757-8d729027e732 with identifier: TA95211
2026-03-28 18:40:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56cd4d27-6c7f-5503-a757-8d729027e732 with scrape type 2
2026-03-28 18:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56cd4d27-6c7f-5503-a757-8d729027e732 with scrape type 2
2026-03-28 18:40:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56cd4d27-6c7f-5503-a757-8d729027e732, identifier: TA95211
2026-03-28 18:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56cd4d27-6c7f-5503-a757-8d729027e732 with identifier: TA95211
2026-03-28 18:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56cd4d27-6c7f-5503-a757-8d729027e732 with identifier: TA95211
2026-03-28 18:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56cd4d27-6c7f-5503-a757-8d729027e732 with identifier: TA95211 to the API
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:21Z',
 'fuel_type': 'petrol',
 'id': '56cd4d27-6c7f-5503-a757-8d729027e732',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA95211',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 187428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-16',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA95211%27 HTTP/1.1" 200 None
2026-03-28 18:40:40 [auto1.de] INFO: Saving data for TA95211: {'auction_closing_time': 1774884501.0, 'created_time': 1774522386.291722, 'last_price_update_time': 1774723240.868523}
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA95211') HTTP/1.1" 204 0
2026-03-28 18:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:41 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 6006 | hits on page: 40
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK60563%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [auto1.de] INFO: Scrape type for JK60563: 0
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN86111%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [auto1.de] INFO: Scrape type for UN86111: 0
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ44451%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [auto1.de] INFO: Scrape type for KJ44451: 2
2026-03-28 18:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03087a0d-cbd5-5c0f-9334-24c662e83c9f with identifier: KJ44451
2026-03-28 18:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03087a0d-cbd5-5c0f-9334-24c662e83c9f with scrape type 2
2026-03-28 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03087a0d-cbd5-5c0f-9334-24c662e83c9f with scrape type 2
2026-03-28 18:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03087a0d-cbd5-5c0f-9334-24c662e83c9f, identifier: KJ44451
2026-03-28 18:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03087a0d-cbd5-5c0f-9334-24c662e83c9f with identifier: KJ44451
2026-03-28 18:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03087a0d-cbd5-5c0f-9334-24c662e83c9f with identifier: KJ44451
2026-03-28 18:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03087a0d-cbd5-5c0f-9334-24c662e83c9f with identifier: KJ44451 to the API
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:26:59Z',
 'fuel_type': 'diesel',
 'id': '03087a0d-cbd5-5c0f-9334-24c662e83c9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ44451',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 204410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-27',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2008}
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ44451%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [auto1.de] INFO: Saving data for KJ44451: {'auction_closing_time': 1774884419.0, 'created_time': 1774522220.252579, 'last_price_update_time': 1774723241.592158}
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ44451') HTTP/1.1" 204 0
2026-03-28 18:40:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ29676%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [auto1.de] INFO: Scrape type for YZ29676: 0
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP13767%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [auto1.de] INFO: Scrape type for GP13767: 0
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51432%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [auto1.de] INFO: Scrape type for RU51432: 0
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH83727%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [auto1.de] INFO: Scrape type for FH83727: 2
2026-03-28 18:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727
2026-03-28 18:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3e642c-a2bf-5ae2-9bf5-274759b71517 with scrape type 2
2026-03-28 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be3e642c-a2bf-5ae2-9bf5-274759b71517 with scrape type 2
2026-03-28 18:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be3e642c-a2bf-5ae2-9bf5-274759b71517, identifier: FH83727
2026-03-28 18:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727
2026-03-28 18:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727
2026-03-28 18:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727 to the API
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:00:14Z',
 'fuel_type': 'diesel',
 'id': 'be3e642c-a2bf-5ae2-9bf5-274759b71517',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH83727',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 29035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI IQ.DRIVE 4Motion',
 'transmission': 'automatic',
 'trim': 'IQ.DRIVE 4Motion',
 'year': 2019}
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH83727%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Saving data for FH83727: {'auction_closing_time': 1774882814.0, 'created_time': 1774521891.880888, 'last_price_update_time': 1774723242.131602}
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH83727') HTTP/1.1" 204 0
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX22441%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for SX22441: 0
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ80305%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for FZ80305: 0
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ77178%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for HJ77178: 0
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR36805%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for XR36805: 0
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: JX01740
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB82459%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for BB82459: 0
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV29238%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for MV29238: 0
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA20314%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for NA20314: 0
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC16092%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for VC16092: 0
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP93832%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for AP93832: 0
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG78657%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for CG78657: 0
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF39104%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for LF39104: 0
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR76591%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for TR76591: 2
2026-03-28 18:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ce736f-2978-5984-864f-c108d574507a with identifier: TR76591
2026-03-28 18:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ce736f-2978-5984-864f-c108d574507a with scrape type 2
2026-03-28 18:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18ce736f-2978-5984-864f-c108d574507a with scrape type 2
2026-03-28 18:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18ce736f-2978-5984-864f-c108d574507a, identifier: TR76591
2026-03-28 18:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18ce736f-2978-5984-864f-c108d574507a with identifier: TR76591
2026-03-28 18:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18ce736f-2978-5984-864f-c108d574507a with identifier: TR76591
2026-03-28 18:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18ce736f-2978-5984-864f-c108d574507a with identifier: TR76591 to the API
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:34:57Z',
 'fuel_type': 'diesel',
 'id': '18ce736f-2978-5984-864f-c108d574507a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR76591',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 208959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2009}
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR76591%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Saving data for TR76591: {'auction_closing_time': 1774884897.0, 'created_time': 1774550147.750428, 'last_price_update_time': 1774723242.907669}
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR76591') HTTP/1.1" 204 0
2026-03-28 18:40:43 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-28 18:40:43 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47451%27 HTTP/1.1" 200 None
2026-03-28 18:40:43 [auto1.de] INFO: Scrape type for EE47451: 0
2026-03-28 18:40:43 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD80564%27 HTTP/1.1" 200 None
2026-03-28 18:40:43 [auto1.de] INFO: Scrape type for RD80564: 2
2026-03-28 18:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52902457-75bc-54d2-b7e9-8cd48c6269a0 with identifier: RD80564
2026-03-28 18:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52902457-75bc-54d2-b7e9-8cd48c6269a0 with scrape type 2
2026-03-28 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52902457-75bc-54d2-b7e9-8cd48c6269a0 with scrape type 2
2026-03-28 18:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52902457-75bc-54d2-b7e9-8cd48c6269a0, identifier: RD80564
2026-03-28 18:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52902457-75bc-54d2-b7e9-8cd48c6269a0 with identifier: RD80564
2026-03-28 18:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52902457-75bc-54d2-b7e9-8cd48c6269a0 with identifier: RD80564
2026-03-28 18:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52902457-75bc-54d2-b7e9-8cd48c6269a0 with identifier: RD80564 to the API
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:22:41Z',
 'fuel_type': 'diesel',
 'id': '52902457-75bc-54d2-b7e9-8cd48c6269a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD80564',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 374134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD80564%27 HTTP/1.1" 200 None
2026-03-28 18:40:43 [auto1.de] INFO: Saving data for RD80564: {'auction_closing_time': 1774884161.0, 'created_time': 1774521743.956604, 'last_price_update_time': 1774723243.456797}
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD80564') HTTP/1.1" 204 0
2026-03-28 18:40:43 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE83152%27 HTTP/1.1" 200 None
2026-03-28 18:40:43 [auto1.de] INFO: Scrape type for BE83152: 0
2026-03-28 18:40:43 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP68247%27 HTTP/1.1" 200 None
2026-03-28 18:40:43 [auto1.de] INFO: Scrape type for YP68247: 0
2026-03-28 18:40:43 [auto1.de] INFO: Found listing with ID: XY17081
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY17081%27 HTTP/1.1" 200 None
2026-03-28 18:40:43 [auto1.de] INFO: Scrape type for XY17081: 2
2026-03-28 18:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29b04275-6fad-5468-9295-7900ed2ba4d9 with identifier: XY17081
2026-03-28 18:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29b04275-6fad-5468-9295-7900ed2ba4d9 with scrape type 2
2026-03-28 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29b04275-6fad-5468-9295-7900ed2ba4d9 with scrape type 2
2026-03-28 18:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29b04275-6fad-5468-9295-7900ed2ba4d9, identifier: XY17081
2026-03-28 18:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29b04275-6fad-5468-9295-7900ed2ba4d9 with identifier: XY17081
2026-03-28 18:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29b04275-6fad-5468-9295-7900ed2ba4d9 with identifier: XY17081
2026-03-28 18:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29b04275-6fad-5468-9295-7900ed2ba4d9 with identifier: XY17081 to the API
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-30T15:43:47Z',
 'fuel_type': 'diesel',
 'id': '29b04275-6fad-5468-9295-7900ed2ba4d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY17081',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 102209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'BMW X6 M50d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY17081%27 HTTP/1.1" 200 None
2026-03-28 18:40:43 [auto1.de] INFO: Saving data for XY17081: {'auction_closing_time': 1774885427.0, 'created_time': 1774002096.684097, 'last_price_update_time': 1774723243.994537}
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY17081') HTTP/1.1" 204 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB26924%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for ZB26924: 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM75105%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for JM75105: 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD70369%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for GD70369: 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ38457%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for SZ38457: 0
2026-03-28 18:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:44 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 6006 | hits on page: 40
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG70282%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for DG70282: 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW39086%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for VW39086: 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50981%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for XV50981: 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN98252%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for KN98252: 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC54847%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for XC54847: 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV32169%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for SV32169: 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG85302%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for DG85302: 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE30080%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for RE30080: 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN43410%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for RN43410: 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM90896%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for TM90896: 2
2026-03-28 18:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with identifier: TM90896
2026-03-28 18:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with scrape type 2
2026-03-28 18:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with scrape type 2
2026-03-28 18:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c, identifier: TM90896
2026-03-28 18:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with identifier: TM90896
2026-03-28 18:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with identifier: TM90896
2026-03-28 18:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with identifier: TM90896 to the API
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:12:46Z',
 'fuel_type': 'petrol',
 'id': '194a6cb9-e19d-5594-9143-dc8cb05a8f4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM90896',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 252488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-08',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 170',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM90896%27 HTTP/1.1" 200 None
2026-03-28 18:40:45 [auto1.de] INFO: Saving data for TM90896: {'auction_closing_time': 1774883566.0, 'created_time': 1773426994.796645, 'last_price_update_time': 1774723245.361751}
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM90896') HTTP/1.1" 204 0
2026-03-28 18:40:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:45 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ98450%27 HTTP/1.1" 200 None
2026-03-28 18:40:45 [auto1.de] INFO: Scrape type for FZ98450: 2
2026-03-28 18:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with identifier: FZ98450
2026-03-28 18:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with scrape type 2
2026-03-28 18:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with scrape type 2
2026-03-28 18:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4042cea6-e7ba-5edd-a18e-4f4483c826c9, identifier: FZ98450
2026-03-28 18:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with identifier: FZ98450
2026-03-28 18:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with identifier: FZ98450
2026-03-28 18:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with identifier: FZ98450 to the API
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-30T15:31:07Z',
 'fuel_type': 'petrol',
 'id': '4042cea6-e7ba-5edd-a18e-4f4483c826c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ98450',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 103181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-22',
 'seller_name': None,
 'title': 'BMW 6er 650i Gran Coupé xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2018}
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ98450%27 HTTP/1.1" 200 None
2026-03-28 18:40:45 [auto1.de] INFO: Saving data for FZ98450: {'auction_closing_time': 1774884667.0, 'created_time': 1774521799.193456, 'last_price_update_time': 1774723245.908876}
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ98450') HTTP/1.1" 204 0
2026-03-28 18:40:45 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-28 18:40:45 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX47602%27 HTTP/1.1" 200 None
2026-03-28 18:40:45 [auto1.de] INFO: Scrape type for RX47602: 0
2026-03-28 18:40:45 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW61170%27 HTTP/1.1" 200 None
2026-03-28 18:40:45 [auto1.de] INFO: Scrape type for VW61170: 0
2026-03-28 18:40:45 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY25128%27 HTTP/1.1" 200 None
2026-03-28 18:40:45 [auto1.de] INFO: Scrape type for XY25128: 0
2026-03-28 18:40:45 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-28 18:40:45 [auto1.de] INFO: Found listing with ID: XC20802
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC20802%27 HTTP/1.1" 200 None
2026-03-28 18:40:46 [auto1.de] INFO: Scrape type for XC20802: 1
2026-03-28 18:40:46 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX93034%27 HTTP/1.1" 200 None
2026-03-28 18:40:46 [auto1.de] INFO: Scrape type for ZX93034: 0
2026-03-28 18:40:46 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-28 18:40:46 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-28 18:40:46 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-28 18:40:46 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF65798%27 HTTP/1.1" 200 None
2026-03-28 18:40:46 [auto1.de] INFO: Scrape type for XF65798: 0
2026-03-28 18:40:46 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ76677%27 HTTP/1.1" 200 None
2026-03-28 18:40:46 [auto1.de] INFO: Scrape type for LZ76677: 2
2026-03-28 18:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d6aec58-f7f1-5cca-8c3a-82f082984758 with identifier: LZ76677
2026-03-28 18:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d6aec58-f7f1-5cca-8c3a-82f082984758 with scrape type 2
2026-03-28 18:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d6aec58-f7f1-5cca-8c3a-82f082984758 with scrape type 2
2026-03-28 18:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d6aec58-f7f1-5cca-8c3a-82f082984758, identifier: LZ76677
2026-03-28 18:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d6aec58-f7f1-5cca-8c3a-82f082984758 with identifier: LZ76677
2026-03-28 18:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d6aec58-f7f1-5cca-8c3a-82f082984758 with identifier: LZ76677
2026-03-28 18:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d6aec58-f7f1-5cca-8c3a-82f082984758 with identifier: LZ76677 to the API
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:33Z',
 'fuel_type': 'petrol',
 'id': '3d6aec58-f7f1-5cca-8c3a-82f082984758',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ76677',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 55169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ76677%27 HTTP/1.1" 200 None
2026-03-28 18:40:46 [auto1.de] INFO: Saving data for LZ76677: {'auction_closing_time': 1774885293.0, 'created_time': 1774118537.302577, 'last_price_update_time': 1774723246.495342}
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ76677') HTTP/1.1" 204 0
2026-03-28 18:40:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:46 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-28 18:40:46 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV91582%27 HTTP/1.1" 200 None
2026-03-28 18:40:46 [auto1.de] INFO: Scrape type for TV91582: 0
2026-03-28 18:40:46 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-28 18:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:47 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 6006 | hits on page: 40
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS77012%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for YS77012: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP48264%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for JP48264: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB21266%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for VB21266: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU40553%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for AU40553: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX98688%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for CX98688: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP56939%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for XP56939: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ75769%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for BZ75769: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP72129%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for BP72129: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM05292%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for RM05292: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG22409%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for KG22409: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV92794%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for HV92794: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39163%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for BP39163: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ83963%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for GJ83963: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT17633%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for RT17633: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV66765%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for YV66765: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW99084%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for ZW99084: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH89792%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for JH89792: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT23330%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for ZT23330: 0
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY57954%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for NY57954: 2
2026-03-28 18:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b575ab56-4e40-5e82-a411-f0b973127896 with identifier: NY57954
2026-03-28 18:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b575ab56-4e40-5e82-a411-f0b973127896 with scrape type 2
2026-03-28 18:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b575ab56-4e40-5e82-a411-f0b973127896 with scrape type 2
2026-03-28 18:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b575ab56-4e40-5e82-a411-f0b973127896, identifier: NY57954
2026-03-28 18:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b575ab56-4e40-5e82-a411-f0b973127896 with identifier: NY57954
2026-03-28 18:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b575ab56-4e40-5e82-a411-f0b973127896 with identifier: NY57954
2026-03-28 18:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b575ab56-4e40-5e82-a411-f0b973127896 with identifier: NY57954 to the API
2026-03-28 18:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:11Z',
 'fuel_type': 'diesel',
 'id': 'b575ab56-4e40-5e82-a411-f0b973127896',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY57954',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Grand Voyager',
 'odometer': 255384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-26',
 'seller_name': None,
 'title': 'Chrysler Grand Voyager 2.8 CRD Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2006}
2026-03-28 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY57954%27 HTTP/1.1" 200 None
2026-03-28 18:40:48 [auto1.de] INFO: Saving data for NY57954: {'auction_closing_time': 1774884851.0, 'created_time': 1774521566.263937, 'last_price_update_time': 1774723248.304072}
2026-03-28 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY57954') HTTP/1.1" 204 0
2026-03-28 18:40:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:48 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-28 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ83474%27 HTTP/1.1" 200 None
2026-03-28 18:40:48 [auto1.de] INFO: Scrape type for MZ83474: 0
2026-03-28 18:40:48 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-28 18:40:48 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-28 18:40:48 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-28 18:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC20802/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:49 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 6006 | hits on page: 40
2026-03-28 18:40:49 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-28 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA30689%27 HTTP/1.1" 200 None
2026-03-28 18:40:49 [auto1.de] INFO: Scrape type for PA30689: 0
2026-03-28 18:40:49 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-28 18:40:49 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-28 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02529%27 HTTP/1.1" 200 None
2026-03-28 18:40:49 [auto1.de] INFO: Scrape type for BR02529: 2
2026-03-28 18:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 919a610f-0423-5d5d-88ba-e207de3af9ba with identifier: BR02529
2026-03-28 18:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 919a610f-0423-5d5d-88ba-e207de3af9ba with scrape type 2
2026-03-28 18:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 919a610f-0423-5d5d-88ba-e207de3af9ba with scrape type 2
2026-03-28 18:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 919a610f-0423-5d5d-88ba-e207de3af9ba, identifier: BR02529
2026-03-28 18:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 919a610f-0423-5d5d-88ba-e207de3af9ba with identifier: BR02529
2026-03-28 18:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 919a610f-0423-5d5d-88ba-e207de3af9ba with identifier: BR02529
2026-03-28 18:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 919a610f-0423-5d5d-88ba-e207de3af9ba with identifier: BR02529 to the API
2026-03-28 18:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:10:06Z',
 'fuel_type': 'diesel',
 'id': '919a610f-0423-5d5d-88ba-e207de3af9ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR02529',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 198985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-25',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2015}
2026-03-28 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02529%27 HTTP/1.1" 200 None
2026-03-28 18:40:49 [auto1.de] INFO: Saving data for BR02529: {'auction_closing_time': 1774883406.0, 'created_time': 1773428791.887474, 'last_price_update_time': 1774723249.957071}
2026-03-28 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR02529') HTTP/1.1" 204 0
2026-03-28 18:40:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:49 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-28 18:40:49 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-28 18:40:49 [auto1.de] INFO: Found listing with ID: UA03321
2026-03-28 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA03321%27 HTTP/1.1" 200 None
2026-03-28 18:40:49 [auto1.de] INFO: Scrape type for UA03321: 2
2026-03-28 18:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1876c610-1c04-5f56-a37d-841774f85032 with identifier: UA03321
2026-03-28 18:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1876c610-1c04-5f56-a37d-841774f85032 with scrape type 2
2026-03-28 18:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1876c610-1c04-5f56-a37d-841774f85032 with scrape type 2
2026-03-28 18:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1876c610-1c04-5f56-a37d-841774f85032, identifier: UA03321
2026-03-28 18:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1876c610-1c04-5f56-a37d-841774f85032 with identifier: UA03321
2026-03-28 18:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1876c610-1c04-5f56-a37d-841774f85032 with identifier: UA03321
2026-03-28 18:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1876c610-1c04-5f56-a37d-841774f85032 with identifier: UA03321 to the API
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:56:03Z',
 'fuel_type': 'diesel',
 'id': '1876c610-1c04-5f56-a37d-841774f85032',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA03321',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 127630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-03',
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.6 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA03321%27 HTTP/1.1" 200 None
2026-03-28 18:40:50 [auto1.de] INFO: Saving data for UA03321: {'auction_closing_time': 1774886163.0, 'created_time': 1774031993.3809, 'last_price_update_time': 1774723250.463607}
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA03321') HTTP/1.1" 204 0
2026-03-28 18:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC20802> (referer: https://www.auto1.com/v1/car-details-view/XC20802/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:50 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-28 18:40:50 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE50485%27 HTTP/1.1" 200 None
2026-03-28 18:40:50 [auto1.de] INFO: Scrape type for CE50485: 0
2026-03-28 18:40:50 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR69139%27 HTTP/1.1" 200 None
2026-03-28 18:40:50 [auto1.de] INFO: Scrape type for BR69139: 0
2026-03-28 18:40:50 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG58570%27 HTTP/1.1" 200 None
2026-03-28 18:40:50 [auto1.de] INFO: Scrape type for PG58570: 2
2026-03-28 18:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d38fb5a-07dd-5f2b-87a1-649695015f5e with identifier: PG58570
2026-03-28 18:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d38fb5a-07dd-5f2b-87a1-649695015f5e with scrape type 2
2026-03-28 18:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d38fb5a-07dd-5f2b-87a1-649695015f5e with scrape type 2
2026-03-28 18:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d38fb5a-07dd-5f2b-87a1-649695015f5e, identifier: PG58570
2026-03-28 18:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d38fb5a-07dd-5f2b-87a1-649695015f5e with identifier: PG58570
2026-03-28 18:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d38fb5a-07dd-5f2b-87a1-649695015f5e with identifier: PG58570
2026-03-28 18:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d38fb5a-07dd-5f2b-87a1-649695015f5e with identifier: PG58570 to the API
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:55:56Z',
 'fuel_type': 'diesel',
 'id': '7d38fb5a-07dd-5f2b-87a1-649695015f5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG58570',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 150140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-18',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG58570%27 HTTP/1.1" 200 None
2026-03-28 18:40:50 [auto1.de] INFO: Saving data for PG58570: {'auction_closing_time': 1774886156.0, 'created_time': 1774522473.570053, 'last_price_update_time': 1774723250.96732}
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG58570') HTTP/1.1" 204 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM20101%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for SM20101: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF24484%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for AF24484: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE45367%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for ZE45367: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD52714%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for GD52714: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST81436%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for ST81436: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: VT05460
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT49707%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for RT49707: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA71883%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for SA71883: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG76209%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for KG76209: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC79950%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for RC79950: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED78349%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for ED78349: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC36387%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for BC36387: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK39735%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for YK39735: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA20211%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for SA20211: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF85970%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for YF85970: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ35604%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Scrape type for LZ35604: 0
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-28 18:40:51 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-28 18:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9 with identifier: XC20802
2026-03-28 18:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9 with scrape type 1
2026-03-28 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F802620ff885730d632e98f04623076e1%252Fpa%252FXC20802_c62b47f3b8e97bdd5f290c1cf41e7927.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_c62b47f3b8e97bdd5f290c1cf41e7927.jpg already downloaded
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F802620ff885730d632e98f04623076e1%252Fpa%252FXC20802_9991e9cbd821165285133cb8863747aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_9991e9cbd821165285133cb8863747aa.jpg already downloaded
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F802620ff885730d632e98f04623076e1%252Fpa%252FXC20802_64f6c229cb1b9306e32ab321b99ef346.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_64f6c229cb1b9306e32ab321b99ef346.jpg already downloaded
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F802620ff885730d632e98f04623076e1%252Fpa%252FXC20802_2c7395f1ab0bf023cb4d451edef4c907.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_2c7395f1ab0bf023cb4d451edef4c907.jpg already downloaded
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F802620ff885730d632e98f04623076e1%252Fpa%252FXC20802_0ab288619953ce553f92933cf1103133.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_0ab288619953ce553f92933cf1103133.jpg already downloaded
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F802620ff885730d632e98f04623076e1%252Fpa%252FXC20802_fdca7d1e5f84f3bf48e02b741ffb483d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_fdca7d1e5f84f3bf48e02b741ffb483d.jpg already downloaded
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F802620ff885730d632e98f04623076e1%252Fpa%252FXC20802_39edf5c5c239fc1a83dcb10edbc84494.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_39edf5c5c239fc1a83dcb10edbc84494.jpg already downloaded
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F802620ff885730d632e98f04623076e1%252Fpa%252FXC20802_b1d667de0b62494e8d5faf3c256f7c4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_b1d667de0b62494e8d5faf3c256f7c4c.jpg already downloaded
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F802620ff885730d632e98f04623076e1%252Fpa%252FXC20802_4e3a35ac9adc979348ae315e04b7271f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_4e3a35ac9adc979348ae315e04b7271f.jpg already downloaded
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F802620ff885730d632e98f04623076e1%252Fpa%252FXC20802_ee04ac75cef798f023adde7e49b83696.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_ee04ac75cef798f023adde7e49b83696.jpg already downloaded
2026-03-28 18:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9, identifier: XC20802
2026-03-28 18:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9 with identifier: XC20802
2026-03-28 18:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9 with identifier: XC20802
2026-03-28 18:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9 with identifier: XC20802 to the API
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XC20802>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:37:41Z',
 'fuel_type': 'hybrid',
 'id': '37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC20802',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 144862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_c62b47f3b8e97bdd5f290c1cf41e7927.jpg',
                'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_9991e9cbd821165285133cb8863747aa.jpg',
                'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_64f6c229cb1b9306e32ab321b99ef346.jpg',
                'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_2c7395f1ab0bf023cb4d451edef4c907.jpg',
                'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_0ab288619953ce553f92933cf1103133.jpg',
                'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_fdca7d1e5f84f3bf48e02b741ffb483d.jpg',
                'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_39edf5c5c239fc1a83dcb10edbc84494.jpg',
                'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_b1d667de0b62494e8d5faf3c256f7c4c.jpg',
                'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_4e3a35ac9adc979348ae315e04b7271f.jpg',
                'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_ee04ac75cef798f023adde7e49b83696.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9/37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_c62b47f3b8e97bdd5f290c1cf41e7927.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9/37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_9991e9cbd821165285133cb8863747aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9/37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_64f6c229cb1b9306e32ab321b99ef346.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9/37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_2c7395f1ab0bf023cb4d451edef4c907.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9/37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_0ab288619953ce553f92933cf1103133.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9/37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_fdca7d1e5f84f3bf48e02b741ffb483d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9/37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_39edf5c5c239fc1a83dcb10edbc84494.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9/37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_b1d667de0b62494e8d5faf3c256f7c4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9/37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_4e3a35ac9adc979348ae315e04b7271f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9/37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/802620ff885730d632e98f04623076e1/pa/XC20802_ee04ac75cef798f023adde7e49b83696.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.8 Hybrid START Edition',
 'transmission': 'automatic',
 'trim': 'START Edition',
 'year': 2013}
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC20802%27 HTTP/1.1" 200 None
2026-03-28 18:40:51 [auto1.de] INFO: Saving data for XC20802: {'created_time': 1774723251.979015, 'last_price_update_time': 1774723251.979027, 'auction_closing_time': 1774885061.0}
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC20802') HTTP/1.1" 204 0
2026-03-28 18:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:52 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 6006 | hits on page: 40
2026-03-28 18:40:52 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-28 18:40:52 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-28 18:40:52 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-28 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU80618%27 HTTP/1.1" 200 None
2026-03-28 18:40:52 [auto1.de] INFO: Scrape type for NU80618: 0
2026-03-28 18:40:52 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-28 18:40:52 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-28 18:40:52 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-28 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34994%27 HTTP/1.1" 200 None
2026-03-28 18:40:52 [auto1.de] INFO: Scrape type for AX34994: 0
2026-03-28 18:40:52 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-28 18:40:52 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-28 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53394%27 HTTP/1.1" 200 None
2026-03-28 18:40:52 [auto1.de] INFO: Scrape type for KL53394: 2
2026-03-28 18:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5cffa74-f5b0-5ff0-b50f-c93219cffd91 with identifier: KL53394
2026-03-28 18:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5cffa74-f5b0-5ff0-b50f-c93219cffd91 with scrape type 2
2026-03-28 18:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5cffa74-f5b0-5ff0-b50f-c93219cffd91 with scrape type 2
2026-03-28 18:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5cffa74-f5b0-5ff0-b50f-c93219cffd91, identifier: KL53394
2026-03-28 18:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5cffa74-f5b0-5ff0-b50f-c93219cffd91 with identifier: KL53394
2026-03-28 18:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5cffa74-f5b0-5ff0-b50f-c93219cffd91 with identifier: KL53394
2026-03-28 18:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5cffa74-f5b0-5ff0-b50f-c93219cffd91 with identifier: KL53394 to the API
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:42:18Z',
 'fuel_type': 'diesel',
 'id': 'f5cffa74-f5b0-5ff0-b50f-c93219cffd91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL53394',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 154104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-23',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
 'transmission': 'automatic',
 'trim': 'Sports-Line',
 'year': 2015}
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53394%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [auto1.de] INFO: Saving data for KL53394: {'auction_closing_time': 1774885338.0, 'created_time': 1774636597.45185, 'last_price_update_time': 1774723253.364332}
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL53394') HTTP/1.1" 204 0
2026-03-28 18:40:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV57223%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [auto1.de] INFO: Scrape type for DV57223: 2
2026-03-28 18:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 648cddcb-d621-5a04-8fc3-97ae185f5699 with identifier: DV57223
2026-03-28 18:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 648cddcb-d621-5a04-8fc3-97ae185f5699 with scrape type 2
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 648cddcb-d621-5a04-8fc3-97ae185f5699 with scrape type 2
2026-03-28 18:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 648cddcb-d621-5a04-8fc3-97ae185f5699, identifier: DV57223
2026-03-28 18:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 648cddcb-d621-5a04-8fc3-97ae185f5699 with identifier: DV57223
2026-03-28 18:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 648cddcb-d621-5a04-8fc3-97ae185f5699 with identifier: DV57223
2026-03-28 18:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 648cddcb-d621-5a04-8fc3-97ae185f5699 with identifier: DV57223 to the API
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:28:59Z',
 'fuel_type': 'petrol',
 'id': '648cddcb-d621-5a04-8fc3-97ae185f5699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV57223',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 3150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-10-05',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 DualJet Mild-Hybrid Comfort+',
 'transmission': 'automatic',
 'trim': 'Comfort+',
 'year': 2025}
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV57223%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [auto1.de] INFO: Saving data for DV57223: {'auction_closing_time': 1774884539.0, 'created_time': 1774636650.92445, 'last_price_update_time': 1774723253.823417}
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV57223') HTTP/1.1" 204 0
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA20411%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [auto1.de] INFO: Scrape type for GA20411: 0
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91436%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [auto1.de] INFO: Scrape type for UH91436: 0
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29717%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [auto1.de] INFO: Scrape type for JV29717: 0
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL01247%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [auto1.de] INFO: Scrape type for YL01247: 0
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT97786%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [auto1.de] INFO: Scrape type for XT97786: 0
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL91584%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [auto1.de] INFO: Scrape type for PL91584: 0
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB13775%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [auto1.de] INFO: Scrape type for DB13775: 2
2026-03-28 18:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4db90cd0-bd81-5dbe-a86e-5b164b16d036 with identifier: DB13775
2026-03-28 18:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4db90cd0-bd81-5dbe-a86e-5b164b16d036 with scrape type 2
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4db90cd0-bd81-5dbe-a86e-5b164b16d036 with scrape type 2
2026-03-28 18:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4db90cd0-bd81-5dbe-a86e-5b164b16d036, identifier: DB13775
2026-03-28 18:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4db90cd0-bd81-5dbe-a86e-5b164b16d036 with identifier: DB13775
2026-03-28 18:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4db90cd0-bd81-5dbe-a86e-5b164b16d036 with identifier: DB13775
2026-03-28 18:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4db90cd0-bd81-5dbe-a86e-5b164b16d036 with identifier: DB13775 to the API
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:34:22Z',
 'fuel_type': 'diesel',
 'id': '4db90cd0-bd81-5dbe-a86e-5b164b16d036',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB13775',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 166388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-07',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB13775%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [auto1.de] INFO: Saving data for DB13775: {'auction_closing_time': 1774884862.0, 'created_time': 1774636541.437442, 'last_price_update_time': 1774723254.421337}
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB13775') HTTP/1.1" 204 0
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP77608%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [auto1.de] INFO: Scrape type for PP77608: 0
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS79013%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [auto1.de] INFO: Scrape type for BS79013: 0
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR52623%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [auto1.de] INFO: Scrape type for CR52623: 0
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ57500%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [auto1.de] INFO: Scrape type for SJ57500: 0
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ21667%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [auto1.de] INFO: Scrape type for LZ21667: 0
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU14126%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [auto1.de] INFO: Scrape type for CU14126: 0
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP90277%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [auto1.de] INFO: Scrape type for SP90277: 0
2026-03-28 18:40:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:55 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 6006 | hits on page: 40
2026-03-28 18:40:55 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-28 18:40:55 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-28 18:40:55 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD42318%27 HTTP/1.1" 200 None
2026-03-28 18:40:55 [auto1.de] INFO: Scrape type for BD42318: 0
2026-03-28 18:40:55 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH48062%27 HTTP/1.1" 200 None
2026-03-28 18:40:55 [auto1.de] INFO: Scrape type for RH48062: 0
2026-03-28 18:40:55 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-28 18:40:55 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS04135%27 HTTP/1.1" 200 None
2026-03-28 18:40:55 [auto1.de] INFO: Scrape type for KS04135: 0
2026-03-28 18:40:55 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06445%27 HTTP/1.1" 200 None
2026-03-28 18:40:55 [auto1.de] INFO: Scrape type for VX06445: 2
2026-03-28 18:40:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f08dc822-4b4c-5c84-b321-2e726280e311 with identifier: VX06445
2026-03-28 18:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08dc822-4b4c-5c84-b321-2e726280e311 with scrape type 2
2026-03-28 18:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08dc822-4b4c-5c84-b321-2e726280e311 with scrape type 2
2026-03-28 18:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f08dc822-4b4c-5c84-b321-2e726280e311, identifier: VX06445
2026-03-28 18:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f08dc822-4b4c-5c84-b321-2e726280e311 with identifier: VX06445
2026-03-28 18:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f08dc822-4b4c-5c84-b321-2e726280e311 with identifier: VX06445
2026-03-28 18:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f08dc822-4b4c-5c84-b321-2e726280e311 with identifier: VX06445 to the API
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:13:47Z',
 'fuel_type': 'hybrid',
 'id': 'f08dc822-4b4c-5c84-b321-2e726280e311',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX06445',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 55456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06445%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Saving data for VX06445: {'auction_closing_time': 1774883627.0, 'created_time': 1773382805.309694, 'last_price_update_time': 1774723256.037652}
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX06445') HTTP/1.1" 204 0
2026-03-28 18:40:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV42130%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Scrape type for CV42130: 0
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY94421%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Scrape type for ZY94421: 2
2026-03-28 18:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5a5ece7-0122-5032-98d5-9adef530e5cb with identifier: ZY94421
2026-03-28 18:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5a5ece7-0122-5032-98d5-9adef530e5cb with scrape type 2
2026-03-28 18:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5a5ece7-0122-5032-98d5-9adef530e5cb with scrape type 2
2026-03-28 18:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5a5ece7-0122-5032-98d5-9adef530e5cb, identifier: ZY94421
2026-03-28 18:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5a5ece7-0122-5032-98d5-9adef530e5cb with identifier: ZY94421
2026-03-28 18:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5a5ece7-0122-5032-98d5-9adef530e5cb with identifier: ZY94421
2026-03-28 18:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5a5ece7-0122-5032-98d5-9adef530e5cb with identifier: ZY94421 to the API
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:53:24Z',
 'fuel_type': 'petrol',
 'id': 'b5a5ece7-0122-5032-98d5-9adef530e5cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY94421',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 156391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-17',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY94421%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Saving data for ZY94421: {'auction_closing_time': 1774886004.0, 'created_time': 1774521362.880234, 'last_price_update_time': 1774723256.643305}
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY94421') HTTP/1.1" 204 0
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT41484%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Scrape type for HT41484: 0
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE85293%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Scrape type for VE85293: 0
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU63404%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Scrape type for BU63404: 0
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW07623%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Scrape type for FW07623: 2
2026-03-28 18:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adbab63c-2a58-583f-a690-7f2a4289dbc7 with identifier: FW07623
2026-03-28 18:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adbab63c-2a58-583f-a690-7f2a4289dbc7 with scrape type 2
2026-03-28 18:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adbab63c-2a58-583f-a690-7f2a4289dbc7 with scrape type 2
2026-03-28 18:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adbab63c-2a58-583f-a690-7f2a4289dbc7, identifier: FW07623
2026-03-28 18:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adbab63c-2a58-583f-a690-7f2a4289dbc7 with identifier: FW07623
2026-03-28 18:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adbab63c-2a58-583f-a690-7f2a4289dbc7 with identifier: FW07623
2026-03-28 18:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adbab63c-2a58-583f-a690-7f2a4289dbc7 with identifier: FW07623 to the API
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:52Z',
 'fuel_type': 'petrol',
 'id': 'adbab63c-2a58-583f-a690-7f2a4289dbc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW07623',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 31105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW07623%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Saving data for FW07623: {'auction_closing_time': 1774886092.0, 'created_time': 1774521681.480761, 'last_price_update_time': 1774723257.213304}
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW07623') HTTP/1.1" 204 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS31792%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for XS31792: 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS23827%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for FS23827: 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP43988%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for TP43988: 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ95000%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for DZ95000: 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS65125%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for TS65125: 2
2026-03-28 18:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with identifier: TS65125
2026-03-28 18:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with scrape type 2
2026-03-28 18:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with scrape type 2
2026-03-28 18:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f38a44cc-2c4b-55de-8fda-14cd9a5721e1, identifier: TS65125
2026-03-28 18:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with identifier: TS65125
2026-03-28 18:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with identifier: TS65125
2026-03-28 18:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with identifier: TS65125 to the API
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:30:56Z',
 'fuel_type': 'petrol',
 'id': 'f38a44cc-2c4b-55de-8fda-14cd9a5721e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS65125',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 35585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-03',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T5 Momentum 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum 2WD',
 'year': 2018}
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS65125%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Saving data for TS65125: {'auction_closing_time': 1774884656.0, 'created_time': 1773946815.264712, 'last_price_update_time': 1774723257.761443}
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS65125') HTTP/1.1" 204 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV59345%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for ZV59345: 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH02928%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for MH02928: 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR03810%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for WR03810: 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT54020%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for XT54020: 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS21396%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for CS21396: 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98136%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for HA98136: 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX95177%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for XX95177: 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-28 18:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:59 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 6006 | hits on page: 40
2026-03-28 18:40:59 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA91193%27 HTTP/1.1" 200 None
2026-03-28 18:40:59 [auto1.de] INFO: Scrape type for KA91193: 2
2026-03-28 18:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0dcf67e-be73-592d-9d23-ecb90c3f4733 with identifier: KA91193
2026-03-28 18:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0dcf67e-be73-592d-9d23-ecb90c3f4733 with scrape type 2
2026-03-28 18:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0dcf67e-be73-592d-9d23-ecb90c3f4733 with scrape type 2
2026-03-28 18:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0dcf67e-be73-592d-9d23-ecb90c3f4733, identifier: KA91193
2026-03-28 18:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0dcf67e-be73-592d-9d23-ecb90c3f4733 with identifier: KA91193
2026-03-28 18:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0dcf67e-be73-592d-9d23-ecb90c3f4733 with identifier: KA91193
2026-03-28 18:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0dcf67e-be73-592d-9d23-ecb90c3f4733 with identifier: KA91193 to the API
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:08:08Z',
 'fuel_type': 'diesel',
 'id': 'a0dcf67e-be73-592d-9d23-ecb90c3f4733',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA91193',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 144659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-08',
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2019}
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA91193%27 HTTP/1.1" 200 None
2026-03-28 18:40:59 [auto1.de] INFO: Saving data for KA91193: {'auction_closing_time': 1774883288.0, 'created_time': 1774350504.235086, 'last_price_update_time': 1774723259.567877}
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA91193') HTTP/1.1" 204 0
2026-03-28 18:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:59 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF22867%27 HTTP/1.1" 200 None
2026-03-28 18:40:59 [auto1.de] INFO: Scrape type for CF22867: 2
2026-03-28 18:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1190f770-ee47-50b4-a859-a2ccb1323105 with identifier: CF22867
2026-03-28 18:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1190f770-ee47-50b4-a859-a2ccb1323105 with scrape type 2
2026-03-28 18:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1190f770-ee47-50b4-a859-a2ccb1323105 with scrape type 2
2026-03-28 18:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1190f770-ee47-50b4-a859-a2ccb1323105, identifier: CF22867
2026-03-28 18:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1190f770-ee47-50b4-a859-a2ccb1323105 with identifier: CF22867
2026-03-28 18:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1190f770-ee47-50b4-a859-a2ccb1323105 with identifier: CF22867
2026-03-28 18:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1190f770-ee47-50b4-a859-a2ccb1323105 with identifier: CF22867 to the API
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 335,
 'expiration_date': '2026-03-30T15:10:20Z',
 'fuel_type': 'petrol',
 'id': '1190f770-ee47-50b4-a859-a2ccb1323105',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF22867',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Phaeton',
 'odometer': 142589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-30',
 'seller_name': None,
 'title': 'Volkswagen Phaeton 4.2 V8 Lang 4Motion',
 'transmission': 'automatic',
 'trim': 'Lang 4Motion',
 'year': 2016}
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF22867%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [auto1.de] INFO: Saving data for CF22867: {'auction_closing_time': 1774883420.0, 'created_time': 1774550156.804689, 'last_price_update_time': 1774723260.179311}
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF22867') HTTP/1.1" 204 0
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14154%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [auto1.de] INFO: Scrape type for UH14154: 0
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: UP35116
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN79660%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [auto1.de] INFO: Scrape type for NN79660: 0
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ83535%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [auto1.de] INFO: Scrape type for XJ83535: 0
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB08927%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [auto1.de] INFO: Scrape type for MB08927: 2
2026-03-28 18:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4202ac89-9b17-5be0-ba22-a104919c1920 with identifier: MB08927
2026-03-28 18:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4202ac89-9b17-5be0-ba22-a104919c1920 with scrape type 2
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4202ac89-9b17-5be0-ba22-a104919c1920 with scrape type 2
2026-03-28 18:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4202ac89-9b17-5be0-ba22-a104919c1920, identifier: MB08927
2026-03-28 18:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4202ac89-9b17-5be0-ba22-a104919c1920 with identifier: MB08927
2026-03-28 18:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4202ac89-9b17-5be0-ba22-a104919c1920 with identifier: MB08927
2026-03-28 18:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4202ac89-9b17-5be0-ba22-a104919c1920 with identifier: MB08927 to the API
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:30:03Z',
 'fuel_type': 'diesel',
 'id': '4202ac89-9b17-5be0-ba22-a104919c1920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB08927',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 127535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB08927%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [auto1.de] INFO: Saving data for MB08927: {'auction_closing_time': 1774884603.0, 'created_time': 1774522166.613032, 'last_price_update_time': 1774723260.755928}
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB08927') HTTP/1.1" 204 0
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK58652%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [auto1.de] INFO: Scrape type for FK58652: 0
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02409%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [auto1.de] INFO: Scrape type for FB02409: 0
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: AU13367
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU13367%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [auto1.de] INFO: Scrape type for AU13367: 2
2026-03-28 18:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9431b620-6665-59b9-97aa-c9ef63fcb218 with identifier: AU13367
2026-03-28 18:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9431b620-6665-59b9-97aa-c9ef63fcb218 with scrape type 2
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9431b620-6665-59b9-97aa-c9ef63fcb218 with scrape type 2
2026-03-28 18:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9431b620-6665-59b9-97aa-c9ef63fcb218, identifier: AU13367
2026-03-28 18:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9431b620-6665-59b9-97aa-c9ef63fcb218 with identifier: AU13367
2026-03-28 18:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9431b620-6665-59b9-97aa-c9ef63fcb218 with identifier: AU13367
2026-03-28 18:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9431b620-6665-59b9-97aa-c9ef63fcb218 with identifier: AU13367 to the API
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:57Z',
 'fuel_type': 'petrol',
 'id': '9431b620-6665-59b9-97aa-c9ef63fcb218',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU13367',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 72652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seller_name': None,
 'title': 'Audi A3 Limousine 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU13367%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Saving data for AU13367: {'auction_closing_time': 1774885377.0, 'created_time': 1774034343.407002, 'last_price_update_time': 1774723261.235387}
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU13367') HTTP/1.1" 204 0
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY64031%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Scrape type for GY64031: 0
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS09512%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Scrape type for HS09512: 0
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM71162%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Scrape type for BM71162: 0
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV14336%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Scrape type for RV14336: 0
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ03964%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Scrape type for YZ03964: 2
2026-03-28 18:41:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 556411f9-e0ae-5b77-b203-76680d81cadf with identifier: YZ03964
2026-03-28 18:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 556411f9-e0ae-5b77-b203-76680d81cadf with scrape type 2
2026-03-28 18:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 556411f9-e0ae-5b77-b203-76680d81cadf with scrape type 2
2026-03-28 18:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 556411f9-e0ae-5b77-b203-76680d81cadf, identifier: YZ03964
2026-03-28 18:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 556411f9-e0ae-5b77-b203-76680d81cadf with identifier: YZ03964
2026-03-28 18:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 556411f9-e0ae-5b77-b203-76680d81cadf with identifier: YZ03964
2026-03-28 18:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 556411f9-e0ae-5b77-b203-76680d81cadf with identifier: YZ03964 to the API
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:15:16Z',
 'fuel_type': 'diesel',
 'id': '556411f9-e0ae-5b77-b203-76680d81cadf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ03964',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 185890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-11',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2017}
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ03964%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Saving data for YZ03964: {'auction_closing_time': 1774883716.0, 'created_time': 1774522430.192459, 'last_price_update_time': 1774723261.898323}
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ03964') HTTP/1.1" 204 0
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB33384%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Scrape type for TB33384: 0
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF27065%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Scrape type for RF27065: 0
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS78216%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Scrape type for KS78216: 0
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85810%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Scrape type for ZS85810: 0
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: DJ74321
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP68837%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Scrape type for XP68837: 0
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY25775%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [auto1.de] INFO: Scrape type for AY25775: 0
2026-03-28 18:41:02 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-28 18:41:02 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX37466%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [auto1.de] INFO: Scrape type for NX37466: 0
2026-03-28 18:41:02 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63230%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [auto1.de] INFO: Scrape type for UK63230: 0
2026-03-28 18:41:02 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-28 18:41:02 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN11461%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [auto1.de] INFO: Scrape type for XN11461: 0
2026-03-28 18:41:02 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-28 18:41:02 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL53532%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [auto1.de] INFO: Scrape type for EL53532: 0
2026-03-28 18:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:02 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 6006 | hits on page: 40
2026-03-28 18:41:02 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-28 18:41:02 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA48706%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [auto1.de] INFO: Scrape type for LA48706: 2
2026-03-28 18:41:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593bce64-97e7-5de4-86ab-55df8b57ec8f with identifier: LA48706
2026-03-28 18:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593bce64-97e7-5de4-86ab-55df8b57ec8f with scrape type 2
2026-03-28 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 593bce64-97e7-5de4-86ab-55df8b57ec8f with scrape type 2
2026-03-28 18:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 593bce64-97e7-5de4-86ab-55df8b57ec8f, identifier: LA48706
2026-03-28 18:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 593bce64-97e7-5de4-86ab-55df8b57ec8f with identifier: LA48706
2026-03-28 18:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 593bce64-97e7-5de4-86ab-55df8b57ec8f with identifier: LA48706
2026-03-28 18:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 593bce64-97e7-5de4-86ab-55df8b57ec8f with identifier: LA48706 to the API
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:01:37Z',
 'fuel_type': 'petrol',
 'id': '593bce64-97e7-5de4-86ab-55df8b57ec8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA48706',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 58265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-12',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2017}
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA48706%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [auto1.de] INFO: Saving data for LA48706: {'auction_closing_time': 1774882897.0, 'created_time': 1774521565.02783, 'last_price_update_time': 1774723263.326185}
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA48706') HTTP/1.1" 204 0
2026-03-28 18:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS90319%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [auto1.de] INFO: Scrape type for PS90319: 2
2026-03-28 18:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6872f563-e08c-5155-9b5b-185c006a69d5 with identifier: PS90319
2026-03-28 18:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6872f563-e08c-5155-9b5b-185c006a69d5 with scrape type 2
2026-03-28 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6872f563-e08c-5155-9b5b-185c006a69d5 with scrape type 2
2026-03-28 18:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6872f563-e08c-5155-9b5b-185c006a69d5, identifier: PS90319
2026-03-28 18:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6872f563-e08c-5155-9b5b-185c006a69d5 with identifier: PS90319
2026-03-28 18:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6872f563-e08c-5155-9b5b-185c006a69d5 with identifier: PS90319
2026-03-28 18:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6872f563-e08c-5155-9b5b-185c006a69d5 with identifier: PS90319 to the API
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:49:57Z',
 'fuel_type': 'diesel',
 'id': '6872f563-e08c-5155-9b5b-185c006a69d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS90319',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 48073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-10',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2019}
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS90319%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [auto1.de] INFO: Saving data for PS90319: {'auction_closing_time': 1774885797.0, 'created_time': 1774522017.143249, 'last_price_update_time': 1774723263.918469}
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS90319') HTTP/1.1" 204 0
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ18784%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [auto1.de] INFO: Scrape type for RJ18784: 0
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX79326%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [auto1.de] INFO: Scrape type for MX79326: 0
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT31718%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [auto1.de] INFO: Scrape type for YT31718: 2
2026-03-28 18:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with identifier: YT31718
2026-03-28 18:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with scrape type 2
2026-03-28 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with scrape type 2
2026-03-28 18:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033, identifier: YT31718
2026-03-28 18:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with identifier: YT31718
2026-03-28 18:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with identifier: YT31718
2026-03-28 18:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with identifier: YT31718 to the API
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:30:10Z',
 'fuel_type': 'petrol',
 'id': 'ab3c1070-36f4-51fb-97b1-4cd4b3cb1033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT31718',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 115289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-20',
 'seller_name': None,
 'title': 'BMW 3er 325i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT31718%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Saving data for YT31718: {'auction_closing_time': 1774884610.0, 'created_time': 1774522480.458332, 'last_price_update_time': 1774723264.44759}
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT31718') HTTP/1.1" 204 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA02242%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for BA02242: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW74456%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for HW74456: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR37106%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for XR37106: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ08846%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for CZ08846: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP57282%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for XP57282: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR02811%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for MR02811: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG68469%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for SG68469: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU12004%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for CU12004: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW63428%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for KW63428: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX83538%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for VX83538: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB29022%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for MB29022: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM29335%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for LM29335: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96570%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for KF96570: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS36559%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for TS36559: 0
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-28 18:41:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:05 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 6006 | hits on page: 40
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35901%27 HTTP/1.1" 200 None
2026-03-28 18:41:05 [auto1.de] INFO: Scrape type for JG35901: 2
2026-03-28 18:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79d36106-5c9a-596d-8d83-23deec829d4e with identifier: JG35901
2026-03-28 18:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d36106-5c9a-596d-8d83-23deec829d4e with scrape type 2
2026-03-28 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79d36106-5c9a-596d-8d83-23deec829d4e with scrape type 2
2026-03-28 18:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79d36106-5c9a-596d-8d83-23deec829d4e, identifier: JG35901
2026-03-28 18:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79d36106-5c9a-596d-8d83-23deec829d4e with identifier: JG35901
2026-03-28 18:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79d36106-5c9a-596d-8d83-23deec829d4e with identifier: JG35901
2026-03-28 18:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79d36106-5c9a-596d-8d83-23deec829d4e with identifier: JG35901 to the API
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:39:18Z',
 'fuel_type': 'petrol',
 'id': '79d36106-5c9a-596d-8d83-23deec829d4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG35901',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 121500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-04',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI BlueMotion',
 'transmission': 'manual',
 'trim': 'BlueMotion',
 'year': 2014}
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35901%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Saving data for JG35901: {'auction_closing_time': 1774885158.0, 'created_time': 1773945741.360783, 'last_price_update_time': 1774723266.087632}
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG35901') HTTP/1.1" 204 0
2026-03-28 18:41:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG62846%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for DG62846: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ05104%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for KZ05104: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM26865%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for MM26865: 2
2026-03-28 18:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with identifier: MM26865
2026-03-28 18:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with scrape type 2
2026-03-28 18:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with scrape type 2
2026-03-28 18:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5, identifier: MM26865
2026-03-28 18:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with identifier: MM26865
2026-03-28 18:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with identifier: MM26865
2026-03-28 18:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with identifier: MM26865 to the API
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:36:08Z',
 'fuel_type': 'diesel',
 'id': 'f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM26865',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 213560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-18',
 'seller_name': None,
 'title': 'BMW X3 xDrive 35d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM26865%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Saving data for MM26865: {'auction_closing_time': 1774884968.0, 'created_time': 1774521547.303999, 'last_price_update_time': 1774723266.713476}
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM26865') HTTP/1.1" 204 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW86673%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for SW86673: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS47149%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for BS47149: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS09440%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for AS09440: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX86126%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for KX86126: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM26302%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for KM26302: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND74491%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for ND74491: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84065%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for FW84065: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55762%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for LV55762: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK36887%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for SK36887: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV20692%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for TV20692: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB70760%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for FB70760: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH49369%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for KH49369: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS68475%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for AS68475: 0
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL15513%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for EL15513: 2
2026-03-28 18:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f006a16-8817-5735-8416-713c79e81536 with identifier: EL15513
2026-03-28 18:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f006a16-8817-5735-8416-713c79e81536 with scrape type 2
2026-03-28 18:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f006a16-8817-5735-8416-713c79e81536 with scrape type 2
2026-03-28 18:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f006a16-8817-5735-8416-713c79e81536, identifier: EL15513
2026-03-28 18:41:07 [scrapy.extensions.logstats] INFO: Crawled 144 pages (at 20 pages/min), scraped 378 items (at 54 items/min)
2026-03-28 18:41:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-28 18:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f006a16-8817-5735-8416-713c79e81536 with identifier: EL15513
2026-03-28 18:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f006a16-8817-5735-8416-713c79e81536 with identifier: EL15513
2026-03-28 18:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f006a16-8817-5735-8416-713c79e81536 with identifier: EL15513 to the API
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:05Z',
 'fuel_type': 'diesel',
 'id': '8f006a16-8817-5735-8416-713c79e81536',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL15513',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 184203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-17',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL15513%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [auto1.de] INFO: Saving data for EL15513: {'auction_closing_time': 1774883825.0, 'created_time': 1774522205.902894, 'last_price_update_time': 1774723267.377442}
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL15513') HTTP/1.1" 204 0
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR50974%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [auto1.de] INFO: Scrape type for YR50974: 0
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57679%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [auto1.de] INFO: Scrape type for FY57679: 0
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-28 18:41:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:08 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 6006 | hits on page: 40
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH41107%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for XH41107: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG41026%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for TG41026: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB57132%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for BB57132: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81482%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for MA81482: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR63212%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for DR63212: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV00084%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for GV00084: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC15982%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for UC15982: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV35825%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for NV35825: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS67256%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for XS67256: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: US02416
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02416%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for US02416: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ13428%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for BJ13428: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: SP71400
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL77379%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for SL77379: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE95129%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for WE95129: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85358%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for ZS85358: 0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-28 18:41:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:09 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 6006 | hits on page: 40
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT62931%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [auto1.de] INFO: Scrape type for YT62931: 0
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: MR29539
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV85362%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [auto1.de] INFO: Scrape type for WV85362: 0
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73181%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [auto1.de] INFO: Scrape type for LN73181: 0
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP23640%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [auto1.de] INFO: Scrape type for MP23640: 0
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP07382%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [auto1.de] INFO: Scrape type for FP07382: 0
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68264%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [auto1.de] INFO: Scrape type for DR68264: 0
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV64816%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [auto1.de] INFO: Scrape type for AV64816: 0
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX01006%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [auto1.de] INFO: Scrape type for FX01006: 2
2026-03-28 18:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with identifier: FX01006
2026-03-28 18:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with scrape type 2
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with scrape type 2
2026-03-28 18:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce27b9d4-36f6-5d0c-82a4-7c92466a5889, identifier: FX01006
2026-03-28 18:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with identifier: FX01006
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 18:41:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with identifier: FX01006
2026-03-28 18:41:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with identifier: FX01006 to the API
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:29:40Z',
 'fuel_type': 'hybrid',
 'id': 'ce27b9d4-36f6-5d0c-82a4-7c92466a5889',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX01006',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 42131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-19',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2022}
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX01006%27 HTTP/1.1" 200 None
2026-03-28 18:41:10 [auto1.de] INFO: Saving data for FX01006: {'auction_closing_time': 1774884580.0, 'created_time': 1774522636.754868, 'last_price_update_time': 1774723270.77429}
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX01006') HTTP/1.1" 204 0
2026-03-28 18:41:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: MH95503
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH95503%27 HTTP/1.1" 200 None
2026-03-28 18:41:10 [auto1.de] INFO: Scrape type for MH95503: 1
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS07911%27 HTTP/1.1" 200 None
2026-03-28 18:41:10 [auto1.de] INFO: Scrape type for KS07911: 0
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-28 18:41:10 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY62389%27 HTTP/1.1" 200 None
2026-03-28 18:41:10 [auto1.de] INFO: Scrape type for EY62389: 0
2026-03-28 18:41:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:11 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 6006 | hits on page: 40
2026-03-28 18:41:11 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-28 18:41:11 [auto1.de] INFO: Found listing with ID: MV27472
2026-03-28 18:41:11 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-28 18:41:11 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY59732%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [auto1.de] INFO: Scrape type for NY59732: 0
2026-03-28 18:41:11 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-28 18:41:11 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-28 18:41:11 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-28 18:41:11 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN74001%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [auto1.de] INFO: Scrape type for CN74001: 0
2026-03-28 18:41:11 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX39792%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [auto1.de] INFO: Scrape type for FX39792: 0
2026-03-28 18:41:11 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-28 18:41:11 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-28 18:41:11 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR89322%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [auto1.de] INFO: Scrape type for GR89322: 0
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH41700%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [auto1.de] INFO: Scrape type for KH41700: 0
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR51863%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [auto1.de] INFO: Scrape type for AR51863: 0
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP29614%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [auto1.de] INFO: Scrape type for ZP29614: 0
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY25945%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [auto1.de] INFO: Scrape type for CY25945: 2
2026-03-28 18:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df25dfcc-c940-5b2c-b541-9ecfda37a889 with identifier: CY25945
2026-03-28 18:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df25dfcc-c940-5b2c-b541-9ecfda37a889 with scrape type 2
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df25dfcc-c940-5b2c-b541-9ecfda37a889 with scrape type 2
2026-03-28 18:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df25dfcc-c940-5b2c-b541-9ecfda37a889, identifier: CY25945
2026-03-28 18:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df25dfcc-c940-5b2c-b541-9ecfda37a889 with identifier: CY25945
2026-03-28 18:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df25dfcc-c940-5b2c-b541-9ecfda37a889 with identifier: CY25945
2026-03-28 18:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df25dfcc-c940-5b2c-b541-9ecfda37a889 with identifier: CY25945 to the API
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:05:03Z',
 'fuel_type': 'petrol',
 'id': 'df25dfcc-c940-5b2c-b541-9ecfda37a889',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY25945',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 68696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-12-18',
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2005}
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY25945%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [auto1.de] INFO: Saving data for CY25945: {'auction_closing_time': 1774883103.0, 'created_time': 1774001890.007442, 'last_price_update_time': 1774723272.529563}
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY25945') HTTP/1.1" 204 0
2026-03-28 18:41:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06572%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [auto1.de] INFO: Scrape type for WT06572: 0
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU93663%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [auto1.de] INFO: Scrape type for EU93663: 0
2026-03-28 18:41:12 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39417%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [auto1.de] INFO: Scrape type for GH39417: 2
2026-03-28 18:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a2a0827-1509-5fec-88fe-7b5303cb4c9d with identifier: GH39417
2026-03-28 18:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a2a0827-1509-5fec-88fe-7b5303cb4c9d with scrape type 2
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a2a0827-1509-5fec-88fe-7b5303cb4c9d with scrape type 2
2026-03-28 18:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a2a0827-1509-5fec-88fe-7b5303cb4c9d, identifier: GH39417
2026-03-28 18:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a2a0827-1509-5fec-88fe-7b5303cb4c9d with identifier: GH39417
2026-03-28 18:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a2a0827-1509-5fec-88fe-7b5303cb4c9d with identifier: GH39417
2026-03-28 18:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a2a0827-1509-5fec-88fe-7b5303cb4c9d with identifier: GH39417 to the API
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-30T15:28:43Z',
 'fuel_type': 'diesel',
 'id': '9a2a0827-1509-5fec-88fe-7b5303cb4c9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH39417',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 131335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 300 d EDITION kompakt',
 'transmission': 'automatic',
 'trim': 'EDITION kompakt',
 'year': 2020}
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39417%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [auto1.de] INFO: Saving data for GH39417: {'auction_closing_time': 1774884523.0, 'created_time': 1773138329.981538, 'last_price_update_time': 1774723273.125722}
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH39417') HTTP/1.1" 204 0
2026-03-28 18:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH95503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:13 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU39005%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [auto1.de] INFO: Scrape type for AU39005: 0
2026-03-28 18:41:13 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-28 18:41:13 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-28 18:41:13 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06535%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [auto1.de] INFO: Scrape type for CP06535: 0
2026-03-28 18:41:13 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ60943%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [auto1.de] INFO: Scrape type for DJ60943: 0
2026-03-28 18:41:13 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ37362%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [auto1.de] INFO: Scrape type for AZ37362: 0
2026-03-28 18:41:13 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-28 18:41:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:14 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 6006 | hits on page: 40
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD94034%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Scrape type for YD94034: 0
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47026%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Scrape type for EE47026: 0
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ97789%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Scrape type for EJ97789: 0
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML30380%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Scrape type for ML30380: 0
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC89740%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Scrape type for VC89740: 0
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07165%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Scrape type for NC07165: 0
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG84988%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Scrape type for AG84988: 2
2026-03-28 18:41:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1171a299-2a06-56f8-b36d-7f7af785b8eb with identifier: AG84988
2026-03-28 18:41:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1171a299-2a06-56f8-b36d-7f7af785b8eb with scrape type 2
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1171a299-2a06-56f8-b36d-7f7af785b8eb with scrape type 2
2026-03-28 18:41:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1171a299-2a06-56f8-b36d-7f7af785b8eb, identifier: AG84988
2026-03-28 18:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1171a299-2a06-56f8-b36d-7f7af785b8eb with identifier: AG84988
2026-03-28 18:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1171a299-2a06-56f8-b36d-7f7af785b8eb with identifier: AG84988
2026-03-28 18:41:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1171a299-2a06-56f8-b36d-7f7af785b8eb with identifier: AG84988 to the API
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:27Z',
 'fuel_type': 'diesel',
 'id': '1171a299-2a06-56f8-b36d-7f7af785b8eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG84988',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 121035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2018}
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG84988%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Saving data for AG84988: {'auction_closing_time': 1774884867.0, 'created_time': 1774522102.330151, 'last_price_update_time': 1774723274.647649}
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG84988') HTTP/1.1" 204 0
2026-03-28 18:41:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA07752%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Scrape type for RA07752: 0
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG73343%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Scrape type for WG73343: 0
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY21095%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Scrape type for UY21095: 0
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME01390%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Scrape type for ME01390: 0
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD64601%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Scrape type for SD64601: 0
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-28 18:41:14 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU06993%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [auto1.de] INFO: Scrape type for VU06993: 2
2026-03-28 18:41:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with identifier: VU06993
2026-03-28 18:41:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with scrape type 2
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with scrape type 2
2026-03-28 18:41:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa, identifier: VU06993
2026-03-28 18:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with identifier: VU06993
2026-03-28 18:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with identifier: VU06993
2026-03-28 18:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with identifier: VU06993 to the API
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:57Z',
 'fuel_type': 'petrol',
 'id': '282c5bf3-6ed6-5a9b-b6d8-c17759e784fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU06993',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 151876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-01',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 FSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2006}
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU06993%27 HTTP/1.1" 200 None
2026-03-28 18:41:15 [auto1.de] INFO: Saving data for VU06993: {'auction_closing_time': 1774884057.0, 'created_time': 1774034890.655815, 'last_price_update_time': 1774723275.281466}
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU06993') HTTP/1.1" 204 0
2026-03-28 18:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH95503> (referer: https://www.auto1.com/v1/car-details-view/MH95503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:15 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-28 18:41:15 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-28 18:41:15 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-28 18:41:15 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK37699%27 HTTP/1.1" 200 None
2026-03-28 18:41:15 [auto1.de] INFO: Scrape type for NK37699: 0
2026-03-28 18:41:15 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-28 18:41:15 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88240%27 HTTP/1.1" 200 None
2026-03-28 18:41:15 [auto1.de] INFO: Scrape type for HG88240: 2
2026-03-28 18:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b09b65b3-0f90-5917-b51a-c5d54b1addba with identifier: HG88240
2026-03-28 18:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b09b65b3-0f90-5917-b51a-c5d54b1addba with scrape type 2
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b09b65b3-0f90-5917-b51a-c5d54b1addba with scrape type 2
2026-03-28 18:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b09b65b3-0f90-5917-b51a-c5d54b1addba, identifier: HG88240
2026-03-28 18:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b09b65b3-0f90-5917-b51a-c5d54b1addba with identifier: HG88240
2026-03-28 18:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b09b65b3-0f90-5917-b51a-c5d54b1addba with identifier: HG88240
2026-03-28 18:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b09b65b3-0f90-5917-b51a-c5d54b1addba with identifier: HG88240 to the API
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:57:09Z',
 'fuel_type': 'diesel',
 'id': 'b09b65b3-0f90-5917-b51a-c5d54b1addba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG88240',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 259510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-14',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88240%27 HTTP/1.1" 200 None
2026-03-28 18:41:15 [auto1.de] INFO: Saving data for HG88240: {'auction_closing_time': 1774886229.0, 'created_time': 1773383377.325067, 'last_price_update_time': 1774723275.869179}
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG88240') HTTP/1.1" 204 0
2026-03-28 18:41:15 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-28 18:41:15 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR29139%27 HTTP/1.1" 200 None
2026-03-28 18:41:15 [auto1.de] INFO: Scrape type for JR29139: 0
2026-03-28 18:41:15 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-28 18:41:15 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB67874%27 HTTP/1.1" 200 None
2026-03-28 18:41:15 [auto1.de] INFO: Scrape type for RB67874: 2
2026-03-28 18:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with identifier: RB67874
2026-03-28 18:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with scrape type 2
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with scrape type 2
2026-03-28 18:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5, identifier: RB67874
2026-03-28 18:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with identifier: RB67874
2026-03-28 18:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with identifier: RB67874
2026-03-28 18:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with identifier: RB67874 to the API
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:46:00Z',
 'fuel_type': 'diesel',
 'id': '9ecac9bc-d704-58bc-8d24-3c42448ef0a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB67874',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 276338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-16',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2010}
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB67874%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [auto1.de] INFO: Saving data for RB67874: {'auction_closing_time': 1774885560.0, 'created_time': 1773945943.794316, 'last_price_update_time': 1774723276.374427}
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB67874') HTTP/1.1" 204 0
2026-03-28 18:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d46e2809-bb2f-5a06-ad98-f14ab1678f5f with identifier: MH95503
2026-03-28 18:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46e2809-bb2f-5a06-ad98-f14ab1678f5f with scrape type 1
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d46e2809-bb2f-5a06-ad98-f14ab1678f5f
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb7%252Fbcb7be9a6bc51eaa87de96155d905a1e%252Fpa%252FMH95503_525e1c52ed2dfae6b1b14a8d9d546cc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_525e1c52ed2dfae6b1b14a8d9d546cc4.jpg already downloaded
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb7%252Fbcb7be9a6bc51eaa87de96155d905a1e%252Fpa%252FMH95503_5cf57324491fb9cbed1f62c6fdb1191c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_5cf57324491fb9cbed1f62c6fdb1191c.jpg already downloaded
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb7%252Fbcb7be9a6bc51eaa87de96155d905a1e%252Fpa%252FMH95503_39a889dbce27bd0b9a31d3cb45a13637.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_39a889dbce27bd0b9a31d3cb45a13637.jpg already downloaded
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb7%252Fbcb7be9a6bc51eaa87de96155d905a1e%252Fpa%252FMH95503_1ff262f19cea311acd6cd1ea090b2f52.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_1ff262f19cea311acd6cd1ea090b2f52.jpg already downloaded
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb7%252Fbcb7be9a6bc51eaa87de96155d905a1e%252Fpa%252FMH95503_0e3aed83ae857aa150a56d8fc5c918d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_0e3aed83ae857aa150a56d8fc5c918d6.jpg already downloaded
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb7%252Fbcb7be9a6bc51eaa87de96155d905a1e%252Fpa%252FMH95503_6d8656d97558861a4c59e758a63d9f3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_6d8656d97558861a4c59e758a63d9f3c.jpg already downloaded
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb7%252Fbcb7be9a6bc51eaa87de96155d905a1e%252Fpa%252FMH95503_d8d33b43ed504ed9c00e89cbea2ea31e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_d8d33b43ed504ed9c00e89cbea2ea31e.jpg already downloaded
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb7%252Fbcb7be9a6bc51eaa87de96155d905a1e%252Fpa%252FMH95503_e781ed7f35a3b5339b882ebbbc646a72.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_e781ed7f35a3b5339b882ebbbc646a72.jpg already downloaded
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb7%252Fbcb7be9a6bc51eaa87de96155d905a1e%252Fpa%252FMH95503_f89538f6580bdddf56db052902c89c33.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_f89538f6580bdddf56db052902c89c33.jpg already downloaded
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb7%252Fbcb7be9a6bc51eaa87de96155d905a1e%252Fpa%252FMH95503_140bee421053a21df5e6bcce6c09b8d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_140bee421053a21df5e6bcce6c09b8d8.jpg already downloaded
2026-03-28 18:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d46e2809-bb2f-5a06-ad98-f14ab1678f5f, identifier: MH95503
2026-03-28 18:41:16 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-28 18:41:16 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-28 18:41:16 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-28 18:41:16 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE75609%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [auto1.de] INFO: Scrape type for CE75609: 0
2026-03-28 18:41:16 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-28 18:41:16 [auto1.de] INFO: Found listing with ID: UA34873
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA34873%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [auto1.de] INFO: Scrape type for UA34873: 2
2026-03-28 18:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d6ec55a-0b04-5267-85a2-e85b62bd5b56 with identifier: UA34873
2026-03-28 18:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d6ec55a-0b04-5267-85a2-e85b62bd5b56 with scrape type 2
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d6ec55a-0b04-5267-85a2-e85b62bd5b56 with scrape type 2
2026-03-28 18:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d6ec55a-0b04-5267-85a2-e85b62bd5b56, identifier: UA34873
2026-03-28 18:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d46e2809-bb2f-5a06-ad98-f14ab1678f5f with identifier: MH95503
2026-03-28 18:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d46e2809-bb2f-5a06-ad98-f14ab1678f5f with identifier: MH95503
2026-03-28 18:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d46e2809-bb2f-5a06-ad98-f14ab1678f5f with identifier: MH95503 to the API
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MH95503>
{'auction_title': '',
 'c_o_2_emission_value': 209,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:11:08Z',
 'fuel_type': 'petrol',
 'id': 'd46e2809-bb2f-5a06-ad98-f14ab1678f5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH95503',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 99094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_525e1c52ed2dfae6b1b14a8d9d546cc4.jpg',
                'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_5cf57324491fb9cbed1f62c6fdb1191c.jpg',
                'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_39a889dbce27bd0b9a31d3cb45a13637.jpg',
                'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_1ff262f19cea311acd6cd1ea090b2f52.jpg',
                'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_0e3aed83ae857aa150a56d8fc5c918d6.jpg',
                'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_6d8656d97558861a4c59e758a63d9f3c.jpg',
                'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_d8d33b43ed504ed9c00e89cbea2ea31e.jpg',
                'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_e781ed7f35a3b5339b882ebbbc646a72.jpg',
                'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_f89538f6580bdddf56db052902c89c33.jpg',
                'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_140bee421053a21df5e6bcce6c09b8d8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e2809-bb2f-5a06-ad98-f14ab1678f5f/d46e2809-bb2f-5a06-ad98-f14ab1678f5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2986281,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_525e1c52ed2dfae6b1b14a8d9d546cc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e2809-bb2f-5a06-ad98-f14ab1678f5f/d46e2809-bb2f-5a06-ad98-f14ab1678f5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977032,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_5cf57324491fb9cbed1f62c6fdb1191c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e2809-bb2f-5a06-ad98-f14ab1678f5f/d46e2809-bb2f-5a06-ad98-f14ab1678f5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3315885,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_39a889dbce27bd0b9a31d3cb45a13637.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e2809-bb2f-5a06-ad98-f14ab1678f5f/d46e2809-bb2f-5a06-ad98-f14ab1678f5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_1ff262f19cea311acd6cd1ea090b2f52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e2809-bb2f-5a06-ad98-f14ab1678f5f/d46e2809-bb2f-5a06-ad98-f14ab1678f5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3296521,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_0e3aed83ae857aa150a56d8fc5c918d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e2809-bb2f-5a06-ad98-f14ab1678f5f/d46e2809-bb2f-5a06-ad98-f14ab1678f5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3246626,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_6d8656d97558861a4c59e758a63d9f3c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e2809-bb2f-5a06-ad98-f14ab1678f5f/d46e2809-bb2f-5a06-ad98-f14ab1678f5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_d8d33b43ed504ed9c00e89cbea2ea31e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e2809-bb2f-5a06-ad98-f14ab1678f5f/d46e2809-bb2f-5a06-ad98-f14ab1678f5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2951803,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_e781ed7f35a3b5339b882ebbbc646a72.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e2809-bb2f-5a06-ad98-f14ab1678f5f/d46e2809-bb2f-5a06-ad98-f14ab1678f5f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2930634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_f89538f6580bdddf56db052902c89c33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46e2809-bb2f-5a06-ad98-f14ab1678f5f/d46e2809-bb2f-5a06-ad98-f14ab1678f5f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3190570,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b7/bcb7be9a6bc51eaa87de96155d905a1e/pa/MH95503_140bee421053a21df5e6bcce6c09b8d8.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 2.4 Limited 4x4',
 'transmission': 'automatic',
 'trim': 'Limited 4x4',
 'year': 2016}
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH95503%27 HTTP/1.1" 200 None
2026-03-28 18:41:17 [auto1.de] INFO: Saving data for MH95503: {'created_time': 1774723277.188305, 'last_price_update_time': 1774723277.188319, 'auction_closing_time': 1774883468.0}
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH95503') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d6ec55a-0b04-5267-85a2-e85b62bd5b56 with identifier: UA34873
2026-03-28 18:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d6ec55a-0b04-5267-85a2-e85b62bd5b56 with identifier: UA34873
2026-03-28 18:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d6ec55a-0b04-5267-85a2-e85b62bd5b56 with identifier: UA34873 to the API
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:51:58Z',
 'fuel_type': 'diesel',
 'id': '3d6ec55a-0b04-5267-85a2-e85b62bd5b56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA34873',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 230697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-12',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2011}
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA34873%27 HTTP/1.1" 200 None
2026-03-28 18:41:17 [auto1.de] INFO: Saving data for UA34873: {'auction_closing_time': 1774885918.0, 'created_time': 1774350216.811544, 'last_price_update_time': 1774723277.64039}
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA34873') HTTP/1.1" 204 0
2026-03-28 18:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:18 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 6007 | hits on page: 40
2026-03-28 18:41:18 [auto1.de] INFO: Found listing with ID: UA34873
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA34873%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [auto1.de] INFO: Scrape type for UA34873: 0
2026-03-28 18:41:18 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA05617%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [auto1.de] INFO: Scrape type for XA05617: 0
2026-03-28 18:41:18 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-28 18:41:18 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF39305%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [auto1.de] INFO: Scrape type for CF39305: 2
2026-03-28 18:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6497bfe5-a8d9-5a35-900b-85514312537d with identifier: CF39305
2026-03-28 18:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6497bfe5-a8d9-5a35-900b-85514312537d with scrape type 2
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6497bfe5-a8d9-5a35-900b-85514312537d with scrape type 2
2026-03-28 18:41:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6497bfe5-a8d9-5a35-900b-85514312537d, identifier: CF39305
2026-03-28 18:41:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6497bfe5-a8d9-5a35-900b-85514312537d with identifier: CF39305
2026-03-28 18:41:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6497bfe5-a8d9-5a35-900b-85514312537d with identifier: CF39305
2026-03-28 18:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6497bfe5-a8d9-5a35-900b-85514312537d with identifier: CF39305 to the API
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:00:15Z',
 'fuel_type': 'diesel',
 'id': '6497bfe5-a8d9-5a35-900b-85514312537d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF39305',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 312352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-31',
 'seller_name': None,
 'title': 'BMW 3er 320d EfficientDynamics Edition',
 'transmission': 'automatic',
 'trim': 'EfficientDynamics Edition',
 'year': 2013}
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF39305%27 HTTP/1.1" 200 None
2026-03-28 18:41:19 [auto1.de] INFO: Saving data for CF39305: {'auction_closing_time': 1774882815.0, 'created_time': 1773229239.993199, 'last_price_update_time': 1774723279.03035}
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF39305') HTTP/1.1" 204 0
2026-03-28 18:41:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:19 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY32384%27 HTTP/1.1" 200 None
2026-03-28 18:41:19 [auto1.de] INFO: Scrape type for TY32384: 0
2026-03-28 18:41:19 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-28 18:41:19 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX54402%27 HTTP/1.1" 200 None
2026-03-28 18:41:19 [auto1.de] INFO: Scrape type for MX54402: 0
2026-03-28 18:41:19 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68108%27 HTTP/1.1" 200 None
2026-03-28 18:41:19 [auto1.de] INFO: Scrape type for ES68108: 0
2026-03-28 18:41:19 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-28 18:41:19 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW68760%27 HTTP/1.1" 200 None
2026-03-28 18:41:19 [auto1.de] INFO: Scrape type for HW68760: 0
2026-03-28 18:41:19 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-28 18:41:19 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH85059%27 HTTP/1.1" 200 None
2026-03-28 18:41:19 [auto1.de] INFO: Scrape type for AH85059: 2
2026-03-28 18:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0992afd8-5cc1-5dfa-93d6-ea333a03fc38 with identifier: AH85059
2026-03-28 18:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0992afd8-5cc1-5dfa-93d6-ea333a03fc38 with scrape type 2
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0992afd8-5cc1-5dfa-93d6-ea333a03fc38 with scrape type 2
2026-03-28 18:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0992afd8-5cc1-5dfa-93d6-ea333a03fc38, identifier: AH85059
2026-03-28 18:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0992afd8-5cc1-5dfa-93d6-ea333a03fc38 with identifier: AH85059
2026-03-28 18:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0992afd8-5cc1-5dfa-93d6-ea333a03fc38 with identifier: AH85059
2026-03-28 18:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0992afd8-5cc1-5dfa-93d6-ea333a03fc38 with identifier: AH85059 to the API
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:45:12Z',
 'fuel_type': 'petrol',
 'id': '0992afd8-5cc1-5dfa-93d6-ea333a03fc38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH85059',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 99878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-30',
 'seller_name': None,
 'title': 'Audi Q3 40 TFSI quattro S Line',
 'transmission': 'automatic',
 'trim': 'quattro S Line',
 'year': 2019}
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH85059%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Saving data for AH85059: {'auction_closing_time': 1774885512.0, 'created_time': 1773131828.927066, 'last_price_update_time': 1774723280.109229}
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH85059') HTTP/1.1" 204 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS39817%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for MS39817: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51858%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for LZ51858: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD61700%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for TD61700: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM15583%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for YM15583: 2
2026-03-28 18:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e999e5a4-f559-5088-8042-c09ba686e57c with identifier: YM15583
2026-03-28 18:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e999e5a4-f559-5088-8042-c09ba686e57c with scrape type 2
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e999e5a4-f559-5088-8042-c09ba686e57c with scrape type 2
2026-03-28 18:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e999e5a4-f559-5088-8042-c09ba686e57c, identifier: YM15583
2026-03-28 18:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e999e5a4-f559-5088-8042-c09ba686e57c with identifier: YM15583
2026-03-28 18:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e999e5a4-f559-5088-8042-c09ba686e57c with identifier: YM15583
2026-03-28 18:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e999e5a4-f559-5088-8042-c09ba686e57c with identifier: YM15583 to the API
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 207,
 'expiration_date': '2026-03-30T15:45:12Z',
 'fuel_type': 'petrol',
 'id': 'e999e5a4-f559-5088-8042-c09ba686e57c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM15583',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 42691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-29',
 'seller_name': None,
 'title': 'Audi A1 Sportback 40 TFSI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM15583%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Saving data for YM15583: {'auction_closing_time': 1774885512.0, 'created_time': 1773831321.699364, 'last_price_update_time': 1774723280.703121}
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM15583') HTTP/1.1" 204 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD93379%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for AD93379: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP24640%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for MP24640: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: HL07149
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN62534%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for VN62534: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM54936%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for SM54936: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR25220%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for BR25220: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN66940%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for KN66940: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK08756%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for UK08756: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG81314%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for CG81314: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ66164%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for CZ66164: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR88792%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for CR88792: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB65858%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for UB65858: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU68975%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for FU68975: 0
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-28 18:41:20 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK53162%27 HTTP/1.1" 200 None
2026-03-28 18:41:20 [auto1.de] INFO: Scrape type for ZK53162: 0
2026-03-28 18:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:21 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 6007 | hits on page: 40
2026-03-28 18:41:21 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-28 18:41:21 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL77051%27 HTTP/1.1" 200 None
2026-03-28 18:41:21 [auto1.de] INFO: Scrape type for VL77051: 2
2026-03-28 18:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae with identifier: VL77051
2026-03-28 18:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae with scrape type 2
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae with scrape type 2
2026-03-28 18:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae, identifier: VL77051
2026-03-28 18:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae with identifier: VL77051
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 18:41:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:41:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae with identifier: VL77051
2026-03-28 18:41:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae with identifier: VL77051 to the API
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:40Z',
 'fuel_type': 'petrol',
 'id': '040e6c9f-b5f2-58fe-a0ca-369eb5e284ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL77051',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 137948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-26',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL77051%27 HTTP/1.1" 200 None
2026-03-28 18:41:22 [auto1.de] INFO: Saving data for VL77051: {'auction_closing_time': 1774884220.0, 'created_time': 1773916952.703523, 'last_price_update_time': 1774723282.440229}
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL77051') HTTP/1.1" 204 0
2026-03-28 18:41:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:22 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-28 18:41:22 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80176%27 HTTP/1.1" 200 None
2026-03-28 18:41:22 [auto1.de] INFO: Scrape type for EJ80176: 2
2026-03-28 18:41:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dddcd894-e6e3-542b-9b84-bc71f5e88e66 with identifier: EJ80176
2026-03-28 18:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dddcd894-e6e3-542b-9b84-bc71f5e88e66 with scrape type 2
2026-03-28 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dddcd894-e6e3-542b-9b84-bc71f5e88e66 with scrape type 2
2026-03-28 18:41:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dddcd894-e6e3-542b-9b84-bc71f5e88e66, identifier: EJ80176
2026-03-28 18:41:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dddcd894-e6e3-542b-9b84-bc71f5e88e66 with identifier: EJ80176
2026-03-28 18:41:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dddcd894-e6e3-542b-9b84-bc71f5e88e66 with identifier: EJ80176
2026-03-28 18:41:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dddcd894-e6e3-542b-9b84-bc71f5e88e66 with identifier: EJ80176 to the API
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 254,
 'expiration_date': '2026-03-30T15:48:28Z',
 'fuel_type': 'diesel',
 'id': 'dddcd894-e6e3-542b-9b84-bc71f5e88e66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ80176',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-60',
 'odometer': 3276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-09',
 'seller_name': None,
 'title': 'Mazda CX-60 3.3 e-Skyactiv D Homura AWD',
 'transmission': 'automatic',
 'trim': 'Homura AWD',
 'year': 2025}
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80176%27 HTTP/1.1" 200 None
2026-03-28 18:41:22 [auto1.de] INFO: Saving data for EJ80176: {'auction_closing_time': 1774885708.0, 'created_time': 1773303443.283726, 'last_price_update_time': 1774723282.98394}
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ80176') HTTP/1.1" 204 0
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN36712%27 HTTP/1.1" 200 None
2026-03-28 18:41:23 [auto1.de] INFO: Scrape type for AN36712: 2
2026-03-28 18:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44976b6d-695f-5f60-9a88-d90fe983fbc7 with identifier: AN36712
2026-03-28 18:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44976b6d-695f-5f60-9a88-d90fe983fbc7 with scrape type 2
2026-03-28 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44976b6d-695f-5f60-9a88-d90fe983fbc7 with scrape type 2
2026-03-28 18:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44976b6d-695f-5f60-9a88-d90fe983fbc7, identifier: AN36712
2026-03-28 18:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44976b6d-695f-5f60-9a88-d90fe983fbc7 with identifier: AN36712
2026-03-28 18:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44976b6d-695f-5f60-9a88-d90fe983fbc7 with identifier: AN36712
2026-03-28 18:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44976b6d-695f-5f60-9a88-d90fe983fbc7 with identifier: AN36712 to the API
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:22:57Z',
 'fuel_type': 'petrol',
 'id': '44976b6d-695f-5f60-9a88-d90fe983fbc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN36712',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 205122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-31',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN36712%27 HTTP/1.1" 200 None
2026-03-28 18:41:23 [auto1.de] INFO: Saving data for AN36712: {'auction_closing_time': 1774884177.0, 'created_time': 1772544495.343027, 'last_price_update_time': 1774723283.445303}
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN36712') HTTP/1.1" 204 0
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW09087%27 HTTP/1.1" 200 None
2026-03-28 18:41:23 [auto1.de] INFO: Scrape type for SW09087: 0
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX34445%27 HTTP/1.1" 200 None
2026-03-28 18:41:23 [auto1.de] INFO: Scrape type for KX34445: 0
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT81385%27 HTTP/1.1" 200 None
2026-03-28 18:41:23 [auto1.de] INFO: Scrape type for FT81385: 0
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL67140%27 HTTP/1.1" 200 None
2026-03-28 18:41:23 [auto1.de] INFO: Scrape type for VL67140: 0
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE09507%27 HTTP/1.1" 200 None
2026-03-28 18:41:23 [auto1.de] INFO: Scrape type for SE09507: 0
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-28 18:41:23 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM43166%27 HTTP/1.1" 200 None
2026-03-28 18:41:23 [auto1.de] INFO: Scrape type for AM43166: 2
2026-03-28 18:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67 with identifier: AM43166
2026-03-28 18:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67 with scrape type 2
2026-03-28 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67 with scrape type 2
2026-03-28 18:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67, identifier: AM43166
2026-03-28 18:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67 with identifier: AM43166
2026-03-28 18:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67 with identifier: AM43166
2026-03-28 18:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67 with identifier: AM43166 to the API
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:14:31Z',
 'fuel_type': 'petrol',
 'id': '59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM43166',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 167177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-14',
 'seller_name': None,
 'title': 'Dacia Logan MCV 0.9 TCe Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2016}
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM43166%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Saving data for AM43166: {'auction_closing_time': 1774883671.0, 'created_time': 1773917564.123621, 'last_price_update_time': 1774723284.009074}
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM43166') HTTP/1.1" 204 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX59150%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for MX59150: 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY93547%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for ZY93547: 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP27370%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for CP27370: 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54290%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for BH54290: 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ93598%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for HZ93598: 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK49641%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for UK49641: 2
2026-03-28 18:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 702ee690-810c-5b40-bcf6-a06575739c8e with identifier: UK49641
2026-03-28 18:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 702ee690-810c-5b40-bcf6-a06575739c8e with scrape type 2
2026-03-28 18:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 702ee690-810c-5b40-bcf6-a06575739c8e with scrape type 2
2026-03-28 18:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 702ee690-810c-5b40-bcf6-a06575739c8e, identifier: UK49641
2026-03-28 18:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 702ee690-810c-5b40-bcf6-a06575739c8e with identifier: UK49641
2026-03-28 18:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 702ee690-810c-5b40-bcf6-a06575739c8e with identifier: UK49641
2026-03-28 18:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 702ee690-810c-5b40-bcf6-a06575739c8e with identifier: UK49641 to the API
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:49:22Z',
 'fuel_type': 'diesel',
 'id': '702ee690-810c-5b40-bcf6-a06575739c8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK49641',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 74386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seller_name': None,
 'title': 'Audi A5 Sportback 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK49641%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Saving data for UK49641: {'auction_closing_time': 1774885762.0, 'created_time': 1773307894.912403, 'last_price_update_time': 1774723284.63612}
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK49641') HTTP/1.1" 204 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL82245%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for DL82245: 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT01639%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for WT01639: 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW65482%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for CW65482: 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: US61717
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US61717%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for US61717: 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF94997%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for WF94997: 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG67799%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for UG67799: 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF55621%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for YF55621: 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU16772%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for MU16772: 0
2026-03-28 18:41:24 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV63052%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Scrape type for JV63052: 0
2026-03-28 18:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:25 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 6007 | hits on page: 40
2026-03-28 18:41:25 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-28 18:41:25 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE48673%27 HTTP/1.1" 200 None
2026-03-28 18:41:25 [auto1.de] INFO: Scrape type for UE48673: 0
2026-03-28 18:41:25 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87101%27 HTTP/1.1" 200 None
2026-03-28 18:41:25 [auto1.de] INFO: Scrape type for WE87101: 0
2026-03-28 18:41:25 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-28 18:41:25 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14649%27 HTTP/1.1" 200 None
2026-03-28 18:41:25 [auto1.de] INFO: Scrape type for SG14649: 2
2026-03-28 18:41:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52b2c05b-b02c-5847-a0ba-f8538e30e573 with identifier: SG14649
2026-03-28 18:41:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52b2c05b-b02c-5847-a0ba-f8538e30e573 with scrape type 2
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52b2c05b-b02c-5847-a0ba-f8538e30e573 with scrape type 2
2026-03-28 18:41:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52b2c05b-b02c-5847-a0ba-f8538e30e573, identifier: SG14649
2026-03-28 18:41:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52b2c05b-b02c-5847-a0ba-f8538e30e573 with identifier: SG14649
2026-03-28 18:41:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52b2c05b-b02c-5847-a0ba-f8538e30e573 with identifier: SG14649
2026-03-28 18:41:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52b2c05b-b02c-5847-a0ba-f8538e30e573 with identifier: SG14649 to the API
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-30T15:51:29Z',
 'fuel_type': 'petrol',
 'id': '52b2c05b-b02c-5847-a0ba-f8538e30e573',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG14649',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 7162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-14',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14649%27 HTTP/1.1" 200 None
2026-03-28 18:41:26 [auto1.de] INFO: Saving data for SG14649: {'auction_closing_time': 1774885889.0, 'created_time': 1774034842.291632, 'last_price_update_time': 1774723286.010631}
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG14649') HTTP/1.1" 204 0
2026-03-28 18:41:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:26 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-28 18:41:26 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM79611%27 HTTP/1.1" 200 None
2026-03-28 18:41:26 [auto1.de] INFO: Scrape type for AM79611: 0
2026-03-28 18:41:26 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE71066%27 HTTP/1.1" 200 None
2026-03-28 18:41:26 [auto1.de] INFO: Scrape type for JE71066: 0
2026-03-28 18:41:26 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW43883%27 HTTP/1.1" 200 None
2026-03-28 18:41:26 [auto1.de] INFO: Scrape type for HW43883: 0
2026-03-28 18:41:26 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-28 18:41:26 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK35927%27 HTTP/1.1" 200 None
2026-03-28 18:41:26 [auto1.de] INFO: Scrape type for EK35927: 0
2026-03-28 18:41:26 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17185%27 HTTP/1.1" 200 None
2026-03-28 18:41:26 [auto1.de] INFO: Scrape type for JX17185: 0
2026-03-28 18:41:26 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV40482%27 HTTP/1.1" 200 None
2026-03-28 18:41:26 [auto1.de] INFO: Scrape type for DV40482: 2
2026-03-28 18:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b33532ed-a453-51fc-9477-ddf7a51c9373 with identifier: DV40482
2026-03-28 18:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b33532ed-a453-51fc-9477-ddf7a51c9373 with scrape type 2
2026-03-28 18:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b33532ed-a453-51fc-9477-ddf7a51c9373 with scrape type 2
2026-03-28 18:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b33532ed-a453-51fc-9477-ddf7a51c9373, identifier: DV40482
2026-03-28 18:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b33532ed-a453-51fc-9477-ddf7a51c9373 with identifier: DV40482
2026-03-28 18:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b33532ed-a453-51fc-9477-ddf7a51c9373 with identifier: DV40482
2026-03-28 18:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b33532ed-a453-51fc-9477-ddf7a51c9373 with identifier: DV40482 to the API
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:53:19Z',
 'fuel_type': 'petrol',
 'id': 'b33532ed-a453-51fc-9477-ddf7a51c9373',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV40482',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 168257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-30',
 'seller_name': None,
 'title': 'Peugeot 407 2.0 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2005}
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV40482%27 HTTP/1.1" 200 None
2026-03-28 18:41:26 [auto1.de] INFO: Saving data for DV40482: {'auction_closing_time': 1774885999.0, 'created_time': 1774033885.275249, 'last_price_update_time': 1774723286.67583}
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV40482') HTTP/1.1" 204 0
2026-03-28 18:41:26 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH17233%27 HTTP/1.1" 200 None
2026-03-28 18:41:26 [auto1.de] INFO: Scrape type for BH17233: 0
2026-03-28 18:41:26 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-28 18:41:26 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-28 18:41:26 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB42941%27 HTTP/1.1" 200 None
2026-03-28 18:41:26 [auto1.de] INFO: Scrape type for TB42941: 2
2026-03-28 18:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e63e799-a946-5728-ab08-7b19f10afa1f with identifier: TB42941
2026-03-28 18:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e63e799-a946-5728-ab08-7b19f10afa1f with scrape type 2
2026-03-28 18:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e63e799-a946-5728-ab08-7b19f10afa1f with scrape type 2
2026-03-28 18:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e63e799-a946-5728-ab08-7b19f10afa1f, identifier: TB42941
2026-03-28 18:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e63e799-a946-5728-ab08-7b19f10afa1f with identifier: TB42941
2026-03-28 18:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e63e799-a946-5728-ab08-7b19f10afa1f with identifier: TB42941
2026-03-28 18:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e63e799-a946-5728-ab08-7b19f10afa1f with identifier: TB42941 to the API
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:43:04Z',
 'fuel_type': 'petrol',
 'id': '4e63e799-a946-5728-ab08-7b19f10afa1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB42941',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 30143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-12',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB42941%27 HTTP/1.1" 200 None
2026-03-28 18:41:27 [auto1.de] INFO: Saving data for TB42941: {'auction_closing_time': 1774885384.0, 'created_time': 1774521555.50864, 'last_price_update_time': 1774723287.117104}
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB42941') HTTP/1.1" 204 0
2026-03-28 18:41:27 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG24427%27 HTTP/1.1" 200 None
2026-03-28 18:41:27 [auto1.de] INFO: Scrape type for XG24427: 0
2026-03-28 18:41:27 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-28 18:41:27 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU37680%27 HTTP/1.1" 200 None
2026-03-28 18:41:27 [auto1.de] INFO: Scrape type for HU37680: 0
2026-03-28 18:41:27 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC42699%27 HTTP/1.1" 200 None
2026-03-28 18:41:27 [auto1.de] INFO: Scrape type for ZC42699: 2
2026-03-28 18:41:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acbb90e9-eade-513d-8eb4-35cf6804cc04 with identifier: ZC42699
2026-03-28 18:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acbb90e9-eade-513d-8eb4-35cf6804cc04 with scrape type 2
2026-03-28 18:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acbb90e9-eade-513d-8eb4-35cf6804cc04 with scrape type 2
2026-03-28 18:41:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acbb90e9-eade-513d-8eb4-35cf6804cc04, identifier: ZC42699
2026-03-28 18:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acbb90e9-eade-513d-8eb4-35cf6804cc04 with identifier: ZC42699
2026-03-28 18:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acbb90e9-eade-513d-8eb4-35cf6804cc04 with identifier: ZC42699
2026-03-28 18:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acbb90e9-eade-513d-8eb4-35cf6804cc04 with identifier: ZC42699 to the API
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 440,
 'expiration_date': '2026-03-30T15:48:10Z',
 'fuel_type': 'petrol',
 'id': 'acbb90e9-eade-513d-8eb4-35cf6804cc04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC42699',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera Sport Turismo',
 'odometer': 134297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-12',
 'seller_name': None,
 'title': 'Porsche Panamera Sport Turismo 4S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC42699%27 HTTP/1.1" 200 None
2026-03-28 18:41:27 [auto1.de] INFO: Saving data for ZC42699: {'auction_closing_time': 1774885690.0, 'created_time': 1774522119.593599, 'last_price_update_time': 1774723287.67961}
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC42699') HTTP/1.1" 204 0
2026-03-28 18:41:27 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM49539%27 HTTP/1.1" 200 None
2026-03-28 18:41:27 [auto1.de] INFO: Scrape type for DM49539: 0
2026-03-28 18:41:27 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-28 18:41:27 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU82600%27 HTTP/1.1" 200 None
2026-03-28 18:41:27 [auto1.de] INFO: Scrape type for ZU82600: 0
2026-03-28 18:41:27 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-28 18:41:27 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK80269%27 HTTP/1.1" 200 None
2026-03-28 18:41:27 [auto1.de] INFO: Scrape type for VK80269: 2
2026-03-28 18:41:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0a5f268-9849-5d95-814b-4a03d612efc5 with identifier: VK80269
2026-03-28 18:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a5f268-9849-5d95-814b-4a03d612efc5 with scrape type 2
2026-03-28 18:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0a5f268-9849-5d95-814b-4a03d612efc5 with scrape type 2
2026-03-28 18:41:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0a5f268-9849-5d95-814b-4a03d612efc5, identifier: VK80269
2026-03-28 18:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0a5f268-9849-5d95-814b-4a03d612efc5 with identifier: VK80269
2026-03-28 18:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0a5f268-9849-5d95-814b-4a03d612efc5 with identifier: VK80269
2026-03-28 18:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0a5f268-9849-5d95-814b-4a03d612efc5 with identifier: VK80269 to the API
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:58:22Z',
 'fuel_type': 'diesel',
 'id': 'a0a5f268-9849-5d95-814b-4a03d612efc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK80269',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 125401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-22',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport Shadow',
 'year': 2018}
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK80269%27 HTTP/1.1" 200 None
2026-03-28 18:41:28 [auto1.de] INFO: Saving data for VK80269: {'auction_closing_time': 1774886302.0, 'created_time': 1774521732.587345, 'last_price_update_time': 1774723288.166195}
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK80269') HTTP/1.1" 204 0
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF75522%27 HTTP/1.1" 200 None
2026-03-28 18:41:28 [auto1.de] INFO: Scrape type for NF75522: 0
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE19293%27 HTTP/1.1" 200 None
2026-03-28 18:41:28 [auto1.de] INFO: Scrape type for AE19293: 0
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY85656%27 HTTP/1.1" 200 None
2026-03-28 18:41:28 [auto1.de] INFO: Scrape type for WY85656: 0
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP61239%27 HTTP/1.1" 200 None
2026-03-28 18:41:28 [auto1.de] INFO: Scrape type for BP61239: 0
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59487%27 HTTP/1.1" 200 None
2026-03-28 18:41:28 [auto1.de] INFO: Scrape type for DS59487: 0
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-28 18:41:28 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-28 18:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:29 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 6008 | hits on page: 40
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ01431%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for BZ01431: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00518%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for HE00518: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV69297%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for AV69297: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP15063%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for WP15063: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA57205%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for LA57205: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR84974%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for KR84974: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE30814%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for WE30814: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS46414%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for MS46414: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB43981%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for EB43981: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM24732%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for FM24732: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD09602%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for DD09602: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09261%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for RT09261: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB14031%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for SB14031: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: NC07171
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07171%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for NC07171: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86569%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for XC86569: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW02228%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for HW02228: 0
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST04128%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Scrape type for ST04128: 2
2026-03-28 18:41:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcbf6e82-7c84-5d17-933a-5150149904c6 with identifier: ST04128
2026-03-28 18:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcbf6e82-7c84-5d17-933a-5150149904c6 with scrape type 2
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcbf6e82-7c84-5d17-933a-5150149904c6 with scrape type 2
2026-03-28 18:41:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bcbf6e82-7c84-5d17-933a-5150149904c6, identifier: ST04128
2026-03-28 18:41:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bcbf6e82-7c84-5d17-933a-5150149904c6 with identifier: ST04128
2026-03-28 18:41:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bcbf6e82-7c84-5d17-933a-5150149904c6 with identifier: ST04128
2026-03-28 18:41:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bcbf6e82-7c84-5d17-933a-5150149904c6 with identifier: ST04128 to the API
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:30:31Z',
 'fuel_type': 'petrol',
 'id': 'bcbf6e82-7c84-5d17-933a-5150149904c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST04128',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 171498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-27',
 'seller_name': None,
 'title': 'Nissan Micra 1.0 DIG-T N-Sport',
 'transmission': 'manual',
 'trim': 'N-Sport',
 'year': 2019}
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST04128%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Saving data for ST04128: {'auction_closing_time': 1774884631.0, 'created_time': 1774636648.043653, 'last_price_update_time': 1774723289.798977}
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST04128') HTTP/1.1" 204 0
2026-03-28 18:41:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-28 18:41:29 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-28 18:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:30 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 6008 | hits on page: 40
2026-03-28 18:41:30 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB61823%27 HTTP/1.1" 200 None
2026-03-28 18:41:30 [auto1.de] INFO: Scrape type for UB61823: 0
2026-03-28 18:41:30 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-28 18:41:30 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68340%27 HTTP/1.1" 200 None
2026-03-28 18:41:30 [auto1.de] INFO: Scrape type for KW68340: 2
2026-03-28 18:41:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with identifier: KW68340
2026-03-28 18:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with scrape type 2
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with scrape type 2
2026-03-28 18:41:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86, identifier: KW68340
2026-03-28 18:41:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with identifier: KW68340
2026-03-28 18:41:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with identifier: KW68340
2026-03-28 18:41:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with identifier: KW68340 to the API
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:40:39Z',
 'fuel_type': 'diesel',
 'id': '3f4acaef-f5e5-589e-bd99-a729fe0f1b86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW68340',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 131624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68340%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [auto1.de] INFO: Saving data for KW68340: {'auction_closing_time': 1774885239.0, 'created_time': 1773427052.657912, 'last_price_update_time': 1774723291.720914}
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW68340') HTTP/1.1" 204 0
2026-03-28 18:41:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:31 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-28 18:41:31 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-28 18:41:31 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-28 18:41:31 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD01129%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [auto1.de] INFO: Scrape type for PD01129: 0
2026-03-28 18:41:31 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-28 18:41:31 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-28 18:41:31 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-28 18:41:31 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15033%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [auto1.de] INFO: Scrape type for GR15033: 0
2026-03-28 18:41:31 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-28 18:41:31 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW69161%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [auto1.de] INFO: Scrape type for DW69161: 0
2026-03-28 18:41:31 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH92759%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [auto1.de] INFO: Scrape type for VH92759: 2
2026-03-28 18:41:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 158a8643-5b2f-56bf-aaa7-07d4e101d112 with identifier: VH92759
2026-03-28 18:41:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 158a8643-5b2f-56bf-aaa7-07d4e101d112 with scrape type 2
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 158a8643-5b2f-56bf-aaa7-07d4e101d112 with scrape type 2
2026-03-28 18:41:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 158a8643-5b2f-56bf-aaa7-07d4e101d112, identifier: VH92759
2026-03-28 18:41:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 158a8643-5b2f-56bf-aaa7-07d4e101d112 with identifier: VH92759
2026-03-28 18:41:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 158a8643-5b2f-56bf-aaa7-07d4e101d112 with identifier: VH92759
2026-03-28 18:41:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 158a8643-5b2f-56bf-aaa7-07d4e101d112 with identifier: VH92759 to the API
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:40:28Z',
 'fuel_type': 'petrol',
 'id': '158a8643-5b2f-56bf-aaa7-07d4e101d112',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH92759',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 152928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-16',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TFSI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH92759%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Saving data for VH92759: {'auction_closing_time': 1774885228.0, 'created_time': 1773131851.853362, 'last_price_update_time': 1774723292.238536}
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH92759') HTTP/1.1" 204 0
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE92744%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Scrape type for UE92744: 0
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX45513%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Scrape type for BX45513: 2
2026-03-28 18:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d70e638b-c6c0-57e1-a0ef-c6a162050ad7 with identifier: BX45513
2026-03-28 18:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d70e638b-c6c0-57e1-a0ef-c6a162050ad7 with scrape type 2
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d70e638b-c6c0-57e1-a0ef-c6a162050ad7 with scrape type 2
2026-03-28 18:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d70e638b-c6c0-57e1-a0ef-c6a162050ad7, identifier: BX45513
2026-03-28 18:41:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d70e638b-c6c0-57e1-a0ef-c6a162050ad7 with identifier: BX45513
2026-03-28 18:41:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d70e638b-c6c0-57e1-a0ef-c6a162050ad7 with identifier: BX45513
2026-03-28 18:41:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d70e638b-c6c0-57e1-a0ef-c6a162050ad7 with identifier: BX45513 to the API
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:43:16Z',
 'fuel_type': 'diesel',
 'id': 'd70e638b-c6c0-57e1-a0ef-c6a162050ad7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX45513',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 56080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-07',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX45513%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Saving data for BX45513: {'auction_closing_time': 1774885396.0, 'created_time': 1773946811.769795, 'last_price_update_time': 1774723292.803403}
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX45513') HTTP/1.1" 204 0
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK09354%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Scrape type for JK09354: 0
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH05961%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Scrape type for UH05961: 0
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX50197%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Scrape type for SX50197: 0
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF93739%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Scrape type for XF93739: 0
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB99639%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Scrape type for MB99639: 0
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB48782%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Scrape type for FB48782: 0
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ30357%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Scrape type for XJ30357: 0
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT56584%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Scrape type for MT56584: 0
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20975%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Scrape type for JY20975: 0
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA13792%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Scrape type for VA13792: 0
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-28 18:41:32 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM58161%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [auto1.de] INFO: Scrape type for CM58161: 2
2026-03-28 18:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc91ac1-39ae-586c-8f03-e99fba943819 with identifier: CM58161
2026-03-28 18:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc91ac1-39ae-586c-8f03-e99fba943819 with scrape type 2
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc91ac1-39ae-586c-8f03-e99fba943819 with scrape type 2
2026-03-28 18:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bc91ac1-39ae-586c-8f03-e99fba943819, identifier: CM58161
2026-03-28 18:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bc91ac1-39ae-586c-8f03-e99fba943819 with identifier: CM58161
2026-03-28 18:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bc91ac1-39ae-586c-8f03-e99fba943819 with identifier: CM58161
2026-03-28 18:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bc91ac1-39ae-586c-8f03-e99fba943819 with identifier: CM58161 to the API
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:55:30Z',
 'fuel_type': 'petrol',
 'id': '2bc91ac1-39ae-586c-8f03-e99fba943819',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM58161',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 274311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-12',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2008}
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM58161%27 HTTP/1.1" 200 None
2026-03-28 18:41:33 [auto1.de] INFO: Saving data for CM58161: {'auction_closing_time': 1774886130.0, 'created_time': 1773383550.360662, 'last_price_update_time': 1774723293.458338}
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM58161') HTTP/1.1" 204 0
2026-03-28 18:41:33 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-28 18:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:34 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 6008 | hits on page: 40
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP67485%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for SP67485: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC52904%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for BC52904: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU59461%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for JU59461: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX55522%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for HX55522: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98939%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for TS98939: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC54043%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for YC54043: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF47459%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for YF47459: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV91199%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for NV91199: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY76457%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for YY76457: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM16548%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for JM16548: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ49473%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for RZ49473: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ94185%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for SZ94185: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA80690%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for EA80690: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE65946%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for HE65946: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX99081%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for PX99081: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN68055%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for WN68055: 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW60338%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for ZW60338: 2
2026-03-28 18:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6761bb1-61f1-5615-ba88-c15d724142ed with identifier: ZW60338
2026-03-28 18:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6761bb1-61f1-5615-ba88-c15d724142ed with scrape type 2
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6761bb1-61f1-5615-ba88-c15d724142ed with scrape type 2
2026-03-28 18:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6761bb1-61f1-5615-ba88-c15d724142ed, identifier: ZW60338
2026-03-28 18:41:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6761bb1-61f1-5615-ba88-c15d724142ed with identifier: ZW60338
2026-03-28 18:41:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6761bb1-61f1-5615-ba88-c15d724142ed with identifier: ZW60338
2026-03-28 18:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6761bb1-61f1-5615-ba88-c15d724142ed with identifier: ZW60338 to the API
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:11:30Z',
 'fuel_type': 'petrol',
 'id': 'f6761bb1-61f1-5615-ba88-c15d724142ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW60338',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 162693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-29',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2010}
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW60338%27 HTTP/1.1" 200 None
2026-03-28 18:41:35 [auto1.de] INFO: Saving data for ZW60338: {'auction_closing_time': 1774883490.0, 'created_time': 1774522151.260255, 'last_price_update_time': 1774723295.229228}
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW60338') HTTP/1.1" 204 0
2026-03-28 18:41:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:35 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-28 18:41:35 [auto1.de] INFO: Found listing with ID: VW88901
2026-03-28 18:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:36 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 6008 | hits on page: 40
2026-03-28 18:41:36 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21289%27 HTTP/1.1" 200 None
2026-03-28 18:41:36 [auto1.de] INFO: Scrape type for YJ21289: 2
2026-03-28 18:41:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with identifier: YJ21289
2026-03-28 18:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with scrape type 2
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with scrape type 2
2026-03-28 18:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d, identifier: YJ21289
2026-03-28 18:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with identifier: YJ21289
2026-03-28 18:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with identifier: YJ21289
2026-03-28 18:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with identifier: YJ21289 to the API
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:45:20Z',
 'fuel_type': 'petrol',
 'id': '78c6cb8d-c293-525b-9df6-2e4ef86ba37d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ21289',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 66791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Audi A5 45 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21289%27 HTTP/1.1" 200 None
2026-03-28 18:41:36 [auto1.de] INFO: Saving data for YJ21289: {'auction_closing_time': 1774885520.0, 'created_time': 1773382195.103127, 'last_price_update_time': 1774723296.807644}
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ21289') HTTP/1.1" 204 0
2026-03-28 18:41:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:36 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX11435%27 HTTP/1.1" 200 None
2026-03-28 18:41:36 [auto1.de] INFO: Scrape type for MX11435: 0
2026-03-28 18:41:36 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-28 18:41:36 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-28 18:41:36 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-28 18:41:36 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36237%27 HTTP/1.1" 200 None
2026-03-28 18:41:36 [auto1.de] INFO: Scrape type for VU36237: 2
2026-03-28 18:41:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1451d7fb-3a86-5cf1-a537-0a12a21b5651 with identifier: VU36237
2026-03-28 18:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1451d7fb-3a86-5cf1-a537-0a12a21b5651 with scrape type 2
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1451d7fb-3a86-5cf1-a537-0a12a21b5651 with scrape type 2
2026-03-28 18:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1451d7fb-3a86-5cf1-a537-0a12a21b5651, identifier: VU36237
2026-03-28 18:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1451d7fb-3a86-5cf1-a537-0a12a21b5651 with identifier: VU36237
2026-03-28 18:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1451d7fb-3a86-5cf1-a537-0a12a21b5651 with identifier: VU36237
2026-03-28 18:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1451d7fb-3a86-5cf1-a537-0a12a21b5651 with identifier: VU36237 to the API
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:02:12Z',
 'fuel_type': 'petrol',
 'id': '1451d7fb-3a86-5cf1-a537-0a12a21b5651',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU36237',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 66416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-02',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36237%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Saving data for VU36237: {'auction_closing_time': 1774882932.0, 'created_time': 1772728542.861412, 'last_price_update_time': 1774723297.27416}
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU36237') HTTP/1.1" 204 0
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77152%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Scrape type for HL77152: 0
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY78752%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Scrape type for GY78752: 0
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN65963%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Scrape type for EN65963: 0
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43781%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Scrape type for UZ43781: 2
2026-03-28 18:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f37b9f-4b57-51d8-a565-82a55cc1dfe6 with identifier: UZ43781
2026-03-28 18:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f37b9f-4b57-51d8-a565-82a55cc1dfe6 with scrape type 2
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17f37b9f-4b57-51d8-a565-82a55cc1dfe6 with scrape type 2
2026-03-28 18:41:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17f37b9f-4b57-51d8-a565-82a55cc1dfe6, identifier: UZ43781
2026-03-28 18:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17f37b9f-4b57-51d8-a565-82a55cc1dfe6 with identifier: UZ43781
2026-03-28 18:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17f37b9f-4b57-51d8-a565-82a55cc1dfe6 with identifier: UZ43781
2026-03-28 18:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17f37b9f-4b57-51d8-a565-82a55cc1dfe6 with identifier: UZ43781 to the API
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:57:58Z',
 'fuel_type': 'petrol',
 'id': '17f37b9f-4b57-51d8-a565-82a55cc1dfe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ43781',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 104605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-11',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43781%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Saving data for UZ43781: {'auction_closing_time': 1774886278.0, 'created_time': 1773135798.311172, 'last_price_update_time': 1774723297.778669}
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ43781') HTTP/1.1" 204 0
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: UW42720
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF87432%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Scrape type for JF87432: 0
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY76053%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Scrape type for DY76053: 0
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU98141%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Scrape type for UU98141: 0
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40728%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Scrape type for TX40728: 0
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: US56502
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB09552%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Scrape type for EB09552: 2
2026-03-28 18:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd352567-47ca-5310-b242-b528880f452b with identifier: EB09552
2026-03-28 18:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd352567-47ca-5310-b242-b528880f452b with scrape type 2
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd352567-47ca-5310-b242-b528880f452b with scrape type 2
2026-03-28 18:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd352567-47ca-5310-b242-b528880f452b, identifier: EB09552
2026-03-28 18:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd352567-47ca-5310-b242-b528880f452b with identifier: EB09552
2026-03-28 18:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd352567-47ca-5310-b242-b528880f452b with identifier: EB09552
2026-03-28 18:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd352567-47ca-5310-b242-b528880f452b with identifier: EB09552 to the API
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:13:51Z',
 'fuel_type': 'petrol',
 'id': 'dd352567-47ca-5310-b242-b528880f452b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB09552',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 152649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-03',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2006}
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB09552%27 HTTP/1.1" 200 None
2026-03-28 18:41:38 [auto1.de] INFO: Saving data for EB09552: {'auction_closing_time': 1774883631.0, 'created_time': 1774522483.392692, 'last_price_update_time': 1774723298.434796}
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB09552') HTTP/1.1" 204 0
2026-03-28 18:41:38 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN47186%27 HTTP/1.1" 200 None
2026-03-28 18:41:38 [auto1.de] INFO: Scrape type for MN47186: 0
2026-03-28 18:41:38 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-28 18:41:38 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-28 18:41:38 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-28 18:41:38 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC78323%27 HTTP/1.1" 200 None
2026-03-28 18:41:38 [auto1.de] INFO: Scrape type for RC78323: 0
2026-03-28 18:41:38 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76340%27 HTTP/1.1" 200 None
2026-03-28 18:41:38 [auto1.de] INFO: Scrape type for LF76340: 2
2026-03-28 18:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with identifier: LF76340
2026-03-28 18:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with scrape type 2
2026-03-28 18:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with scrape type 2
2026-03-28 18:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f, identifier: LF76340
2026-03-28 18:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with identifier: LF76340
2026-03-28 18:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with identifier: LF76340
2026-03-28 18:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with identifier: LF76340 to the API
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:05:15Z',
 'fuel_type': 'petrol',
 'id': '8ae4c973-a17d-5587-a02b-7d9ea7fbe57f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF76340',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 171488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-26',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76340%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Saving data for LF76340: {'auction_closing_time': 1774883115.0, 'created_time': 1774522499.579679, 'last_price_update_time': 1774723299.017241}
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF76340') HTTP/1.1" 204 0
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL50388%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Scrape type for JL50388: 0
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY49158%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Scrape type for AY49158: 0
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64301%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Scrape type for RC64301: 0
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS95073%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Scrape type for PS95073: 0
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW95477%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Scrape type for WW95477: 0
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18846%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Scrape type for KV18846: 0
2026-03-28 18:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:39 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 6008 | hits on page: 40
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX72009%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Scrape type for SX72009: 0
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA60248%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Scrape type for ZA60248: 2
2026-03-28 18:41:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05737405-74fe-59e4-9ff4-72278f6053ef with identifier: ZA60248
2026-03-28 18:41:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05737405-74fe-59e4-9ff4-72278f6053ef with scrape type 2
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05737405-74fe-59e4-9ff4-72278f6053ef with scrape type 2
2026-03-28 18:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05737405-74fe-59e4-9ff4-72278f6053ef, identifier: ZA60248
2026-03-28 18:41:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05737405-74fe-59e4-9ff4-72278f6053ef with identifier: ZA60248
2026-03-28 18:41:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05737405-74fe-59e4-9ff4-72278f6053ef with identifier: ZA60248
2026-03-28 18:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05737405-74fe-59e4-9ff4-72278f6053ef with identifier: ZA60248 to the API
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-30T15:36:14Z',
 'fuel_type': 'petrol',
 'id': '05737405-74fe-59e4-9ff4-72278f6053ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA60248',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 60565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2020}
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA60248%27 HTTP/1.1" 200 None
2026-03-28 18:41:40 [auto1.de] INFO: Saving data for ZA60248: {'auction_closing_time': 1774884974.0, 'created_time': 1773858955.103501, 'last_price_update_time': 1774723300.35036}
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA60248') HTTP/1.1" 204 0
2026-03-28 18:41:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT47398%27 HTTP/1.1" 200 None
2026-03-28 18:41:40 [auto1.de] INFO: Scrape type for YT47398: 0
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG18386%27 HTTP/1.1" 200 None
2026-03-28 18:41:40 [auto1.de] INFO: Scrape type for VG18386: 0
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB52240%27 HTTP/1.1" 200 None
2026-03-28 18:41:40 [auto1.de] INFO: Scrape type for BB52240: 0
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK52419%27 HTTP/1.1" 200 None
2026-03-28 18:41:40 [auto1.de] INFO: Scrape type for RK52419: 0
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU21879%27 HTTP/1.1" 200 None
2026-03-28 18:41:40 [auto1.de] INFO: Scrape type for YU21879: 0
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD93241%27 HTTP/1.1" 200 None
2026-03-28 18:41:40 [auto1.de] INFO: Scrape type for HD93241: 2
2026-03-28 18:41:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79dc98a9-7049-59b4-8bca-a1762fa4c0d2 with identifier: HD93241
2026-03-28 18:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79dc98a9-7049-59b4-8bca-a1762fa4c0d2 with scrape type 2
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79dc98a9-7049-59b4-8bca-a1762fa4c0d2 with scrape type 2
2026-03-28 18:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79dc98a9-7049-59b4-8bca-a1762fa4c0d2, identifier: HD93241
2026-03-28 18:41:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79dc98a9-7049-59b4-8bca-a1762fa4c0d2 with identifier: HD93241
2026-03-28 18:41:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79dc98a9-7049-59b4-8bca-a1762fa4c0d2 with identifier: HD93241
2026-03-28 18:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79dc98a9-7049-59b4-8bca-a1762fa4c0d2 with identifier: HD93241 to the API
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 99,
 'expiration_date': '2026-03-30T15:57:17Z',
 'fuel_type': 'petrol',
 'id': '79dc98a9-7049-59b4-8bca-a1762fa4c0d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD93241',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 59013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-26',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2019}
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD93241%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Saving data for HD93241: {'auction_closing_time': 1774886237.0, 'created_time': 1774031832.294531, 'last_price_update_time': 1774723301.026644}
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD93241') HTTP/1.1" 204 0
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS15843%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Scrape type for ZS15843: 0
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP80486%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Scrape type for DP80486: 0
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: US92808
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL98851%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Scrape type for HL98851: 0
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG82631%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Scrape type for ZG82631: 0
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR57027%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Scrape type for WR57027: 0
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT14298%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Scrape type for GT14298: 2
2026-03-28 18:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052 with identifier: GT14298
2026-03-28 18:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052 with scrape type 2
2026-03-28 18:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052 with scrape type 2
2026-03-28 18:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052, identifier: GT14298
2026-03-28 18:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052 with identifier: GT14298
2026-03-28 18:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052 with identifier: GT14298
2026-03-28 18:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052 with identifier: GT14298 to the API
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:41:37Z',
 'fuel_type': 'diesel',
 'id': '9e7ae824-5f17-5735-a5d5-cd4ee0e4a052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT14298',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 115818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-11',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT14298%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Saving data for GT14298: {'auction_closing_time': 1774885297.0, 'created_time': 1774350205.329863, 'last_price_update_time': 1774723301.674751}
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT14298') HTTP/1.1" 204 0
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33048%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Scrape type for KV33048: 0
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ53783%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Scrape type for JZ53783: 0
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH55559%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Scrape type for JH55559: 0
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75518%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Scrape type for CJ75518: 0
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80015%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Scrape type for JB80015: 0
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF75953%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Scrape type for RF75953: 0
2026-03-28 18:41:41 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX09791%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Scrape type for JX09791: 2
2026-03-28 18:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5f7d8ec-566c-5476-8652-bc0d3a39ea3e with identifier: JX09791
2026-03-28 18:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5f7d8ec-566c-5476-8652-bc0d3a39ea3e with scrape type 2
2026-03-28 18:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5f7d8ec-566c-5476-8652-bc0d3a39ea3e with scrape type 2
2026-03-28 18:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5f7d8ec-566c-5476-8652-bc0d3a39ea3e, identifier: JX09791
2026-03-28 18:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5f7d8ec-566c-5476-8652-bc0d3a39ea3e with identifier: JX09791
2026-03-28 18:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5f7d8ec-566c-5476-8652-bc0d3a39ea3e with identifier: JX09791
2026-03-28 18:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5f7d8ec-566c-5476-8652-bc0d3a39ea3e with identifier: JX09791 to the API
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:24Z',
 'fuel_type': 'petrol',
 'id': 'a5f7d8ec-566c-5476-8652-bc0d3a39ea3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX09791',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 65691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-12',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2021}
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX09791%27 HTTP/1.1" 200 None
2026-03-28 18:41:42 [auto1.de] INFO: Saving data for JX09791: {'auction_closing_time': 1774883424.0, 'created_time': 1774636657.159011, 'last_price_update_time': 1774723302.254471}
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX09791') HTTP/1.1" 204 0
2026-03-28 18:41:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:43 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 6008 | hits on page: 40
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ55086%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for UJ55086: 0
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR32988%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for DR32988: 2
2026-03-28 18:41:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 463d34e4-9930-532b-9770-8a78e8b016c5 with identifier: DR32988
2026-03-28 18:41:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 463d34e4-9930-532b-9770-8a78e8b016c5 with scrape type 2
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 463d34e4-9930-532b-9770-8a78e8b016c5 with scrape type 2
2026-03-28 18:41:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 463d34e4-9930-532b-9770-8a78e8b016c5, identifier: DR32988
2026-03-28 18:41:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 463d34e4-9930-532b-9770-8a78e8b016c5 with identifier: DR32988
2026-03-28 18:41:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 463d34e4-9930-532b-9770-8a78e8b016c5 with identifier: DR32988
2026-03-28 18:41:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 463d34e4-9930-532b-9770-8a78e8b016c5 with identifier: DR32988 to the API
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:44:30Z',
 'fuel_type': 'diesel',
 'id': '463d34e4-9930-532b-9770-8a78e8b016c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR32988',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 90227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-20',
 'seller_name': None,
 'title': 'Ford Ranger 2.2 TDCi Doppelkabine 4x4 XLT',
 'transmission': 'manual',
 'trim': 'Doppelkabine 4x4 XLT',
 'year': 2017}
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR32988%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Saving data for DR32988: {'auction_closing_time': 1774885470.0, 'created_time': 1774522694.248073, 'last_price_update_time': 1774723303.683298}
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR32988') HTTP/1.1" 204 0
2026-03-28 18:41:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68423%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for HU68423: 0
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW18782%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for ZW18782: 0
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH01499%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for RH01499: 0
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT22641%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for CT22641: 0
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV93424%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for DV93424: 0
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX92669%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for JX92669: 0
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46030%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for VL46030: 2
2026-03-28 18:41:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1485a78a-04fa-5302-ad0d-da3eac10dc1c with identifier: VL46030
2026-03-28 18:41:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1485a78a-04fa-5302-ad0d-da3eac10dc1c with scrape type 2
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1485a78a-04fa-5302-ad0d-da3eac10dc1c with scrape type 2
2026-03-28 18:41:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1485a78a-04fa-5302-ad0d-da3eac10dc1c, identifier: VL46030
2026-03-28 18:41:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1485a78a-04fa-5302-ad0d-da3eac10dc1c with identifier: VL46030
2026-03-28 18:41:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1485a78a-04fa-5302-ad0d-da3eac10dc1c with identifier: VL46030
2026-03-28 18:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1485a78a-04fa-5302-ad0d-da3eac10dc1c with identifier: VL46030 to the API
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:50:08Z',
 'fuel_type': 'petrol',
 'id': '1485a78a-04fa-5302-ad0d-da3eac10dc1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL46030',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 48507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-14',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46030%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Saving data for VL46030: {'auction_closing_time': 1774885808.0, 'created_time': 1774521588.907601, 'last_price_update_time': 1774723304.273612}
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL46030') HTTP/1.1" 204 0
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF99280%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Scrape type for AF99280: 0
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY09014%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Scrape type for FY09014: 0
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU04620%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Scrape type for JU04620: 0
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: JG45711
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX96959%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Scrape type for GX96959: 0
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM81365%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Scrape type for NM81365: 0
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP49973%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Scrape type for NP49973: 0
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK72696%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Scrape type for VK72696: 2
2026-03-28 18:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee7b2695-032f-51d1-bde1-61a1644069a6 with identifier: VK72696
2026-03-28 18:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee7b2695-032f-51d1-bde1-61a1644069a6 with scrape type 2
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee7b2695-032f-51d1-bde1-61a1644069a6 with scrape type 2
2026-03-28 18:41:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee7b2695-032f-51d1-bde1-61a1644069a6, identifier: VK72696
2026-03-28 18:41:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee7b2695-032f-51d1-bde1-61a1644069a6 with identifier: VK72696
2026-03-28 18:41:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee7b2695-032f-51d1-bde1-61a1644069a6 with identifier: VK72696
2026-03-28 18:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee7b2695-032f-51d1-bde1-61a1644069a6 with identifier: VK72696 to the API
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:02:09Z',
 'fuel_type': 'petrol',
 'id': 'ee7b2695-032f-51d1-bde1-61a1644069a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK72696',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 80065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK72696%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Saving data for VK72696: {'auction_closing_time': 1774882929.0, 'created_time': 1774522252.557076, 'last_price_update_time': 1774723304.924242}
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK72696') HTTP/1.1" 204 0
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11616%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [auto1.de] INFO: Scrape type for BX11616: 0
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL73476%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [auto1.de] INFO: Scrape type for KL73476: 0
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD95192%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [auto1.de] INFO: Scrape type for PD95192: 0
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW40365%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [auto1.de] INFO: Scrape type for SW40365: 2
2026-03-28 18:41:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17940e68-d952-5e43-bfa2-8b7fd02ca307 with identifier: SW40365
2026-03-28 18:41:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17940e68-d952-5e43-bfa2-8b7fd02ca307 with scrape type 2
2026-03-28 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17940e68-d952-5e43-bfa2-8b7fd02ca307 with scrape type 2
2026-03-28 18:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17940e68-d952-5e43-bfa2-8b7fd02ca307, identifier: SW40365
2026-03-28 18:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17940e68-d952-5e43-bfa2-8b7fd02ca307 with identifier: SW40365
2026-03-28 18:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17940e68-d952-5e43-bfa2-8b7fd02ca307 with identifier: SW40365
2026-03-28 18:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17940e68-d952-5e43-bfa2-8b7fd02ca307 with identifier: SW40365 to the API
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:17:18Z',
 'fuel_type': 'diesel',
 'id': '17940e68-d952-5e43-bfa2-8b7fd02ca307',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW40365',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 175452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-18',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2021}
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW40365%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [auto1.de] INFO: Saving data for SW40365: {'auction_closing_time': 1774883838.0, 'created_time': 1773380950.550579, 'last_price_update_time': 1774723305.550738}
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW40365') HTTP/1.1" 204 0
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE82761%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [auto1.de] INFO: Scrape type for FE82761: 0
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50653%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [auto1.de] INFO: Scrape type for YW50653: 2
2026-03-28 18:41:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 675677bf-3e44-50d8-8159-14bd4eca7707 with identifier: YW50653
2026-03-28 18:41:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675677bf-3e44-50d8-8159-14bd4eca7707 with scrape type 2
2026-03-28 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 675677bf-3e44-50d8-8159-14bd4eca7707 with scrape type 2
2026-03-28 18:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 675677bf-3e44-50d8-8159-14bd4eca7707, identifier: YW50653
2026-03-28 18:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 675677bf-3e44-50d8-8159-14bd4eca7707 with identifier: YW50653
2026-03-28 18:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 675677bf-3e44-50d8-8159-14bd4eca7707 with identifier: YW50653
2026-03-28 18:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 675677bf-3e44-50d8-8159-14bd4eca7707 with identifier: YW50653 to the API
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:20:52Z',
 'fuel_type': 'petrol',
 'id': '675677bf-3e44-50d8-8159-14bd4eca7707',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW50653',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 233261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-31',
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2007}
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50653%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [auto1.de] INFO: Saving data for YW50653: {'auction_closing_time': 1774884052.0, 'created_time': 1774522443.96113, 'last_price_update_time': 1774723306.009045}
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW50653') HTTP/1.1" 204 0
2026-03-28 18:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:47 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 6008 | hits on page: 40
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP99262%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for RP99262: 0
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ47858%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for KZ47858: 2
2026-03-28 18:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with identifier: KZ47858
2026-03-28 18:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with scrape type 2
2026-03-28 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with scrape type 2
2026-03-28 18:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d, identifier: KZ47858
2026-03-28 18:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with identifier: KZ47858
2026-03-28 18:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with identifier: KZ47858
2026-03-28 18:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with identifier: KZ47858 to the API
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:37:49Z',
 'fuel_type': 'petrol',
 'id': '2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ47858',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 213087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ47858%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Saving data for KZ47858: {'auction_closing_time': 1774885069.0, 'created_time': 1773341316.25608, 'last_price_update_time': 1774723307.464253}
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ47858') HTTP/1.1" 204 0
2026-03-28 18:41:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE13487%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for NE13487: 0
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR43966%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for BR43966: 0
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU15721%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for YU15721: 0
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX67630%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for FX67630: 0
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX01041%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for MX01041: 0
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL59024%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for LL59024: 0
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG77097%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for JG77097: 0
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC20634%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for BC20634: 0
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL95797%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for NL95797: 0
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ29273%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for GZ29273: 2
2026-03-28 18:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c38b3cea-9a6f-505c-b1bf-316318f42f2d with identifier: GZ29273
2026-03-28 18:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c38b3cea-9a6f-505c-b1bf-316318f42f2d with scrape type 2
2026-03-28 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c38b3cea-9a6f-505c-b1bf-316318f42f2d with scrape type 2
2026-03-28 18:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c38b3cea-9a6f-505c-b1bf-316318f42f2d, identifier: GZ29273
2026-03-28 18:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c38b3cea-9a6f-505c-b1bf-316318f42f2d with identifier: GZ29273
2026-03-28 18:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c38b3cea-9a6f-505c-b1bf-316318f42f2d with identifier: GZ29273
2026-03-28 18:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c38b3cea-9a6f-505c-b1bf-316318f42f2d with identifier: GZ29273 to the API
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:58:06Z',
 'fuel_type': 'diesel',
 'id': 'c38b3cea-9a6f-505c-b1bf-316318f42f2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ29273',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 112275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-26',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2016}
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ29273%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Saving data for GZ29273: {'auction_closing_time': 1774886286.0, 'created_time': 1774522350.299571, 'last_price_update_time': 1774723308.213156}
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ29273') HTTP/1.1" 204 0
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE56554%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Scrape type for DE56554: 0
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL37437%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Scrape type for JL37437: 0
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH05972%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Scrape type for FH05972: 2
2026-03-28 18:41:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47863fa4-4f46-59af-be65-653ddf1ce0e1 with identifier: FH05972
2026-03-28 18:41:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47863fa4-4f46-59af-be65-653ddf1ce0e1 with scrape type 2
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47863fa4-4f46-59af-be65-653ddf1ce0e1 with scrape type 2
2026-03-28 18:41:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47863fa4-4f46-59af-be65-653ddf1ce0e1, identifier: FH05972
2026-03-28 18:41:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47863fa4-4f46-59af-be65-653ddf1ce0e1 with identifier: FH05972
2026-03-28 18:41:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47863fa4-4f46-59af-be65-653ddf1ce0e1 with identifier: FH05972
2026-03-28 18:41:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47863fa4-4f46-59af-be65-653ddf1ce0e1 with identifier: FH05972 to the API
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:49:44Z',
 'fuel_type': 'petrol',
 'id': '47863fa4-4f46-59af-be65-653ddf1ce0e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH05972',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 118245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-28',
 'seller_name': None,
 'title': 'MINI Clubman Cooper S ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2018}
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH05972%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Saving data for FH05972: {'auction_closing_time': 1774885784.0, 'created_time': 1774636908.340742, 'last_price_update_time': 1774723308.805847}
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH05972') HTTP/1.1" 204 0
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN04984%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Scrape type for TN04984: 0
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG94407%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Scrape type for LG94407: 0
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34556%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Scrape type for JN34556: 0
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB03108%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Scrape type for LB03108: 0
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61912%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Scrape type for GL61912: 0
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR98876%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Scrape type for WR98876: 2
2026-03-28 18:41:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8 with identifier: WR98876
2026-03-28 18:41:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8 with scrape type 2
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8 with scrape type 2
2026-03-28 18:41:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8, identifier: WR98876
2026-03-28 18:41:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8 with identifier: WR98876
2026-03-28 18:41:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8 with identifier: WR98876
2026-03-28 18:41:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8 with identifier: WR98876 to the API
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:10:40Z',
 'fuel_type': 'diesel',
 'id': '386ea913-8fd4-540e-a0ce-6b4f54eb4cc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR98876',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 170672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-31',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2015}
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR98876%27 HTTP/1.1" 200 None
2026-03-28 18:41:49 [auto1.de] INFO: Saving data for WR98876: {'auction_closing_time': 1774883440.0, 'created_time': 1774350530.293288, 'last_price_update_time': 1774723309.378272}
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR98876') HTTP/1.1" 204 0
2026-03-28 18:41:49 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-28 18:41:49 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-28 18:41:49 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB28690%27 HTTP/1.1" 200 None
2026-03-28 18:41:49 [auto1.de] INFO: Scrape type for UB28690: 2
2026-03-28 18:41:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4fe42eb-4935-5113-a40b-b9debac213ec with identifier: UB28690
2026-03-28 18:41:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4fe42eb-4935-5113-a40b-b9debac213ec with scrape type 2
2026-03-28 18:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4fe42eb-4935-5113-a40b-b9debac213ec with scrape type 2
2026-03-28 18:41:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4fe42eb-4935-5113-a40b-b9debac213ec, identifier: UB28690
2026-03-28 18:41:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4fe42eb-4935-5113-a40b-b9debac213ec with identifier: UB28690
2026-03-28 18:41:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4fe42eb-4935-5113-a40b-b9debac213ec with identifier: UB28690
2026-03-28 18:41:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4fe42eb-4935-5113-a40b-b9debac213ec with identifier: UB28690 to the API
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:25:52Z',
 'fuel_type': 'petrol',
 'id': 'b4fe42eb-4935-5113-a40b-b9debac213ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB28690',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 101427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-13',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo ON',
 'transmission': 'manual',
 'trim': 'ON',
 'year': 2017}
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB28690%27 HTTP/1.1" 200 None
2026-03-28 18:41:49 [auto1.de] INFO: Saving data for UB28690: {'auction_closing_time': 1774884352.0, 'created_time': 1774636617.852686, 'last_price_update_time': 1774723309.936419}
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB28690') HTTP/1.1" 204 0
2026-03-28 18:41:49 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-28 18:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:50 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 6008 | hits on page: 40
2026-03-28 18:41:50 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-28 18:41:50 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF57615%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [auto1.de] INFO: Scrape type for WF57615: 0
2026-03-28 18:41:50 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC78051%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [auto1.de] INFO: Scrape type for PC78051: 0
2026-03-28 18:41:50 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-28 18:41:50 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-28 18:41:50 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG12536%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [auto1.de] INFO: Scrape type for KG12536: 0
2026-03-28 18:41:50 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-28 18:41:50 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-28 18:41:50 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18345%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [auto1.de] INFO: Scrape type for KV18345: 2
2026-03-28 18:41:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with identifier: KV18345
2026-03-28 18:41:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with scrape type 2
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with scrape type 2
2026-03-28 18:41:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7061eccb-bcde-5f92-8794-faa4bd88fcc5, identifier: KV18345
2026-03-28 18:41:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with identifier: KV18345
2026-03-28 18:41:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with identifier: KV18345
2026-03-28 18:41:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with identifier: KV18345 to the API
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:38:55Z',
 'fuel_type': 'petrol',
 'id': '7061eccb-bcde-5f92-8794-faa4bd88fcc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV18345',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 109253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-07',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18345%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [auto1.de] INFO: Saving data for KV18345: {'auction_closing_time': 1774885135.0, 'created_time': 1773400237.049561, 'last_price_update_time': 1774723311.338695}
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV18345') HTTP/1.1" 204 0
2026-03-28 18:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY51393%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [auto1.de] INFO: Scrape type for BY51393: 0
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF81800%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [auto1.de] INFO: Scrape type for LF81800: 0
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU36809%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [auto1.de] INFO: Scrape type for EU36809: 0
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20606%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [auto1.de] INFO: Scrape type for TY20606: 0
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06361%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [auto1.de] INFO: Scrape type for WT06361: 0
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31653%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [auto1.de] INFO: Scrape type for GA31653: 0
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE15652%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [auto1.de] INFO: Scrape type for NE15652: 0
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK89545%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [auto1.de] INFO: Scrape type for LK89545: 0
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37789%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [auto1.de] INFO: Scrape type for MZ37789: 0
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ01572%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [auto1.de] INFO: Scrape type for NZ01572: 0
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB50178%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [auto1.de] INFO: Scrape type for VB50178: 0
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-28 18:41:51 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE19972%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [auto1.de] INFO: Scrape type for NE19972: 2
2026-03-28 18:41:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df834e0e-34ab-55f6-a58c-8774994ea020 with identifier: NE19972
2026-03-28 18:41:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df834e0e-34ab-55f6-a58c-8774994ea020 with scrape type 2
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df834e0e-34ab-55f6-a58c-8774994ea020 with scrape type 2
2026-03-28 18:41:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df834e0e-34ab-55f6-a58c-8774994ea020, identifier: NE19972
2026-03-28 18:41:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df834e0e-34ab-55f6-a58c-8774994ea020 with identifier: NE19972
2026-03-28 18:41:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df834e0e-34ab-55f6-a58c-8774994ea020 with identifier: NE19972
2026-03-28 18:41:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df834e0e-34ab-55f6-a58c-8774994ea020 with identifier: NE19972 to the API
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:04:57Z',
 'fuel_type': 'diesel',
 'id': 'df834e0e-34ab-55f6-a58c-8774994ea020',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE19972',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 238525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-11',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE19972%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [auto1.de] INFO: Saving data for NE19972: {'auction_closing_time': 1774883097.0, 'created_time': 1774033080.585198, 'last_price_update_time': 1774723312.090218}
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE19972') HTTP/1.1" 204 0
2026-03-28 18:41:52 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP50790%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [auto1.de] INFO: Scrape type for CP50790: 0
2026-03-28 18:41:52 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU91677%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [auto1.de] INFO: Scrape type for WU91677: 0
2026-03-28 18:41:52 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF79248%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [auto1.de] INFO: Scrape type for YF79248: 0
2026-03-28 18:41:52 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-28 18:41:52 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-28 18:41:52 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-28 18:41:52 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK53054%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [auto1.de] INFO: Scrape type for NK53054: 0
2026-03-28 18:41:52 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-28 18:41:52 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-28 18:41:52 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-28 18:41:52 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-28 18:41:52 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14297%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [auto1.de] INFO: Scrape type for SG14297: 2
2026-03-28 18:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b136346-3d12-5785-8a21-af8db765002b with identifier: SG14297
2026-03-28 18:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b136346-3d12-5785-8a21-af8db765002b with scrape type 2
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b136346-3d12-5785-8a21-af8db765002b with scrape type 2
2026-03-28 18:41:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b136346-3d12-5785-8a21-af8db765002b, identifier: SG14297
2026-03-28 18:41:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b136346-3d12-5785-8a21-af8db765002b with identifier: SG14297
2026-03-28 18:41:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b136346-3d12-5785-8a21-af8db765002b with identifier: SG14297
2026-03-28 18:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b136346-3d12-5785-8a21-af8db765002b with identifier: SG14297 to the API
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:58Z',
 'fuel_type': 'petrol',
 'id': '5b136346-3d12-5785-8a21-af8db765002b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG14297',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 136637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-03',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14297%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [auto1.de] INFO: Saving data for SG14297: {'auction_closing_time': 1774884778.0, 'created_time': 1774636585.851593, 'last_price_update_time': 1774723312.737435}
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG14297') HTTP/1.1" 204 0
2026-03-28 18:41:52 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-28 18:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:53 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 6008 | hits on page: 40
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG05559%27 HTTP/1.1" 200 None
2026-03-28 18:41:53 [auto1.de] INFO: Scrape type for KG05559: 0
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX81034%27 HTTP/1.1" 200 None
2026-03-28 18:41:53 [auto1.de] INFO: Scrape type for XX81034: 0
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA12811%27 HTTP/1.1" 200 None
2026-03-28 18:41:53 [auto1.de] INFO: Scrape type for MA12811: 0
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV33356%27 HTTP/1.1" 200 None
2026-03-28 18:41:53 [auto1.de] INFO: Scrape type for GV33356: 0
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91338%27 HTTP/1.1" 200 None
2026-03-28 18:41:53 [auto1.de] INFO: Scrape type for XY91338: 0
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH43917%27 HTTP/1.1" 200 None
2026-03-28 18:41:53 [auto1.de] INFO: Scrape type for BH43917: 0
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-28 18:41:53 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47772%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [auto1.de] INFO: Scrape type for SY47772: 0
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG98772%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [auto1.de] INFO: Scrape type for KG98772: 0
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE97467%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [auto1.de] INFO: Scrape type for TE97467: 0
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK49169%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [auto1.de] INFO: Scrape type for VK49169: 0
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN92666%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [auto1.de] INFO: Scrape type for EN92666: 0
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: VK36740
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK36740%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [auto1.de] INFO: Scrape type for VK36740: 1
2026-03-28 18:41:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: GK27432
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK27432%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [auto1.de] INFO: Scrape type for GK27432: 1
2026-03-28 18:41:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL85831%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [auto1.de] INFO: Scrape type for WL85831: 0
2026-03-28 18:41:54 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-28 18:41:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:55 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 6009 | hits on page: 40
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ39551%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [auto1.de] INFO: Scrape type for LJ39551: 2
2026-03-28 18:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bafad74d-0159-5389-a6c8-70089e10eb93 with identifier: LJ39551
2026-03-28 18:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bafad74d-0159-5389-a6c8-70089e10eb93 with scrape type 2
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bafad74d-0159-5389-a6c8-70089e10eb93 with scrape type 2
2026-03-28 18:41:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bafad74d-0159-5389-a6c8-70089e10eb93, identifier: LJ39551
2026-03-28 18:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bafad74d-0159-5389-a6c8-70089e10eb93 with identifier: LJ39551
2026-03-28 18:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bafad74d-0159-5389-a6c8-70089e10eb93 with identifier: LJ39551
2026-03-28 18:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bafad74d-0159-5389-a6c8-70089e10eb93 with identifier: LJ39551 to the API
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:33:48Z',
 'fuel_type': 'petrol',
 'id': 'bafad74d-0159-5389-a6c8-70089e10eb93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ39551',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 64916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2021}
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ39551%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [auto1.de] INFO: Saving data for LJ39551: {'auction_closing_time': 1774884828.0, 'created_time': 1774522247.521105, 'last_price_update_time': 1774723315.59301}
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ39551') HTTP/1.1" 204 0
2026-03-28 18:41:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21429%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [auto1.de] INFO: Scrape type for FV21429: 0
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92076%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [auto1.de] INFO: Scrape type for TX92076: 0
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR82363%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [auto1.de] INFO: Scrape type for CR82363: 0
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33039%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [auto1.de] INFO: Scrape type for CY33039: 0
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45535%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [auto1.de] INFO: Scrape type for SZ45535: 0
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA00227%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [auto1.de] INFO: Scrape type for KA00227: 0
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-28 18:41:55 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL68094%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [auto1.de] INFO: Scrape type for KL68094: 2
2026-03-28 18:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with identifier: KL68094
2026-03-28 18:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with scrape type 2
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with scrape type 2
2026-03-28 18:41:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2, identifier: KL68094
2026-03-28 18:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with identifier: KL68094
2026-03-28 18:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with identifier: KL68094
2026-03-28 18:41:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with identifier: KL68094 to the API
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:54Z',
 'fuel_type': 'petrol',
 'id': 'fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL68094',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 255845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-03-06',
 'seller_name': None,
 'title': 'Audi A4 1.8 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL68094%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [auto1.de] INFO: Saving data for KL68094: {'auction_closing_time': 1774884714.0, 'created_time': 1774035153.734983, 'last_price_update_time': 1774723316.225277}
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL68094') HTTP/1.1" 204 0
2026-03-28 18:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK36740/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM31151%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [auto1.de] INFO: Scrape type for BM31151: 0
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM88586%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [auto1.de] INFO: Scrape type for PM88586: 2
2026-03-28 18:41:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9728d942-351f-5e65-9063-75a6b4a3262b with identifier: PM88586
2026-03-28 18:41:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9728d942-351f-5e65-9063-75a6b4a3262b with scrape type 2
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9728d942-351f-5e65-9063-75a6b4a3262b with scrape type 2
2026-03-28 18:41:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9728d942-351f-5e65-9063-75a6b4a3262b, identifier: PM88586
2026-03-28 18:41:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9728d942-351f-5e65-9063-75a6b4a3262b with identifier: PM88586
2026-03-28 18:41:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9728d942-351f-5e65-9063-75a6b4a3262b with identifier: PM88586
2026-03-28 18:41:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9728d942-351f-5e65-9063-75a6b4a3262b with identifier: PM88586 to the API
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:57:00Z',
 'fuel_type': 'diesel',
 'id': '9728d942-351f-5e65-9063-75a6b4a3262b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM88586',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 137101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-23',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2011}
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM88586%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [auto1.de] INFO: Saving data for PM88586: {'auction_closing_time': 1774886220.0, 'created_time': 1774636647.317263, 'last_price_update_time': 1774723316.834565}
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM88586') HTTP/1.1" 204 0
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG98787%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [auto1.de] INFO: Scrape type for GG98787: 0
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE24372%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [auto1.de] INFO: Scrape type for BE24372: 0
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN65231%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [auto1.de] INFO: Scrape type for ZN65231: 0
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX18202%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [auto1.de] INFO: Scrape type for HX18202: 0
2026-03-28 18:41:56 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK36654%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [auto1.de] INFO: Scrape type for FK36654: 0
2026-03-28 18:41:57 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV47567%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [auto1.de] INFO: Scrape type for LV47567: 0
2026-03-28 18:41:57 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB58638%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [auto1.de] INFO: Scrape type for FB58638: 0
2026-03-28 18:41:57 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-28 18:41:57 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-28 18:41:57 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67137%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [auto1.de] INFO: Scrape type for TT67137: 0
2026-03-28 18:41:57 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS32666%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [auto1.de] INFO: Scrape type for FS32666: 0
2026-03-28 18:41:57 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD81555%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [auto1.de] INFO: Scrape type for CD81555: 0
2026-03-28 18:41:57 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT28462%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [auto1.de] INFO: Scrape type for FT28462: 0
2026-03-28 18:41:57 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-28 18:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK27432/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK36740> (referer: https://www.auto1.com/v1/car-details-view/VK36740/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3073702-3572-540f-8ce3-5b97d2a731b9 with identifier: VK36740
2026-03-28 18:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3073702-3572-540f-8ce3-5b97d2a731b9 with scrape type 1
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c3073702-3572-540f-8ce3-5b97d2a731b9
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F50%252F2c50db0f63c5ca35f8ed0f5dbb319016%252Fpa%252FVK36740_018b3b984460a6b07f1d8b839c1b969f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_018b3b984460a6b07f1d8b839c1b969f.jpg already downloaded
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F50%252F2c50db0f63c5ca35f8ed0f5dbb319016%252Fpa%252FVK36740_377ae18f71c54acc3ba6c5f3ac3b1fdf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_377ae18f71c54acc3ba6c5f3ac3b1fdf.jpg already downloaded
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F50%252F2c50db0f63c5ca35f8ed0f5dbb319016%252Fpa%252FVK36740_7f5b5813ba6cc2710f6af62ade6f66d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_7f5b5813ba6cc2710f6af62ade6f66d9.jpg already downloaded
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F50%252F2c50db0f63c5ca35f8ed0f5dbb319016%252Fpa%252FVK36740_66c39fb5f46b0b41ce7dc55842ed7db8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_66c39fb5f46b0b41ce7dc55842ed7db8.jpg already downloaded
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F50%252F2c50db0f63c5ca35f8ed0f5dbb319016%252Fpa%252FVK36740_5a876f953660593a4297a41dd3764242.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_5a876f953660593a4297a41dd3764242.jpg already downloaded
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F50%252F2c50db0f63c5ca35f8ed0f5dbb319016%252Fpa%252FVK36740_6f399ed3ce9afff15c6f574e49374be0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_6f399ed3ce9afff15c6f574e49374be0.jpg already downloaded
2026-03-28 18:41:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3073702-3572-540f-8ce3-5b97d2a731b9, identifier: VK36740
2026-03-28 18:41:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3073702-3572-540f-8ce3-5b97d2a731b9 with identifier: VK36740
2026-03-28 18:41:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3073702-3572-540f-8ce3-5b97d2a731b9 with identifier: VK36740
2026-03-28 18:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3073702-3572-540f-8ce3-5b97d2a731b9 with identifier: VK36740 to the API
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VK36740>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:32:43Z',
 'fuel_type': 'petrol',
 'id': 'c3073702-3572-540f-8ce3-5b97d2a731b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK36740',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 269412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_018b3b984460a6b07f1d8b839c1b969f.jpg',
                'https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_377ae18f71c54acc3ba6c5f3ac3b1fdf.jpg',
                'https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_7f5b5813ba6cc2710f6af62ade6f66d9.jpg',
                'https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_66c39fb5f46b0b41ce7dc55842ed7db8.jpg',
                'https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_5a876f953660593a4297a41dd3764242.jpg',
                'https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_6f399ed3ce9afff15c6f574e49374be0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3073702-3572-540f-8ce3-5b97d2a731b9/c3073702-3572-540f-8ce3-5b97d2a731b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_018b3b984460a6b07f1d8b839c1b969f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3073702-3572-540f-8ce3-5b97d2a731b9/c3073702-3572-540f-8ce3-5b97d2a731b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_377ae18f71c54acc3ba6c5f3ac3b1fdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3073702-3572-540f-8ce3-5b97d2a731b9/c3073702-3572-540f-8ce3-5b97d2a731b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_7f5b5813ba6cc2710f6af62ade6f66d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3073702-3572-540f-8ce3-5b97d2a731b9/c3073702-3572-540f-8ce3-5b97d2a731b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_66c39fb5f46b0b41ce7dc55842ed7db8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3073702-3572-540f-8ce3-5b97d2a731b9/c3073702-3572-540f-8ce3-5b97d2a731b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_5a876f953660593a4297a41dd3764242.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3073702-3572-540f-8ce3-5b97d2a731b9/c3073702-3572-540f-8ce3-5b97d2a731b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/50/2c50db0f63c5ca35f8ed0f5dbb319016/pa/VK36740_6f399ed3ce9afff15c6f574e49374be0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-07-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 3.0i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2001}
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK36740%27 HTTP/1.1" 200 None
2026-03-28 18:41:58 [auto1.de] INFO: Saving data for VK36740: {'created_time': 1774723318.754257, 'last_price_update_time': 1774723318.754271, 'auction_closing_time': 1774884763.0}
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK36740') HTTP/1.1" 204 0
2026-03-28 18:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK27432> (referer: https://www.auto1.com/v1/car-details-view/GK27432/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:58 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 6009 | hits on page: 40
2026-03-28 18:41:58 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-28 18:41:58 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14078%27 HTTP/1.1" 200 None
2026-03-28 18:41:58 [auto1.de] INFO: Scrape type for UC14078: 0
2026-03-28 18:41:58 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW34309%27 HTTP/1.1" 200 None
2026-03-28 18:41:58 [auto1.de] INFO: Scrape type for YW34309: 0
2026-03-28 18:41:58 [auto1.de] INFO: Found listing with ID: UT49919
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT49919%27 HTTP/1.1" 200 None
2026-03-28 18:41:58 [auto1.de] INFO: Scrape type for UT49919: 2
2026-03-28 18:41:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be943f07-6bfb-597b-b7e4-8b3d1dea8147 with identifier: UT49919
2026-03-28 18:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be943f07-6bfb-597b-b7e4-8b3d1dea8147 with scrape type 2
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be943f07-6bfb-597b-b7e4-8b3d1dea8147 with scrape type 2
2026-03-28 18:41:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be943f07-6bfb-597b-b7e4-8b3d1dea8147, identifier: UT49919
2026-03-28 18:41:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be943f07-6bfb-597b-b7e4-8b3d1dea8147 with identifier: UT49919
2026-03-28 18:41:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be943f07-6bfb-597b-b7e4-8b3d1dea8147 with identifier: UT49919
2026-03-28 18:41:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be943f07-6bfb-597b-b7e4-8b3d1dea8147 with identifier: UT49919 to the API
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:31:19Z',
 'fuel_type': 'diesel',
 'id': 'be943f07-6bfb-597b-b7e4-8b3d1dea8147',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT49919',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 197041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-27',
 'seller_name': None,
 'title': 'BMW X4 xDrive 35d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT49919%27 HTTP/1.1" 200 None
2026-03-28 18:41:59 [auto1.de] INFO: Saving data for UT49919: {'auction_closing_time': 1774884679.0, 'created_time': 1773400138.788004, 'last_price_update_time': 1774723319.341428}
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT49919') HTTP/1.1" 204 0
2026-03-28 18:41:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:59 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK53846%27 HTTP/1.1" 200 None
2026-03-28 18:41:59 [auto1.de] INFO: Scrape type for UK53846: 0
2026-03-28 18:41:59 [auto1.de] INFO: Found listing with ID: DE59201
2026-03-28 18:41:59 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM05172%27 HTTP/1.1" 200 None
2026-03-28 18:41:59 [auto1.de] INFO: Scrape type for BM05172: 0
2026-03-28 18:41:59 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-28 18:41:59 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-28 18:41:59 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX24181%27 HTTP/1.1" 200 None
2026-03-28 18:41:59 [auto1.de] INFO: Scrape type for WX24181: 0
2026-03-28 18:41:59 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ86438%27 HTTP/1.1" 200 None
2026-03-28 18:41:59 [auto1.de] INFO: Scrape type for BJ86438: 0
2026-03-28 18:41:59 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-28 18:41:59 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP46589%27 HTTP/1.1" 200 None
2026-03-28 18:41:59 [auto1.de] INFO: Scrape type for NP46589: 2
2026-03-28 18:41:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with identifier: NP46589
2026-03-28 18:41:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with scrape type 2
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with scrape type 2
2026-03-28 18:41:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca1bcc98-8849-55f2-a537-755fbdd9d1e1, identifier: NP46589
2026-03-28 18:41:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with identifier: NP46589
2026-03-28 18:41:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with identifier: NP46589
2026-03-28 18:41:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with identifier: NP46589 to the API
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 326,
 'expiration_date': '2026-03-30T15:29:48Z',
 'fuel_type': 'diesel',
 'id': 'ca1bcc98-8849-55f2-a537-755fbdd9d1e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP46589',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 98865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'BMW X3 M40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP46589%27 HTTP/1.1" 200 None
2026-03-28 18:41:59 [auto1.de] INFO: Saving data for NP46589: {'auction_closing_time': 1774884588.0, 'created_time': 1774521713.523712, 'last_price_update_time': 1774723319.917696}
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP46589') HTTP/1.1" 204 0
2026-03-28 18:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 520c739a-9c5a-5441-b65b-f3a594cf4c5a with identifier: GK27432
2026-03-28 18:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 520c739a-9c5a-5441-b65b-f3a594cf4c5a with scrape type 1
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 520c739a-9c5a-5441-b65b-f3a594cf4c5a
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fcf%252Fdacf61bca1b87d3bdcb1f81f7d03368f%252Fpa%252FGK27432_dd752e85095c07680e130dc7f791b338.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_dd752e85095c07680e130dc7f791b338.jpg already downloaded
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fcf%252Fdacf61bca1b87d3bdcb1f81f7d03368f%252Fpa%252FGK27432_791dffb6847b689811a75a73d5c35d67.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_791dffb6847b689811a75a73d5c35d67.jpg already downloaded
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fcf%252Fdacf61bca1b87d3bdcb1f81f7d03368f%252Fpa%252FGK27432_9f4be4503b813c9f3af31217c8ea5936.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_9f4be4503b813c9f3af31217c8ea5936.jpg already downloaded
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fcf%252Fdacf61bca1b87d3bdcb1f81f7d03368f%252Fpa%252FGK27432_4ced7dfaf9e9321678e5fe222440dc80.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_4ced7dfaf9e9321678e5fe222440dc80.jpg already downloaded
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fcf%252Fdacf61bca1b87d3bdcb1f81f7d03368f%252Fpa%252FGK27432_332e7e67a43fe607ecaa1cec4a742b95.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_332e7e67a43fe607ecaa1cec4a742b95.jpg already downloaded
2026-03-28 18:42:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 520c739a-9c5a-5441-b65b-f3a594cf4c5a, identifier: GK27432
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ50890%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [auto1.de] INFO: Scrape type for PJ50890: 0
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY31624%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [auto1.de] INFO: Scrape type for ZY31624: 0
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV38151%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [auto1.de] INFO: Scrape type for BV38151: 0
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77542%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [auto1.de] INFO: Scrape type for JZ77542: 0
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC48761%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [auto1.de] INFO: Scrape type for RC48761: 0
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX11356%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [auto1.de] INFO: Scrape type for LX11356: 0
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD57431%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [auto1.de] INFO: Scrape type for LD57431: 0
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-28 18:42:00 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN16508%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [auto1.de] INFO: Scrape type for FN16508: 2
2026-03-28 18:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26d876f6-2cca-5451-bdcb-237bb64d12ec with identifier: FN16508
2026-03-28 18:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26d876f6-2cca-5451-bdcb-237bb64d12ec with scrape type 2
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26d876f6-2cca-5451-bdcb-237bb64d12ec with scrape type 2
2026-03-28 18:42:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26d876f6-2cca-5451-bdcb-237bb64d12ec, identifier: FN16508
2026-03-28 18:42:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 520c739a-9c5a-5441-b65b-f3a594cf4c5a with identifier: GK27432
2026-03-28 18:42:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 520c739a-9c5a-5441-b65b-f3a594cf4c5a with identifier: GK27432
2026-03-28 18:42:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 520c739a-9c5a-5441-b65b-f3a594cf4c5a with identifier: GK27432 to the API
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GK27432>
{'auction_title': '',
 'c_o_2_emission_value': 247,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.6L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:26:23Z',
 'fuel_type': 'petrol',
 'id': '520c739a-9c5a-5441-b65b-f3a594cf4c5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK27432',
 'listing': 'auction',
 'location': 'Laatzen',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 278261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_dd752e85095c07680e130dc7f791b338.jpg',
                'https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_791dffb6847b689811a75a73d5c35d67.jpg',
                'https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_9f4be4503b813c9f3af31217c8ea5936.jpg',
                'https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_4ced7dfaf9e9321678e5fe222440dc80.jpg',
                'https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_332e7e67a43fe607ecaa1cec4a742b95.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520c739a-9c5a-5441-b65b-f3a594cf4c5a/520c739a-9c5a-5441-b65b-f3a594cf4c5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_dd752e85095c07680e130dc7f791b338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520c739a-9c5a-5441-b65b-f3a594cf4c5a/520c739a-9c5a-5441-b65b-f3a594cf4c5a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_791dffb6847b689811a75a73d5c35d67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520c739a-9c5a-5441-b65b-f3a594cf4c5a/520c739a-9c5a-5441-b65b-f3a594cf4c5a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_9f4be4503b813c9f3af31217c8ea5936.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520c739a-9c5a-5441-b65b-f3a594cf4c5a/520c739a-9c5a-5441-b65b-f3a594cf4c5a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_4ced7dfaf9e9321678e5fe222440dc80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520c739a-9c5a-5441-b65b-f3a594cf4c5a/520c739a-9c5a-5441-b65b-f3a594cf4c5a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/cf/dacf61bca1b87d3bdcb1f81f7d03368f/pa/GK27432_332e7e67a43fe607ecaa1cec4a742b95.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 240 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2002}
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK27432%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [auto1.de] INFO: Saving data for GK27432: {'created_time': 1774723320.871662, 'last_price_update_time': 1774723320.871674, 'auction_closing_time': 1774884383.0}
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK27432') HTTP/1.1" 204 0
2026-03-28 18:42:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26d876f6-2cca-5451-bdcb-237bb64d12ec with identifier: FN16508
2026-03-28 18:42:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26d876f6-2cca-5451-bdcb-237bb64d12ec with identifier: FN16508
2026-03-28 18:42:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26d876f6-2cca-5451-bdcb-237bb64d12ec with identifier: FN16508 to the API
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:18:04Z',
 'fuel_type': 'petrol',
 'id': '26d876f6-2cca-5451-bdcb-237bb64d12ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN16508',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 55689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-05',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN16508%27 HTTP/1.1" 200 None
2026-03-28 18:42:01 [auto1.de] INFO: Saving data for FN16508: {'auction_closing_time': 1774883884.0, 'created_time': 1774521934.83695, 'last_price_update_time': 1774723321.350274}
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN16508') HTTP/1.1" 204 0
2026-03-28 18:42:01 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX92939%27 HTTP/1.1" 200 None
2026-03-28 18:42:01 [auto1.de] INFO: Scrape type for HX92939: 2
2026-03-28 18:42:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with identifier: HX92939
2026-03-28 18:42:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with scrape type 2
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with scrape type 2
2026-03-28 18:42:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9, identifier: HX92939
2026-03-28 18:42:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with identifier: HX92939
2026-03-28 18:42:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with identifier: HX92939
2026-03-28 18:42:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with identifier: HX92939 to the API
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:42:07Z',
 'fuel_type': 'petrol',
 'id': '6539662d-8c7b-5bda-a193-4d3fef8bb4e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX92939',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 184324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX92939%27 HTTP/1.1" 200 None
2026-03-28 18:42:01 [auto1.de] INFO: Saving data for HX92939: {'auction_closing_time': 1774885327.0, 'created_time': 1774522548.282944, 'last_price_update_time': 1774723321.830925}
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX92939') HTTP/1.1" 204 0
2026-03-28 18:42:01 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-28 18:42:01 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-28 18:42:01 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-28 18:42:01 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-28 18:42:01 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ98399%27 HTTP/1.1" 200 None
2026-03-28 18:42:01 [auto1.de] INFO: Scrape type for MZ98399: 0
2026-03-28 18:42:01 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-28 18:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:02 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:02 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-28 18:42:02 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-28 18:42:02 [auto1.de] INFO: Found listing with ID: AJ27375
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ27375%27 HTTP/1.1" 200 None
2026-03-28 18:42:02 [auto1.de] INFO: Scrape type for AJ27375: 2
2026-03-28 18:42:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f3e01a-8094-5ed4-97da-9dbe1afff589 with identifier: AJ27375
2026-03-28 18:42:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f3e01a-8094-5ed4-97da-9dbe1afff589 with scrape type 2
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17f3e01a-8094-5ed4-97da-9dbe1afff589 with scrape type 2
2026-03-28 18:42:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17f3e01a-8094-5ed4-97da-9dbe1afff589, identifier: AJ27375
2026-03-28 18:42:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17f3e01a-8094-5ed4-97da-9dbe1afff589 with identifier: AJ27375
2026-03-28 18:42:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17f3e01a-8094-5ed4-97da-9dbe1afff589 with identifier: AJ27375
2026-03-28 18:42:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17f3e01a-8094-5ed4-97da-9dbe1afff589 with identifier: AJ27375 to the API
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:50:35Z',
 'fuel_type': 'hybrid',
 'id': '17f3e01a-8094-5ed4-97da-9dbe1afff589',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ27375',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 62133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ27375%27 HTTP/1.1" 200 None
2026-03-28 18:42:03 [auto1.de] INFO: Saving data for AJ27375: {'auction_closing_time': 1774885835.0, 'created_time': 1773428534.846355, 'last_price_update_time': 1774723323.232298}
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ27375') HTTP/1.1" 204 0
2026-03-28 18:42:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:03 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-28 18:42:03 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-28 18:42:03 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE25486%27 HTTP/1.1" 200 None
2026-03-28 18:42:03 [auto1.de] INFO: Scrape type for NE25486: 0
2026-03-28 18:42:03 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA53170%27 HTTP/1.1" 200 None
2026-03-28 18:42:03 [auto1.de] INFO: Scrape type for MA53170: 0
2026-03-28 18:42:03 [auto1.de] INFO: Found listing with ID: MF48816
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF48816%27 HTTP/1.1" 200 None
2026-03-28 18:42:03 [auto1.de] INFO: Scrape type for MF48816: 2
2026-03-28 18:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 180e6fec-da75-5258-9054-0fd8b525d0d5 with identifier: MF48816
2026-03-28 18:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 180e6fec-da75-5258-9054-0fd8b525d0d5 with scrape type 2
2026-03-28 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 180e6fec-da75-5258-9054-0fd8b525d0d5 with scrape type 2
2026-03-28 18:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 180e6fec-da75-5258-9054-0fd8b525d0d5, identifier: MF48816
2026-03-28 18:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 180e6fec-da75-5258-9054-0fd8b525d0d5 with identifier: MF48816
2026-03-28 18:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 180e6fec-da75-5258-9054-0fd8b525d0d5 with identifier: MF48816
2026-03-28 18:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 180e6fec-da75-5258-9054-0fd8b525d0d5 with identifier: MF48816 to the API
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:38:10Z',
 'fuel_type': 'petrol',
 'id': '180e6fec-da75-5258-9054-0fd8b525d0d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF48816',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 171543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-12',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Klassik Kollektion 2WD',
 'transmission': 'manual',
 'trim': 'Klassik Kollektion 2WD',
 'year': 2015}
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF48816%27 HTTP/1.1" 200 None
2026-03-28 18:42:03 [auto1.de] INFO: Saving data for MF48816: {'auction_closing_time': 1774885090.0, 'created_time': 1774350628.444929, 'last_price_update_time': 1774723323.758768}
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF48816') HTTP/1.1" 204 0
2026-03-28 18:42:03 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-28 18:42:03 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW17525%27 HTTP/1.1" 200 None
2026-03-28 18:42:03 [auto1.de] INFO: Scrape type for EW17525: 0
2026-03-28 18:42:03 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB30393%27 HTTP/1.1" 200 None
2026-03-28 18:42:03 [auto1.de] INFO: Scrape type for TB30393: 0
2026-03-28 18:42:03 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-28 18:42:03 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL21750%27 HTTP/1.1" 200 None
2026-03-28 18:42:03 [auto1.de] INFO: Scrape type for JL21750: 0
2026-03-28 18:42:03 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD08059%27 HTTP/1.1" 200 None
2026-03-28 18:42:03 [auto1.de] INFO: Scrape type for CD08059: 0
2026-03-28 18:42:03 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-28 18:42:03 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ36938%27 HTTP/1.1" 200 None
2026-03-28 18:42:03 [auto1.de] INFO: Scrape type for CZ36938: 2
2026-03-28 18:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71200441-6566-5c38-8a15-efb2f15c56dd with identifier: CZ36938
2026-03-28 18:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71200441-6566-5c38-8a15-efb2f15c56dd with scrape type 2
2026-03-28 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71200441-6566-5c38-8a15-efb2f15c56dd with scrape type 2
2026-03-28 18:42:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71200441-6566-5c38-8a15-efb2f15c56dd, identifier: CZ36938
2026-03-28 18:42:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71200441-6566-5c38-8a15-efb2f15c56dd with identifier: CZ36938
2026-03-28 18:42:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71200441-6566-5c38-8a15-efb2f15c56dd with identifier: CZ36938
2026-03-28 18:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71200441-6566-5c38-8a15-efb2f15c56dd with identifier: CZ36938 to the API
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 420,
 'expiration_date': '2026-03-30T15:25:55Z',
 'fuel_type': 'petrol',
 'id': '71200441-6566-5c38-8a15-efb2f15c56dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ36938',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 29880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seller_name': None,
 'title': 'Ford Mustang 5.0 Ti-VCT V8 GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ36938%27 HTTP/1.1" 200 None
2026-03-28 18:42:04 [auto1.de] INFO: Saving data for CZ36938: {'auction_closing_time': 1774884355.0, 'created_time': 1774522562.375157, 'last_price_update_time': 1774723324.426786}
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ36938') HTTP/1.1" 204 0
2026-03-28 18:42:04 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC80296%27 HTTP/1.1" 200 None
2026-03-28 18:42:04 [auto1.de] INFO: Scrape type for VC80296: 0
2026-03-28 18:42:04 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-28 18:42:04 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-28 18:42:04 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY11260%27 HTTP/1.1" 200 None
2026-03-28 18:42:04 [auto1.de] INFO: Scrape type for KY11260: 0
2026-03-28 18:42:04 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU72855%27 HTTP/1.1" 200 None
2026-03-28 18:42:04 [auto1.de] INFO: Scrape type for HU72855: 2
2026-03-28 18:42:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe27f486-eb45-5680-94fb-0d6d8272d5e2 with identifier: HU72855
2026-03-28 18:42:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe27f486-eb45-5680-94fb-0d6d8272d5e2 with scrape type 2
2026-03-28 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe27f486-eb45-5680-94fb-0d6d8272d5e2 with scrape type 2
2026-03-28 18:42:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe27f486-eb45-5680-94fb-0d6d8272d5e2, identifier: HU72855
2026-03-28 18:42:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe27f486-eb45-5680-94fb-0d6d8272d5e2 with identifier: HU72855
2026-03-28 18:42:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe27f486-eb45-5680-94fb-0d6d8272d5e2 with identifier: HU72855
2026-03-28 18:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe27f486-eb45-5680-94fb-0d6d8272d5e2 with identifier: HU72855 to the API
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:24:14Z',
 'fuel_type': 'diesel',
 'id': 'fe27f486-eb45-5680-94fb-0d6d8272d5e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU72855',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 144713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-04',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2012}
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU72855%27 HTTP/1.1" 200 None
2026-03-28 18:42:04 [auto1.de] INFO: Saving data for HU72855: {'auction_closing_time': 1774884254.0, 'created_time': 1774522094.453723, 'last_price_update_time': 1774723324.922126}
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU72855') HTTP/1.1" 204 0
2026-03-28 18:42:05 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK60330%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [auto1.de] INFO: Scrape type for RK60330: 0
2026-03-28 18:42:05 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU90892%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [auto1.de] INFO: Scrape type for PU90892: 2
2026-03-28 18:42:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3b46849-aab4-5f9b-b020-8533bb792ad0 with identifier: PU90892
2026-03-28 18:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3b46849-aab4-5f9b-b020-8533bb792ad0 with scrape type 2
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3b46849-aab4-5f9b-b020-8533bb792ad0 with scrape type 2
2026-03-28 18:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3b46849-aab4-5f9b-b020-8533bb792ad0, identifier: PU90892
2026-03-28 18:42:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3b46849-aab4-5f9b-b020-8533bb792ad0 with identifier: PU90892
2026-03-28 18:42:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3b46849-aab4-5f9b-b020-8533bb792ad0 with identifier: PU90892
2026-03-28 18:42:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3b46849-aab4-5f9b-b020-8533bb792ad0 with identifier: PU90892 to the API
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:29:03Z',
 'fuel_type': 'petrol',
 'id': 'd3b46849-aab4-5f9b-b020-8533bb792ad0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU90892',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 98605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Edition 19 Progressive',
 'transmission': 'automatic',
 'trim': 'Edition 19 Progressive',
 'year': 2019}
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU90892%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [auto1.de] INFO: Saving data for PU90892: {'auction_closing_time': 1774884543.0, 'created_time': 1774522214.393852, 'last_price_update_time': 1774723325.479693}
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU90892') HTTP/1.1" 204 0
2026-03-28 18:42:05 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK67833%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [auto1.de] INFO: Scrape type for NK67833: 0
2026-03-28 18:42:05 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW98263%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [auto1.de] INFO: Scrape type for PW98263: 0
2026-03-28 18:42:05 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-28 18:42:05 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-28 18:42:05 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN12652%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [auto1.de] INFO: Scrape type for WN12652: 0
2026-03-28 18:42:05 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27254%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [auto1.de] INFO: Scrape type for VF27254: 2
2026-03-28 18:42:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b72ded6-c498-511a-91f1-45ebbd0be765 with identifier: VF27254
2026-03-28 18:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b72ded6-c498-511a-91f1-45ebbd0be765 with scrape type 2
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b72ded6-c498-511a-91f1-45ebbd0be765 with scrape type 2
2026-03-28 18:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b72ded6-c498-511a-91f1-45ebbd0be765, identifier: VF27254
2026-03-28 18:42:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b72ded6-c498-511a-91f1-45ebbd0be765 with identifier: VF27254
2026-03-28 18:42:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b72ded6-c498-511a-91f1-45ebbd0be765 with identifier: VF27254
2026-03-28 18:42:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b72ded6-c498-511a-91f1-45ebbd0be765 with identifier: VF27254 to the API
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:53:38Z',
 'fuel_type': 'petrol',
 'id': '9b72ded6-c498-511a-91f1-45ebbd0be765',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF27254',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 172789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-29',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27254%27 HTTP/1.1" 200 None
2026-03-28 18:42:06 [auto1.de] INFO: Saving data for VF27254: {'auction_closing_time': 1774886018.0, 'created_time': 1773831500.767157, 'last_price_update_time': 1774723326.061214}
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF27254') HTTP/1.1" 204 0
2026-03-28 18:42:06 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ82865%27 HTTP/1.1" 200 None
2026-03-28 18:42:06 [auto1.de] INFO: Scrape type for PZ82865: 0
2026-03-28 18:42:06 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-28 18:42:06 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT58589%27 HTTP/1.1" 200 None
2026-03-28 18:42:06 [auto1.de] INFO: Scrape type for LT58589: 0
2026-03-28 18:42:06 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-28 18:42:06 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-28 18:42:06 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-28 18:42:06 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH12576%27 HTTP/1.1" 200 None
2026-03-28 18:42:06 [auto1.de] INFO: Scrape type for NH12576: 2
2026-03-28 18:42:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e88df9d-87de-5d25-92dd-741ecc203953 with identifier: NH12576
2026-03-28 18:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e88df9d-87de-5d25-92dd-741ecc203953 with scrape type 2
2026-03-28 18:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e88df9d-87de-5d25-92dd-741ecc203953 with scrape type 2
2026-03-28 18:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e88df9d-87de-5d25-92dd-741ecc203953, identifier: NH12576
2026-03-28 18:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e88df9d-87de-5d25-92dd-741ecc203953 with identifier: NH12576
2026-03-28 18:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e88df9d-87de-5d25-92dd-741ecc203953 with identifier: NH12576
2026-03-28 18:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e88df9d-87de-5d25-92dd-741ecc203953 with identifier: NH12576 to the API
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:50:53Z',
 'fuel_type': 'petrol',
 'id': '9e88df9d-87de-5d25-92dd-741ecc203953',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH12576',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 142994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-09-17',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2001}
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH12576%27 HTTP/1.1" 200 None
2026-03-28 18:42:06 [auto1.de] INFO: Saving data for NH12576: {'auction_closing_time': 1774885853.0, 'created_time': 1774522110.729333, 'last_price_update_time': 1774723326.537053}
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH12576') HTTP/1.1" 204 0
2026-03-28 18:42:06 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-28 18:42:06 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA54655%27 HTTP/1.1" 200 None
2026-03-28 18:42:06 [auto1.de] INFO: Scrape type for XA54655: 2
2026-03-28 18:42:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a72215d9-4b10-55e2-8d68-63bf15d209e1 with identifier: XA54655
2026-03-28 18:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72215d9-4b10-55e2-8d68-63bf15d209e1 with scrape type 2
2026-03-28 18:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a72215d9-4b10-55e2-8d68-63bf15d209e1 with scrape type 2
2026-03-28 18:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a72215d9-4b10-55e2-8d68-63bf15d209e1, identifier: XA54655
2026-03-28 18:42:06 [scrapy.extensions.logstats] INFO: Crawled 169 pages (at 25 pages/min), scraped 445 items (at 67 items/min)
2026-03-28 18:42:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-28 18:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a72215d9-4b10-55e2-8d68-63bf15d209e1 with identifier: XA54655
2026-03-28 18:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a72215d9-4b10-55e2-8d68-63bf15d209e1 with identifier: XA54655
2026-03-28 18:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a72215d9-4b10-55e2-8d68-63bf15d209e1 with identifier: XA54655 to the API
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:38:17Z',
 'fuel_type': 'petrol',
 'id': 'a72215d9-4b10-55e2-8d68-63bf15d209e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA54655',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 219861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-29',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2005}
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA54655%27 HTTP/1.1" 200 None
2026-03-28 18:42:07 [auto1.de] INFO: Saving data for XA54655: {'auction_closing_time': 1774885097.0, 'created_time': 1774522147.247987, 'last_price_update_time': 1774723327.089307}
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA54655') HTTP/1.1" 204 0
2026-03-28 18:42:07 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ43118%27 HTTP/1.1" 200 None
2026-03-28 18:42:07 [auto1.de] INFO: Scrape type for GZ43118: 2
2026-03-28 18:42:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24c3233e-3156-55db-9d40-7a9af9d5ef1e with identifier: GZ43118
2026-03-28 18:42:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24c3233e-3156-55db-9d40-7a9af9d5ef1e with scrape type 2
2026-03-28 18:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24c3233e-3156-55db-9d40-7a9af9d5ef1e with scrape type 2
2026-03-28 18:42:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24c3233e-3156-55db-9d40-7a9af9d5ef1e, identifier: GZ43118
2026-03-28 18:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24c3233e-3156-55db-9d40-7a9af9d5ef1e with identifier: GZ43118
2026-03-28 18:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24c3233e-3156-55db-9d40-7a9af9d5ef1e with identifier: GZ43118
2026-03-28 18:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24c3233e-3156-55db-9d40-7a9af9d5ef1e with identifier: GZ43118 to the API
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:34Z',
 'fuel_type': 'petrol',
 'id': '24c3233e-3156-55db-9d40-7a9af9d5ef1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ43118',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 82714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-11',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ43118%27 HTTP/1.1" 200 None
2026-03-28 18:42:07 [auto1.de] INFO: Saving data for GZ43118: {'auction_closing_time': 1774885174.0, 'created_time': 1774034889.688054, 'last_price_update_time': 1774723327.534871}
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ43118') HTTP/1.1" 204 0
2026-03-28 18:42:07 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ38540%27 HTTP/1.1" 200 None
2026-03-28 18:42:07 [auto1.de] INFO: Scrape type for DZ38540: 2
2026-03-28 18:42:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5913f35-9307-5a3c-bc15-2576acd9021d with identifier: DZ38540
2026-03-28 18:42:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5913f35-9307-5a3c-bc15-2576acd9021d with scrape type 2
2026-03-28 18:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5913f35-9307-5a3c-bc15-2576acd9021d with scrape type 2
2026-03-28 18:42:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5913f35-9307-5a3c-bc15-2576acd9021d, identifier: DZ38540
2026-03-28 18:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5913f35-9307-5a3c-bc15-2576acd9021d with identifier: DZ38540
2026-03-28 18:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5913f35-9307-5a3c-bc15-2576acd9021d with identifier: DZ38540
2026-03-28 18:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5913f35-9307-5a3c-bc15-2576acd9021d with identifier: DZ38540 to the API
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:57:44Z',
 'fuel_type': 'petrol',
 'id': 'd5913f35-9307-5a3c-bc15-2576acd9021d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ38540',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 185402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-30',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2007}
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ38540%27 HTTP/1.1" 200 None
2026-03-28 18:42:07 [auto1.de] INFO: Saving data for DZ38540: {'auction_closing_time': 1774886264.0, 'created_time': 1774522196.066596, 'last_price_update_time': 1774723327.997686}
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ38540') HTTP/1.1" 204 0
2026-03-28 18:42:08 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV94610%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [auto1.de] INFO: Scrape type for FV94610: 0
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY06483%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [auto1.de] INFO: Scrape type for HY06483: 0
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30704%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [auto1.de] INFO: Scrape type for PY30704: 0
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU32595%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [auto1.de] INFO: Scrape type for BU32595: 2
2026-03-28 18:42:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f with identifier: BU32595
2026-03-28 18:42:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f with scrape type 2
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f with scrape type 2
2026-03-28 18:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f, identifier: BU32595
2026-03-28 18:42:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f with identifier: BU32595
2026-03-28 18:42:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f with identifier: BU32595
2026-03-28 18:42:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f with identifier: BU32595 to the API
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:57:11Z',
 'fuel_type': 'petrol',
 'id': 'a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU32595',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 133760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-11',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU32595%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [auto1.de] INFO: Saving data for BU32595: {'auction_closing_time': 1774886231.0, 'created_time': 1774636623.265165, 'last_price_update_time': 1774723328.479253}
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU32595') HTTP/1.1" 204 0
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: KF40481
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83216%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [auto1.de] INFO: Scrape type for GY83216: 0
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: XP52765
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY63966%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [auto1.de] INFO: Scrape type for XY63966: 0
2026-03-28 18:42:08 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR01056%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [auto1.de] INFO: Scrape type for XR01056: 2
2026-03-28 18:42:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 312dc970-afab-5ffc-8dac-9a17220f9c41 with identifier: XR01056
2026-03-28 18:42:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 312dc970-afab-5ffc-8dac-9a17220f9c41 with scrape type 2
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 312dc970-afab-5ffc-8dac-9a17220f9c41 with scrape type 2
2026-03-28 18:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 312dc970-afab-5ffc-8dac-9a17220f9c41, identifier: XR01056
2026-03-28 18:42:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 312dc970-afab-5ffc-8dac-9a17220f9c41 with identifier: XR01056
2026-03-28 18:42:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 312dc970-afab-5ffc-8dac-9a17220f9c41 with identifier: XR01056
2026-03-28 18:42:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 312dc970-afab-5ffc-8dac-9a17220f9c41 with identifier: XR01056 to the API
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:58:01Z',
 'fuel_type': 'petrol',
 'id': '312dc970-afab-5ffc-8dac-9a17220f9c41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR01056',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 194038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-29',
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR01056%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Saving data for XR01056: {'auction_closing_time': 1774886281.0, 'created_time': 1774350495.874881, 'last_price_update_time': 1774723329.085322}
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR01056') HTTP/1.1" 204 0
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH14315%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Scrape type for GH14315: 0
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67116%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Scrape type for ZY67116: 0
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ16162%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Scrape type for MJ16162: 0
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX66491%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Scrape type for MX66491: 0
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50003%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Scrape type for WY50003: 0
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33465%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Scrape type for MM33465: 0
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE17013%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Scrape type for ZE17013: 0
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK50656%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Scrape type for JK50656: 0
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN69903%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Scrape type for VN69903: 0
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ00075%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Scrape type for YJ00075: 2
2026-03-28 18:42:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e325b690-6cc0-5e4e-9ae0-9982fafc57ca with identifier: YJ00075
2026-03-28 18:42:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e325b690-6cc0-5e4e-9ae0-9982fafc57ca with scrape type 2
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e325b690-6cc0-5e4e-9ae0-9982fafc57ca with scrape type 2
2026-03-28 18:42:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e325b690-6cc0-5e4e-9ae0-9982fafc57ca, identifier: YJ00075
2026-03-28 18:42:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e325b690-6cc0-5e4e-9ae0-9982fafc57ca with identifier: YJ00075
2026-03-28 18:42:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e325b690-6cc0-5e4e-9ae0-9982fafc57ca with identifier: YJ00075
2026-03-28 18:42:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e325b690-6cc0-5e4e-9ae0-9982fafc57ca with identifier: YJ00075 to the API
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:16:29Z',
 'fuel_type': 'petrol',
 'id': 'e325b690-6cc0-5e4e-9ae0-9982fafc57ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ00075',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 62979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-09',
 'seller_name': None,
 'title': 'Smart fortwo 0.7 Turbo Basis pure',
 'transmission': 'automatic',
 'trim': 'Basis pure',
 'year': 2007}
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ00075%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Saving data for YJ00075: {'auction_closing_time': 1774883789.0, 'created_time': 1774350527.47794, 'last_price_update_time': 1774723329.700114}
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ00075') HTTP/1.1" 204 0
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS25100%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Scrape type for XS25100: 0
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-28 18:42:09 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59934%27 HTTP/1.1" 200 None
2026-03-28 18:42:09 [auto1.de] INFO: Scrape type for ZB59934: 2
2026-03-28 18:42:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 941389e8-05d9-550e-b351-8fed75360bb8 with identifier: ZB59934
2026-03-28 18:42:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 941389e8-05d9-550e-b351-8fed75360bb8 with scrape type 2
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 941389e8-05d9-550e-b351-8fed75360bb8 with scrape type 2
2026-03-28 18:42:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 941389e8-05d9-550e-b351-8fed75360bb8, identifier: ZB59934
2026-03-28 18:42:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 941389e8-05d9-550e-b351-8fed75360bb8 with identifier: ZB59934
2026-03-28 18:42:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 941389e8-05d9-550e-b351-8fed75360bb8 with identifier: ZB59934
2026-03-28 18:42:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 941389e8-05d9-550e-b351-8fed75360bb8 with identifier: ZB59934 to the API
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:09:05Z',
 'fuel_type': 'petrol',
 'id': '941389e8-05d9-550e-b351-8fed75360bb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB59934',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 73492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-26',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Competizione',
 'transmission': 'manual',
 'trim': 'Competizione',
 'year': 2019}
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59934%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [auto1.de] INFO: Saving data for ZB59934: {'auction_closing_time': 1774883345.0, 'created_time': 1774521943.580163, 'last_price_update_time': 1774723330.250635}
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB59934') HTTP/1.1" 204 0
2026-03-28 18:42:10 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-28 18:42:10 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN23623%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [auto1.de] INFO: Scrape type for LN23623: 0
2026-03-28 18:42:10 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-28 18:42:10 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-28 18:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:11 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM27166%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [auto1.de] INFO: Scrape type for CM27166: 0
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01361%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [auto1.de] INFO: Scrape type for DX01361: 0
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE31655%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [auto1.de] INFO: Scrape type for NE31655: 2
2026-03-28 18:42:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b9c770a-d0dd-558e-8d16-30e7b056e931 with identifier: NE31655
2026-03-28 18:42:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b9c770a-d0dd-558e-8d16-30e7b056e931 with scrape type 2
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b9c770a-d0dd-558e-8d16-30e7b056e931 with scrape type 2
2026-03-28 18:42:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b9c770a-d0dd-558e-8d16-30e7b056e931, identifier: NE31655
2026-03-28 18:42:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b9c770a-d0dd-558e-8d16-30e7b056e931 with identifier: NE31655
2026-03-28 18:42:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b9c770a-d0dd-558e-8d16-30e7b056e931 with identifier: NE31655
2026-03-28 18:42:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b9c770a-d0dd-558e-8d16-30e7b056e931 with identifier: NE31655 to the API
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:32Z',
 'fuel_type': 'diesel',
 'id': '7b9c770a-d0dd-558e-8d16-30e7b056e931',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE31655',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 258524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-13',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE31655%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [auto1.de] INFO: Saving data for NE31655: {'auction_closing_time': 1774885412.0, 'created_time': 1774522221.054731, 'last_price_update_time': 1774723331.706547}
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE31655') HTTP/1.1" 204 0
2026-03-28 18:42:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW02544%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [auto1.de] INFO: Scrape type for EW02544: 0
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW02543%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [auto1.de] INFO: Scrape type for NW02543: 0
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68869%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [auto1.de] INFO: Scrape type for JV68869: 0
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ97474%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [auto1.de] INFO: Scrape type for XJ97474: 0
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-28 18:42:11 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX10948%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [auto1.de] INFO: Scrape type for RX10948: 2
2026-03-28 18:42:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85aeeaa2-b35a-5fe6-a069-f188cbc77850 with identifier: RX10948
2026-03-28 18:42:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85aeeaa2-b35a-5fe6-a069-f188cbc77850 with scrape type 2
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85aeeaa2-b35a-5fe6-a069-f188cbc77850 with scrape type 2
2026-03-28 18:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85aeeaa2-b35a-5fe6-a069-f188cbc77850, identifier: RX10948
2026-03-28 18:42:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85aeeaa2-b35a-5fe6-a069-f188cbc77850 with identifier: RX10948
2026-03-28 18:42:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85aeeaa2-b35a-5fe6-a069-f188cbc77850 with identifier: RX10948
2026-03-28 18:42:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85aeeaa2-b35a-5fe6-a069-f188cbc77850 with identifier: RX10948 to the API
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:08:55Z',
 'fuel_type': 'diesel',
 'id': '85aeeaa2-b35a-5fe6-a069-f188cbc77850',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX10948',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 147422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-07',
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.5 dCi Celebration',
 'transmission': 'manual',
 'trim': 'Celebration',
 'year': 2015}
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX10948%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [auto1.de] INFO: Saving data for RX10948: {'auction_closing_time': 1774883335.0, 'created_time': 1774636605.980729, 'last_price_update_time': 1774723332.329015}
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX10948') HTTP/1.1" 204 0
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN65057%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [auto1.de] INFO: Scrape type for XN65057: 0
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98433%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [auto1.de] INFO: Scrape type for ZL98433: 0
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC35903%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [auto1.de] INFO: Scrape type for PC35903: 0
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV35353%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [auto1.de] INFO: Scrape type for YV35353: 0
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS93446%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [auto1.de] INFO: Scrape type for XS93446: 0
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR25014%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [auto1.de] INFO: Scrape type for VR25014: 0
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY06770%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [auto1.de] INFO: Scrape type for KY06770: 0
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH20850%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [auto1.de] INFO: Scrape type for GH20850: 0
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ83009%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [auto1.de] INFO: Scrape type for AJ83009: 0
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17394%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [auto1.de] INFO: Scrape type for JR17394: 0
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ38471%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [auto1.de] INFO: Scrape type for JZ38471: 0
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: EX67189
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-28 18:42:12 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-28 18:42:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:13 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:13 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-28 18:42:13 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-28 18:42:13 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND29954%27 HTTP/1.1" 200 None
2026-03-28 18:42:13 [auto1.de] INFO: Scrape type for ND29954: 0
2026-03-28 18:42:13 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS14457%27 HTTP/1.1" 200 None
2026-03-28 18:42:13 [auto1.de] INFO: Scrape type for XS14457: 0
2026-03-28 18:42:13 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-28 18:42:13 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG28999%27 HTTP/1.1" 200 None
2026-03-28 18:42:13 [auto1.de] INFO: Scrape type for ZG28999: 0
2026-03-28 18:42:13 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX36135%27 HTTP/1.1" 200 None
2026-03-28 18:42:13 [auto1.de] INFO: Scrape type for BX36135: 0
2026-03-28 18:42:13 [auto1.de] INFO: Found listing with ID: US86443
2026-03-28 18:42:13 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-28 18:42:13 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46177%27 HTTP/1.1" 200 None
2026-03-28 18:42:13 [auto1.de] INFO: Scrape type for WA46177: 0
2026-03-28 18:42:13 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW15546%27 HTTP/1.1" 200 None
2026-03-28 18:42:13 [auto1.de] INFO: Scrape type for GW15546: 2
2026-03-28 18:42:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0823fb9e-2485-54fe-9110-63f89db137d2 with identifier: GW15546
2026-03-28 18:42:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0823fb9e-2485-54fe-9110-63f89db137d2 with scrape type 2
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0823fb9e-2485-54fe-9110-63f89db137d2 with scrape type 2
2026-03-28 18:42:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0823fb9e-2485-54fe-9110-63f89db137d2, identifier: GW15546
2026-03-28 18:42:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0823fb9e-2485-54fe-9110-63f89db137d2 with identifier: GW15546
2026-03-28 18:42:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0823fb9e-2485-54fe-9110-63f89db137d2 with identifier: GW15546
2026-03-28 18:42:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0823fb9e-2485-54fe-9110-63f89db137d2 with identifier: GW15546 to the API
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:40:54Z',
 'fuel_type': 'diesel',
 'id': '0823fb9e-2485-54fe-9110-63f89db137d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW15546',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 142925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-13',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Tourneo Titanium X',
 'transmission': 'automatic',
 'trim': '320 L2 Tourneo Titanium X',
 'year': 2021}
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW15546%27 HTTP/1.1" 200 None
2026-03-28 18:42:14 [auto1.de] INFO: Saving data for GW15546: {'auction_closing_time': 1774885254.0, 'created_time': 1774522506.929775, 'last_price_update_time': 1774723334.340086}
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW15546') HTTP/1.1" 204 0
2026-03-28 18:42:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP55195%27 HTTP/1.1" 200 None
2026-03-28 18:42:14 [auto1.de] INFO: Scrape type for DP55195: 2
2026-03-28 18:42:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03c75654-15b0-5492-911c-3408f638ccf3 with identifier: DP55195
2026-03-28 18:42:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03c75654-15b0-5492-911c-3408f638ccf3 with scrape type 2
2026-03-28 18:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03c75654-15b0-5492-911c-3408f638ccf3 with scrape type 2
2026-03-28 18:42:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03c75654-15b0-5492-911c-3408f638ccf3, identifier: DP55195
2026-03-28 18:42:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03c75654-15b0-5492-911c-3408f638ccf3 with identifier: DP55195
2026-03-28 18:42:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03c75654-15b0-5492-911c-3408f638ccf3 with identifier: DP55195
2026-03-28 18:42:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03c75654-15b0-5492-911c-3408f638ccf3 with identifier: DP55195 to the API
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:52:03Z',
 'fuel_type': 'diesel',
 'id': '03c75654-15b0-5492-911c-3408f638ccf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP55195',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 109329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2020}
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP55195%27 HTTP/1.1" 200 None
2026-03-28 18:42:14 [auto1.de] INFO: Saving data for DP55195: {'auction_closing_time': 1774885923.0, 'created_time': 1773427167.223173, 'last_price_update_time': 1774723334.866951}
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP55195') HTTP/1.1" 204 0
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF63690%27 HTTP/1.1" 200 None
2026-03-28 18:42:14 [auto1.de] INFO: Scrape type for MF63690: 0
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS08913%27 HTTP/1.1" 200 None
2026-03-28 18:42:14 [auto1.de] INFO: Scrape type for DS08913: 0
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS42918%27 HTTP/1.1" 200 None
2026-03-28 18:42:14 [auto1.de] INFO: Scrape type for VS42918: 0
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM97642%27 HTTP/1.1" 200 None
2026-03-28 18:42:14 [auto1.de] INFO: Scrape type for FM97642: 0
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP95286%27 HTTP/1.1" 200 None
2026-03-28 18:42:14 [auto1.de] INFO: Scrape type for ZP95286: 0
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-28 18:42:14 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC37462%27 HTTP/1.1" 200 None
2026-03-28 18:42:14 [auto1.de] INFO: Scrape type for KC37462: 2
2026-03-28 18:42:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deabc4f7-8a95-558c-b315-2ba4f1ec8270 with identifier: KC37462
2026-03-28 18:42:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deabc4f7-8a95-558c-b315-2ba4f1ec8270 with scrape type 2
2026-03-28 18:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deabc4f7-8a95-558c-b315-2ba4f1ec8270 with scrape type 2
2026-03-28 18:42:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: deabc4f7-8a95-558c-b315-2ba4f1ec8270, identifier: KC37462
2026-03-28 18:42:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: deabc4f7-8a95-558c-b315-2ba4f1ec8270 with identifier: KC37462
2026-03-28 18:42:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: deabc4f7-8a95-558c-b315-2ba4f1ec8270 with identifier: KC37462
2026-03-28 18:42:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: deabc4f7-8a95-558c-b315-2ba4f1ec8270 with identifier: KC37462 to the API
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:18:34Z',
 'fuel_type': 'petrol',
 'id': 'deabc4f7-8a95-558c-b315-2ba4f1ec8270',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC37462',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 39345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-22',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 120 Jahre',
 'transmission': 'manual',
 'trim': '120 Jahre',
 'year': 2019}
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC37462%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [auto1.de] INFO: Saving data for KC37462: {'auction_closing_time': 1774883914.0, 'created_time': 1774636615.2192, 'last_price_update_time': 1774723335.421931}
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC37462') HTTP/1.1" 204 0
2026-03-28 18:42:15 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41479%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [auto1.de] INFO: Scrape type for MF41479: 0
2026-03-28 18:42:15 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD31530%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [auto1.de] INFO: Scrape type for XD31530: 0
2026-03-28 18:42:15 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-28 18:42:15 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-28 18:42:15 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-28 18:42:15 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-28 18:42:15 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ90236%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [auto1.de] INFO: Scrape type for VJ90236: 0
2026-03-28 18:42:15 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-28 18:42:15 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP43066%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [auto1.de] INFO: Scrape type for PP43066: 0
2026-03-28 18:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:16 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:16 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-28 18:42:16 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-28 18:42:16 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS86460%27 HTTP/1.1" 200 None
2026-03-28 18:42:16 [auto1.de] INFO: Scrape type for MS86460: 0
2026-03-28 18:42:16 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ31172%27 HTTP/1.1" 200 None
2026-03-28 18:42:16 [auto1.de] INFO: Scrape type for GZ31172: 0
2026-03-28 18:42:16 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU48092%27 HTTP/1.1" 200 None
2026-03-28 18:42:16 [auto1.de] INFO: Scrape type for GU48092: 0
2026-03-28 18:42:16 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT93934%27 HTTP/1.1" 200 None
2026-03-28 18:42:16 [auto1.de] INFO: Scrape type for UT93934: 0
2026-03-28 18:42:16 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-28 18:42:16 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-28 18:42:16 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD53590%27 HTTP/1.1" 200 None
2026-03-28 18:42:16 [auto1.de] INFO: Scrape type for KD53590: 2
2026-03-28 18:42:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 272942b6-2f4b-5344-aae6-80943da4d3bf with identifier: KD53590
2026-03-28 18:42:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 272942b6-2f4b-5344-aae6-80943da4d3bf with scrape type 2
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 272942b6-2f4b-5344-aae6-80943da4d3bf with scrape type 2
2026-03-28 18:42:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 272942b6-2f4b-5344-aae6-80943da4d3bf, identifier: KD53590
2026-03-28 18:42:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 272942b6-2f4b-5344-aae6-80943da4d3bf with identifier: KD53590
2026-03-28 18:42:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 272942b6-2f4b-5344-aae6-80943da4d3bf with identifier: KD53590
2026-03-28 18:42:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 272942b6-2f4b-5344-aae6-80943da4d3bf with identifier: KD53590 to the API
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-30T15:19:51Z',
 'fuel_type': 'petrol',
 'id': '272942b6-2f4b-5344-aae6-80943da4d3bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD53590',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 105495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-03-12',
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Fresh',
 'transmission': 'manual',
 'trim': 'Fresh',
 'year': 2002}
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD53590%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Saving data for KD53590: {'auction_closing_time': 1774883991.0, 'created_time': 1774033903.950529, 'last_price_update_time': 1774723337.094642}
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD53590') HTTP/1.1" 204 0
2026-03-28 18:42:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: XD68871
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN70453%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for GN70453: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP84657%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for WP84657: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09551%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for WE09551: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ82929%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for UZ82929: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL81874%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for LL81874: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97195%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for AU97195: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH64157%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for VH64157: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH71903%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for VH71903: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98670%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for EU98670: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG36185%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for LG36185: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH41953%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for ZH41953: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS82653%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for GS82653: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN87643%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for EN87643: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM56533%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for HM56533: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY27021%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for DY27021: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL85069%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for LL85069: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG81564%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for EG81564: 0
2026-03-28 18:42:17 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV94916%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Scrape type for RV94916: 0
2026-03-28 18:42:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:18 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ63393%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for JZ63393: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS60844%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for BS60844: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX23158%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for XX23158: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW98108%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for GW98108: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ99289%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for XJ99289: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP61348%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for VP61348: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY66130%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for CY66130: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ21452%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for NZ21452: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH87635%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for KH87635: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM53714%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for VM53714: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: FN51585
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN51585%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for FN51585: 1
2026-03-28 18:42:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE67956%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for AE67956: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB15916%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for PB15916: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA58180%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for DA58180: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA39997%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for NA39997: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR34905%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for SR34905: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56565%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for MK56565: 0
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-28 18:42:18 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR30933%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Scrape type for XR30933: 2
2026-03-28 18:42:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with identifier: XR30933
2026-03-28 18:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with scrape type 2
2026-03-28 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with scrape type 2
2026-03-28 18:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e, identifier: XR30933
2026-03-28 18:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with identifier: XR30933
2026-03-28 18:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with identifier: XR30933
2026-03-28 18:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with identifier: XR30933 to the API
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:13Z',
 'fuel_type': 'petrol',
 'id': '62d4e062-82c8-5091-a3ab-fcbf0a3ee14e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR30933',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 103570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-07',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT ACT',
 'transmission': 'manual',
 'trim': 'ACT',
 'year': 2018}
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR30933%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [auto1.de] INFO: Saving data for XR30933: {'auction_closing_time': 1774885393.0, 'created_time': 1774521546.322635, 'last_price_update_time': 1774723339.258771}
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR30933') HTTP/1.1" 204 0
2026-03-28 18:42:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF73856%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [auto1.de] INFO: Scrape type for ZF73856: 0
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ79041%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [auto1.de] INFO: Scrape type for BZ79041: 0
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72354%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [auto1.de] INFO: Scrape type for ME72354: 2
2026-03-28 18:42:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25e41024-7e1d-5e66-ba7a-72a80db254ec with identifier: ME72354
2026-03-28 18:42:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25e41024-7e1d-5e66-ba7a-72a80db254ec with scrape type 2
2026-03-28 18:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25e41024-7e1d-5e66-ba7a-72a80db254ec with scrape type 2
2026-03-28 18:42:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25e41024-7e1d-5e66-ba7a-72a80db254ec, identifier: ME72354
2026-03-28 18:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25e41024-7e1d-5e66-ba7a-72a80db254ec with identifier: ME72354
2026-03-28 18:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25e41024-7e1d-5e66-ba7a-72a80db254ec with identifier: ME72354
2026-03-28 18:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25e41024-7e1d-5e66-ba7a-72a80db254ec with identifier: ME72354 to the API
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:42Z',
 'fuel_type': 'petrol',
 'id': '25e41024-7e1d-5e66-ba7a-72a80db254ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME72354',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 167119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2019}
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72354%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [auto1.de] INFO: Saving data for ME72354: {'auction_closing_time': 1774885062.0, 'created_time': 1774522028.888157, 'last_price_update_time': 1774723339.849899}
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME72354') HTTP/1.1" 204 0
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW13301%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [auto1.de] INFO: Scrape type for SW13301: 2
2026-03-28 18:42:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d880e6f2-28da-5561-8baf-8ededeb56ad6 with identifier: SW13301
2026-03-28 18:42:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d880e6f2-28da-5561-8baf-8ededeb56ad6 with scrape type 2
2026-03-28 18:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d880e6f2-28da-5561-8baf-8ededeb56ad6 with scrape type 2
2026-03-28 18:42:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d880e6f2-28da-5561-8baf-8ededeb56ad6, identifier: SW13301
2026-03-28 18:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d880e6f2-28da-5561-8baf-8ededeb56ad6 with identifier: SW13301
2026-03-28 18:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d880e6f2-28da-5561-8baf-8ededeb56ad6 with identifier: SW13301
2026-03-28 18:42:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d880e6f2-28da-5561-8baf-8ededeb56ad6 with identifier: SW13301 to the API
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:51:35Z',
 'fuel_type': 'diesel',
 'id': 'd880e6f2-28da-5561-8baf-8ededeb56ad6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW13301',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 109395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-11',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2017}
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW13301%27 HTTP/1.1" 200 None
2026-03-28 18:42:20 [auto1.de] INFO: Saving data for SW13301: {'auction_closing_time': 1774885895.0, 'created_time': 1773427596.809157, 'last_price_update_time': 1774723340.306865}
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW13301') HTTP/1.1" 204 0
2026-03-28 18:42:20 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV52621%27 HTTP/1.1" 200 None
2026-03-28 18:42:20 [auto1.de] INFO: Scrape type for KV52621: 0
2026-03-28 18:42:20 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN01227%27 HTTP/1.1" 200 None
2026-03-28 18:42:20 [auto1.de] INFO: Scrape type for FN01227: 0
2026-03-28 18:42:20 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51805%27 HTTP/1.1" 200 None
2026-03-28 18:42:20 [auto1.de] INFO: Scrape type for ER51805: 0
2026-03-28 18:42:20 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC49554%27 HTTP/1.1" 200 None
2026-03-28 18:42:20 [auto1.de] INFO: Scrape type for RC49554: 0
2026-03-28 18:42:20 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-28 18:42:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:21 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA95780%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for RA95780: 0
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX26482%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for BX26482: 2
2026-03-28 18:42:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aabf142f-a197-52d1-b793-4cde5c00fb96 with identifier: BX26482
2026-03-28 18:42:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aabf142f-a197-52d1-b793-4cde5c00fb96 with scrape type 2
2026-03-28 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aabf142f-a197-52d1-b793-4cde5c00fb96 with scrape type 2
2026-03-28 18:42:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aabf142f-a197-52d1-b793-4cde5c00fb96, identifier: BX26482
2026-03-28 18:42:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aabf142f-a197-52d1-b793-4cde5c00fb96 with identifier: BX26482
2026-03-28 18:42:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aabf142f-a197-52d1-b793-4cde5c00fb96 with identifier: BX26482
2026-03-28 18:42:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aabf142f-a197-52d1-b793-4cde5c00fb96 with identifier: BX26482 to the API
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:27:34Z',
 'fuel_type': 'diesel',
 'id': 'aabf142f-a197-52d1-b793-4cde5c00fb96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX26482',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 142514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2014}
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX26482%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Saving data for BX26482: {'auction_closing_time': 1774884454.0, 'created_time': 1773946491.170855, 'last_price_update_time': 1774723341.710365}
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX26482') HTTP/1.1" 204 0
2026-03-28 18:42:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS31762%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for SS31762: 0
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK04993%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for MK04993: 0
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01853%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for VR01853: 0
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ09626%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for FJ09626: 0
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW50467%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for CW50467: 0
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL59525%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for UL59525: 0
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58036%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for LJ58036: 0
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH08686%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for GH08686: 0
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06694%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for HH06694: 0
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV68047%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for EV68047: 2
2026-03-28 18:42:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8641ebe-4be8-5c63-8c05-0f233487fd62 with identifier: EV68047
2026-03-28 18:42:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8641ebe-4be8-5c63-8c05-0f233487fd62 with scrape type 2
2026-03-28 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8641ebe-4be8-5c63-8c05-0f233487fd62 with scrape type 2
2026-03-28 18:42:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8641ebe-4be8-5c63-8c05-0f233487fd62, identifier: EV68047
2026-03-28 18:42:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8641ebe-4be8-5c63-8c05-0f233487fd62 with identifier: EV68047
2026-03-28 18:42:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8641ebe-4be8-5c63-8c05-0f233487fd62 with identifier: EV68047
2026-03-28 18:42:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8641ebe-4be8-5c63-8c05-0f233487fd62 with identifier: EV68047 to the API
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:17:30Z',
 'fuel_type': 'diesel',
 'id': 'c8641ebe-4be8-5c63-8c05-0f233487fd62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV68047',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 33796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-05',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV68047%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [auto1.de] INFO: Saving data for EV68047: {'auction_closing_time': 1774883850.0, 'created_time': 1774350703.359221, 'last_price_update_time': 1774723342.421397}
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV68047') HTTP/1.1" 204 0
2026-03-28 18:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN51585/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:22 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR02584%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [auto1.de] INFO: Scrape type for GR02584: 2
2026-03-28 18:42:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02cd12f7-1491-55b8-af73-6955e585f4d8 with identifier: GR02584
2026-03-28 18:42:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02cd12f7-1491-55b8-af73-6955e585f4d8 with scrape type 2
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02cd12f7-1491-55b8-af73-6955e585f4d8 with scrape type 2
2026-03-28 18:42:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02cd12f7-1491-55b8-af73-6955e585f4d8, identifier: GR02584
2026-03-28 18:42:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02cd12f7-1491-55b8-af73-6955e585f4d8 with identifier: GR02584
2026-03-28 18:42:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02cd12f7-1491-55b8-af73-6955e585f4d8 with identifier: GR02584
2026-03-28 18:42:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02cd12f7-1491-55b8-af73-6955e585f4d8 with identifier: GR02584 to the API
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:20:10Z',
 'fuel_type': 'diesel',
 'id': '02cd12f7-1491-55b8-af73-6955e585f4d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR02584',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 169504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-29',
 'seller_name': None,
 'title': 'Chevrolet Cruze 2.0 Diesel LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2013}
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR02584%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [auto1.de] INFO: Saving data for GR02584: {'auction_closing_time': 1774884010.0, 'created_time': 1773306173.158542, 'last_price_update_time': 1774723342.94133}
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR02584') HTTP/1.1" 204 0
2026-03-28 18:42:22 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT67219%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [auto1.de] INFO: Scrape type for MT67219: 0
2026-03-28 18:42:22 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-28 18:42:22 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-28 18:42:22 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93561%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [auto1.de] INFO: Scrape type for NL93561: 2
2026-03-28 18:42:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with identifier: NL93561
2026-03-28 18:42:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with scrape type 2
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with scrape type 2
2026-03-28 18:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed, identifier: NL93561
2026-03-28 18:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with identifier: NL93561
2026-03-28 18:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with identifier: NL93561
2026-03-28 18:42:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with identifier: NL93561 to the API
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:50:13Z',
 'fuel_type': 'diesel',
 'id': '4daa08b9-1ffe-5e58-bbb6-763aeb4137ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL93561',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 142410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-14',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93561%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [auto1.de] INFO: Saving data for NL93561: {'auction_closing_time': 1774885813.0, 'created_time': 1774521904.825234, 'last_price_update_time': 1774723343.422283}
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL93561') HTTP/1.1" 204 0
2026-03-28 18:42:23 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED94101%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [auto1.de] INFO: Scrape type for ED94101: 0
2026-03-28 18:42:23 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV90195%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [auto1.de] INFO: Scrape type for VV90195: 0
2026-03-28 18:42:23 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR95379%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [auto1.de] INFO: Scrape type for FR95379: 0
2026-03-28 18:42:23 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-28 18:42:23 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-28 18:42:23 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK09580%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [auto1.de] INFO: Scrape type for HK09580: 2
2026-03-28 18:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69015933-67e2-53fd-91e7-12c58f237cc1 with identifier: HK09580
2026-03-28 18:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69015933-67e2-53fd-91e7-12c58f237cc1 with scrape type 2
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69015933-67e2-53fd-91e7-12c58f237cc1 with scrape type 2
2026-03-28 18:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69015933-67e2-53fd-91e7-12c58f237cc1, identifier: HK09580
2026-03-28 18:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69015933-67e2-53fd-91e7-12c58f237cc1 with identifier: HK09580
2026-03-28 18:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69015933-67e2-53fd-91e7-12c58f237cc1 with identifier: HK09580
2026-03-28 18:42:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69015933-67e2-53fd-91e7-12c58f237cc1 with identifier: HK09580 to the API
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:36:14Z',
 'fuel_type': 'diesel',
 'id': '69015933-67e2-53fd-91e7-12c58f237cc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK09580',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 107901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-24',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK09580%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [auto1.de] INFO: Saving data for HK09580: {'auction_closing_time': 1774884974.0, 'created_time': 1774350842.702096, 'last_price_update_time': 1774723343.970459}
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK09580') HTTP/1.1" 204 0
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08680%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Scrape type for SG08680: 0
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG24809%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Scrape type for HG24809: 0
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72135%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Scrape type for KP72135: 0
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP92221%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Scrape type for XP92221: 0
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05978%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Scrape type for AB05978: 0
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL82276%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Scrape type for LL82276: 0
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH21613%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Scrape type for BH21613: 2
2026-03-28 18:42:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with identifier: BH21613
2026-03-28 18:42:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with scrape type 2
2026-03-28 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with scrape type 2
2026-03-28 18:42:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909, identifier: BH21613
2026-03-28 18:42:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with identifier: BH21613
2026-03-28 18:42:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with identifier: BH21613
2026-03-28 18:42:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with identifier: BH21613 to the API
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:24:15Z',
 'fuel_type': 'petrol',
 'id': '39d2b4b5-6ff9-5f5e-945e-cb10f714a909',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH21613',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 150812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-04',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH21613%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Saving data for BH21613: {'auction_closing_time': 1774884255.0, 'created_time': 1773429673.28189, 'last_price_update_time': 1774723344.646733}
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH21613') HTTP/1.1" 204 0
2026-03-28 18:42:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN37925%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Scrape type for GN37925: 0
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89473%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Scrape type for ZL89473: 0
2026-03-28 18:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:24 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX19940%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Scrape type for BX19940: 2
2026-03-28 18:42:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6120ca4d-e562-5530-917a-baaf953ba8b2 with identifier: BX19940
2026-03-28 18:42:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6120ca4d-e562-5530-917a-baaf953ba8b2 with scrape type 2
2026-03-28 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6120ca4d-e562-5530-917a-baaf953ba8b2 with scrape type 2
2026-03-28 18:42:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6120ca4d-e562-5530-917a-baaf953ba8b2, identifier: BX19940
2026-03-28 18:42:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6120ca4d-e562-5530-917a-baaf953ba8b2 with identifier: BX19940
2026-03-28 18:42:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6120ca4d-e562-5530-917a-baaf953ba8b2 with identifier: BX19940
2026-03-28 18:42:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6120ca4d-e562-5530-917a-baaf953ba8b2 with identifier: BX19940 to the API
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:08:10Z',
 'fuel_type': 'petrol',
 'id': '6120ca4d-e562-5530-917a-baaf953ba8b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX19940',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 117789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-12',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Avantage',
 'transmission': 'automatic',
 'trim': 'Avantage',
 'year': 2006}
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX19940%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Saving data for BX19940: {'auction_closing_time': 1774883290.0, 'created_time': 1774522260.547889, 'last_price_update_time': 1774723345.280509}
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX19940') HTTP/1.1" 204 0
2026-03-28 18:42:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27927%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for BX27927: 0
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB81454%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for SB81454: 0
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS31989%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for WS31989: 2
2026-03-28 18:42:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf50a9fe-f6a6-5698-98aa-e41f0f508792 with identifier: WS31989
2026-03-28 18:42:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf50a9fe-f6a6-5698-98aa-e41f0f508792 with scrape type 2
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf50a9fe-f6a6-5698-98aa-e41f0f508792 with scrape type 2
2026-03-28 18:42:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf50a9fe-f6a6-5698-98aa-e41f0f508792, identifier: WS31989
2026-03-28 18:42:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf50a9fe-f6a6-5698-98aa-e41f0f508792 with identifier: WS31989
2026-03-28 18:42:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf50a9fe-f6a6-5698-98aa-e41f0f508792 with identifier: WS31989
2026-03-28 18:42:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf50a9fe-f6a6-5698-98aa-e41f0f508792 with identifier: WS31989 to the API
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:47:47Z',
 'fuel_type': 'petrol',
 'id': 'bf50a9fe-f6a6-5698-98aa-e41f0f508792',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS31989',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 20356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-28',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS31989%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Saving data for WS31989: {'auction_closing_time': 1774885667.0, 'created_time': 1774550129.401332, 'last_price_update_time': 1774723345.888732}
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS31989') HTTP/1.1" 204 0
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD58686%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for MD58686: 0
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR15690%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for LR15690: 0
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG38319%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for SG38319: 0
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ84842%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for DZ84842: 0
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR96123%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for PR96123: 0
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR79819%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [auto1.de] INFO: Scrape type for AR79819: 0
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV65723%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [auto1.de] INFO: Scrape type for FV65723: 0
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS57096%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [auto1.de] INFO: Scrape type for KS57096: 0
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE53934%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [auto1.de] INFO: Scrape type for GE53934: 0
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ82429%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [auto1.de] INFO: Scrape type for MZ82429: 0
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA14077%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [auto1.de] INFO: Scrape type for KA14077: 2
2026-03-28 18:42:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 559abe04-f112-56c1-ae19-f18b3a0c8bf3 with identifier: KA14077
2026-03-28 18:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 559abe04-f112-56c1-ae19-f18b3a0c8bf3 with scrape type 2
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 559abe04-f112-56c1-ae19-f18b3a0c8bf3 with scrape type 2
2026-03-28 18:42:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 559abe04-f112-56c1-ae19-f18b3a0c8bf3, identifier: KA14077
2026-03-28 18:42:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 559abe04-f112-56c1-ae19-f18b3a0c8bf3 with identifier: KA14077
2026-03-28 18:42:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 559abe04-f112-56c1-ae19-f18b3a0c8bf3 with identifier: KA14077
2026-03-28 18:42:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 559abe04-f112-56c1-ae19-f18b3a0c8bf3 with identifier: KA14077 to the API
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:17:03Z',
 'fuel_type': 'diesel',
 'id': '559abe04-f112-56c1-ae19-f18b3a0c8bf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA14077',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 229463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-05',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA14077%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [auto1.de] INFO: Saving data for KA14077: {'auction_closing_time': 1774883823.0, 'created_time': 1773382920.640793, 'last_price_update_time': 1774723346.498628}
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA14077') HTTP/1.1" 204 0
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB05903%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [auto1.de] INFO: Scrape type for UB05903: 0
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX10720%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [auto1.de] INFO: Scrape type for GX10720: 0
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT15230%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [auto1.de] INFO: Scrape type for PT15230: 0
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: CL18387
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL18387%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [auto1.de] INFO: Scrape type for CL18387: 1
2026-03-28 18:42:26 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD47381%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [auto1.de] INFO: Scrape type for WD47381: 2
2026-03-28 18:42:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3641fb43-a22f-5b5d-9c7b-81b4360dfb26 with identifier: WD47381
2026-03-28 18:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3641fb43-a22f-5b5d-9c7b-81b4360dfb26 with scrape type 2
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3641fb43-a22f-5b5d-9c7b-81b4360dfb26 with scrape type 2
2026-03-28 18:42:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3641fb43-a22f-5b5d-9c7b-81b4360dfb26, identifier: WD47381
2026-03-28 18:42:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3641fb43-a22f-5b5d-9c7b-81b4360dfb26 with identifier: WD47381
2026-03-28 18:42:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3641fb43-a22f-5b5d-9c7b-81b4360dfb26 with identifier: WD47381
2026-03-28 18:42:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3641fb43-a22f-5b5d-9c7b-81b4360dfb26 with identifier: WD47381 to the API
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:08:09Z',
 'fuel_type': 'diesel',
 'id': '3641fb43-a22f-5b5d-9c7b-81b4360dfb26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD47381',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 120621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-18',
 'seller_name': None,
 'title': 'BMW 5er 530d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD47381%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [auto1.de] INFO: Saving data for WD47381: {'auction_closing_time': 1774883289.0, 'created_time': 1773345512.070836, 'last_price_update_time': 1774723347.155361}
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD47381') HTTP/1.1" 204 0
2026-03-28 18:42:27 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP03484%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [auto1.de] INFO: Scrape type for XP03484: 0
2026-03-28 18:42:27 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN41265%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [auto1.de] INFO: Scrape type for PN41265: 0
2026-03-28 18:42:27 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-28 18:42:27 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-28 18:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN51585> (referer: https://www.auto1.com/v1/car-details-view/FN51585/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eb1b848-3324-5aad-a739-f78dd49fa128 with identifier: FN51585
2026-03-28 18:42:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eb1b848-3324-5aad-a739-f78dd49fa128 with scrape type 1
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3eb1b848-3324-5aad-a739-f78dd49fa128
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0d%252Fe80da820f5f47d6c56c5885d111ecbe4%252Fpa%252FFN51585_7977c99fe58d38bc0ee6afb73f145f16.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_7977c99fe58d38bc0ee6afb73f145f16.jpg already downloaded
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0d%252Fe80da820f5f47d6c56c5885d111ecbe4%252Fpa%252FFN51585_34c824eb8ac8c439e7ff7471a64a0ebf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_34c824eb8ac8c439e7ff7471a64a0ebf.jpg already downloaded
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0d%252Fe80da820f5f47d6c56c5885d111ecbe4%252Fpa%252FFN51585_c3adf0758c879b476aaac1e19e03ebb4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_c3adf0758c879b476aaac1e19e03ebb4.jpg already downloaded
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0d%252Fe80da820f5f47d6c56c5885d111ecbe4%252Fpa%252FFN51585_c8f69ed9ed019795148b153a70a22c28.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_c8f69ed9ed019795148b153a70a22c28.jpg already downloaded
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0d%252Fe80da820f5f47d6c56c5885d111ecbe4%252Fpa%252FFN51585_ced289c74521841d001cfdeb2c4e526c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_ced289c74521841d001cfdeb2c4e526c.jpg already downloaded
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0d%252Fe80da820f5f47d6c56c5885d111ecbe4%252Fpa%252FFN51585_491f8fa28e9fae93d2487a88b4a650d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_491f8fa28e9fae93d2487a88b4a650d4.jpg already downloaded
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0d%252Fe80da820f5f47d6c56c5885d111ecbe4%252Fpa%252FFN51585_9c31cadd72040e6d12ab80fcd80cf1c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_9c31cadd72040e6d12ab80fcd80cf1c8.jpg already downloaded
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0d%252Fe80da820f5f47d6c56c5885d111ecbe4%252Fpa%252FFN51585_d4d7cb4abbfd2c725785ce44e3fb92f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_d4d7cb4abbfd2c725785ce44e3fb92f9.jpg already downloaded
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0d%252Fe80da820f5f47d6c56c5885d111ecbe4%252Fpa%252FFN51585_7b5581b2b012fa97c73b177d1b8c3a41.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_7b5581b2b012fa97c73b177d1b8c3a41.jpg already downloaded
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0d%252Fe80da820f5f47d6c56c5885d111ecbe4%252Fpa%252FFN51585_c7e0737a05cc4eda1cf7d32a44e69fad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_c7e0737a05cc4eda1cf7d32a44e69fad.jpg already downloaded
2026-03-28 18:42:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3eb1b848-3324-5aad-a739-f78dd49fa128, identifier: FN51585
2026-03-28 18:42:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3eb1b848-3324-5aad-a739-f78dd49fa128 with identifier: FN51585
2026-03-28 18:42:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3eb1b848-3324-5aad-a739-f78dd49fa128 with identifier: FN51585
2026-03-28 18:42:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3eb1b848-3324-5aad-a739-f78dd49fa128 with identifier: FN51585 to the API
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FN51585>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:28:13Z',
 'fuel_type': 'petrol',
 'id': '3eb1b848-3324-5aad-a739-f78dd49fa128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN51585',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 90094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_7977c99fe58d38bc0ee6afb73f145f16.jpg',
                'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_34c824eb8ac8c439e7ff7471a64a0ebf.jpg',
                'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_c3adf0758c879b476aaac1e19e03ebb4.jpg',
                'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_c8f69ed9ed019795148b153a70a22c28.jpg',
                'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_ced289c74521841d001cfdeb2c4e526c.jpg',
                'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_491f8fa28e9fae93d2487a88b4a650d4.jpg',
                'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_9c31cadd72040e6d12ab80fcd80cf1c8.jpg',
                'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_d4d7cb4abbfd2c725785ce44e3fb92f9.jpg',
                'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_7b5581b2b012fa97c73b177d1b8c3a41.jpg',
                'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_c7e0737a05cc4eda1cf7d32a44e69fad.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb1b848-3324-5aad-a739-f78dd49fa128/3eb1b848-3324-5aad-a739-f78dd49fa128_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_7977c99fe58d38bc0ee6afb73f145f16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb1b848-3324-5aad-a739-f78dd49fa128/3eb1b848-3324-5aad-a739-f78dd49fa128_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_34c824eb8ac8c439e7ff7471a64a0ebf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb1b848-3324-5aad-a739-f78dd49fa128/3eb1b848-3324-5aad-a739-f78dd49fa128_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_c3adf0758c879b476aaac1e19e03ebb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb1b848-3324-5aad-a739-f78dd49fa128/3eb1b848-3324-5aad-a739-f78dd49fa128_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_c8f69ed9ed019795148b153a70a22c28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb1b848-3324-5aad-a739-f78dd49fa128/3eb1b848-3324-5aad-a739-f78dd49fa128_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_ced289c74521841d001cfdeb2c4e526c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb1b848-3324-5aad-a739-f78dd49fa128/3eb1b848-3324-5aad-a739-f78dd49fa128_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_491f8fa28e9fae93d2487a88b4a650d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb1b848-3324-5aad-a739-f78dd49fa128/3eb1b848-3324-5aad-a739-f78dd49fa128_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_9c31cadd72040e6d12ab80fcd80cf1c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb1b848-3324-5aad-a739-f78dd49fa128/3eb1b848-3324-5aad-a739-f78dd49fa128_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_d4d7cb4abbfd2c725785ce44e3fb92f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb1b848-3324-5aad-a739-f78dd49fa128/3eb1b848-3324-5aad-a739-f78dd49fa128_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_7b5581b2b012fa97c73b177d1b8c3a41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb1b848-3324-5aad-a739-f78dd49fa128/3eb1b848-3324-5aad-a739-f78dd49fa128_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0d/e80da820f5f47d6c56c5885d111ecbe4/pa/FN51585_c7e0737a05cc4eda1cf7d32a44e69fad.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2015}
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN51585%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [auto1.de] INFO: Saving data for FN51585: {'created_time': 1774723347.911344, 'last_price_update_time': 1774723347.911359, 'auction_closing_time': 1774884493.0}
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN51585') HTTP/1.1" 204 0
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:28 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE73798%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for KE73798: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP39271%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for EP39271: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40224%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for SX40224: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH12349%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for RH12349: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK86846%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for SK86846: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY30583%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for JY30583: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB16241%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for XB16241: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC45431%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for DC45431: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN58705%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for VN58705: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU37095%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for PU37095: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75557%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for DA75557: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE62268%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for TE62268: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS06029%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for FS06029: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT18435%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for CT18435: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45042%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for WL45042: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC25913%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for MC25913: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52581%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for WJ52581: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB69488%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for DB69488: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV26733%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for DV26733: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ53227%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for GJ53227: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS07294%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for XS07294: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH48828%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for MH48828: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU28825%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for MU28825: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR12459%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for HR12459: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00058%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for PH00058: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF51688%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for SF51688: 0
2026-03-28 18:42:28 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48054%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Scrape type for KU48054: 2
2026-03-28 18:42:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0129e928-3c84-5feb-91dc-6bca30cbfa90 with identifier: KU48054
2026-03-28 18:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0129e928-3c84-5feb-91dc-6bca30cbfa90 with scrape type 2
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0129e928-3c84-5feb-91dc-6bca30cbfa90 with scrape type 2
2026-03-28 18:42:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0129e928-3c84-5feb-91dc-6bca30cbfa90, identifier: KU48054
2026-03-28 18:42:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0129e928-3c84-5feb-91dc-6bca30cbfa90 with identifier: KU48054
2026-03-28 18:42:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0129e928-3c84-5feb-91dc-6bca30cbfa90 with identifier: KU48054
2026-03-28 18:42:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0129e928-3c84-5feb-91dc-6bca30cbfa90 with identifier: KU48054 to the API
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:33:08Z',
 'fuel_type': 'petrol',
 'id': '0129e928-3c84-5feb-91dc-6bca30cbfa90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU48054',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 6971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-24',
 'seller_name': None,
 'title': 'BMW 1er 120i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2024}
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48054%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [auto1.de] INFO: Saving data for KU48054: {'auction_closing_time': 1774884788.0, 'created_time': 1774521582.177692, 'last_price_update_time': 1774723349.03406}
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU48054') HTTP/1.1" 204 0
2026-03-28 18:42:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL18387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:30 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC14239%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [auto1.de] INFO: Scrape type for WC14239: 0
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34410%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [auto1.de] INFO: Scrape type for DG34410: 0
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP16968%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [auto1.de] INFO: Scrape type for UP16968: 2
2026-03-28 18:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with identifier: UP16968
2026-03-28 18:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with scrape type 2
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with scrape type 2
2026-03-28 18:42:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73, identifier: UP16968
2026-03-28 18:42:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with identifier: UP16968
2026-03-28 18:42:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with identifier: UP16968
2026-03-28 18:42:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with identifier: UP16968 to the API
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:16:04Z',
 'fuel_type': 'petrol',
 'id': '5d41dcc3-3c03-5e8c-b493-26f6384c2f73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP16968',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 101052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-10',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP16968%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [auto1.de] INFO: Saving data for UP16968: {'auction_closing_time': 1774883764.0, 'created_time': 1774522366.212166, 'last_price_update_time': 1774723350.732922}
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP16968') HTTP/1.1" 204 0
2026-03-28 18:42:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW78119%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [auto1.de] INFO: Scrape type for VW78119: 0
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH60803%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [auto1.de] INFO: Scrape type for XH60803: 0
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED54075%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [auto1.de] INFO: Scrape type for ED54075: 0
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-28 18:42:30 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH55403%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [auto1.de] INFO: Scrape type for YH55403: 2
2026-03-28 18:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with identifier: YH55403
2026-03-28 18:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with scrape type 2
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with scrape type 2
2026-03-28 18:42:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca, identifier: YH55403
2026-03-28 18:42:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with identifier: YH55403
2026-03-28 18:42:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with identifier: YH55403
2026-03-28 18:42:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with identifier: YH55403 to the API
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:37:11Z',
 'fuel_type': 'petrol',
 'id': '5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH55403',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 130298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-13',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2011}
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH55403%27 HTTP/1.1" 200 None
2026-03-28 18:42:31 [auto1.de] INFO: Saving data for YH55403: {'auction_closing_time': 1774885031.0, 'created_time': 1774521782.404606, 'last_price_update_time': 1774723351.391201}
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH55403') HTTP/1.1" 204 0
2026-03-28 18:42:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL18387> (referer: https://www.auto1.com/v1/car-details-view/CL18387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:31 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-28 18:42:31 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-28 18:42:31 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63697%27 HTTP/1.1" 200 None
2026-03-28 18:42:31 [auto1.de] INFO: Scrape type for XB63697: 2
2026-03-28 18:42:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3978a967-4222-5b19-b692-1597eeece47b with identifier: XB63697
2026-03-28 18:42:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3978a967-4222-5b19-b692-1597eeece47b with scrape type 2
2026-03-28 18:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3978a967-4222-5b19-b692-1597eeece47b with scrape type 2
2026-03-28 18:42:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3978a967-4222-5b19-b692-1597eeece47b, identifier: XB63697
2026-03-28 18:42:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3978a967-4222-5b19-b692-1597eeece47b with identifier: XB63697
2026-03-28 18:42:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3978a967-4222-5b19-b692-1597eeece47b with identifier: XB63697
2026-03-28 18:42:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3978a967-4222-5b19-b692-1597eeece47b with identifier: XB63697 to the API
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:18:40Z',
 'fuel_type': 'petrol',
 'id': '3978a967-4222-5b19-b692-1597eeece47b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB63697',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 101422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-12',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2017}
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63697%27 HTTP/1.1" 200 None
2026-03-28 18:42:31 [auto1.de] INFO: Saving data for XB63697: {'auction_closing_time': 1774883920.0, 'created_time': 1774636575.75196, 'last_price_update_time': 1774723351.995848}
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB63697') HTTP/1.1" 204 0
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA34634%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [auto1.de] INFO: Scrape type for AA34634: 0
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13972%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [auto1.de] INFO: Scrape type for TR13972: 0
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH76263%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [auto1.de] INFO: Scrape type for AH76263: 0
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK82878%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [auto1.de] INFO: Scrape type for GK82878: 0
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB72166%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [auto1.de] INFO: Scrape type for TB72166: 0
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17291%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [auto1.de] INFO: Scrape type for RE17291: 0
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF69711%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [auto1.de] INFO: Scrape type for XF69711: 0
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW17566%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [auto1.de] INFO: Scrape type for FW17566: 0
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ08446%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [auto1.de] INFO: Scrape type for KZ08446: 0
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE63209%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [auto1.de] INFO: Scrape type for JE63209: 0
2026-03-28 18:42:32 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU80975%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [auto1.de] INFO: Scrape type for BU80975: 2
2026-03-28 18:42:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19dcf5ae-f17a-54f1-ae2f-6676fc631d62 with identifier: BU80975
2026-03-28 18:42:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19dcf5ae-f17a-54f1-ae2f-6676fc631d62 with scrape type 2
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19dcf5ae-f17a-54f1-ae2f-6676fc631d62 with scrape type 2
2026-03-28 18:42:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19dcf5ae-f17a-54f1-ae2f-6676fc631d62, identifier: BU80975
2026-03-28 18:42:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19dcf5ae-f17a-54f1-ae2f-6676fc631d62 with identifier: BU80975
2026-03-28 18:42:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19dcf5ae-f17a-54f1-ae2f-6676fc631d62 with identifier: BU80975
2026-03-28 18:42:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19dcf5ae-f17a-54f1-ae2f-6676fc631d62 with identifier: BU80975 to the API
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:35:14Z',
 'fuel_type': 'petrol',
 'id': '19dcf5ae-f17a-54f1-ae2f-6676fc631d62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU80975',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 218202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-07',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU80975%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [auto1.de] INFO: Saving data for BU80975: {'auction_closing_time': 1774884914.0, 'created_time': 1774034561.238225, 'last_price_update_time': 1774723352.698856}
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU80975') HTTP/1.1" 204 0
2026-03-28 18:42:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd050084-8988-5b17-b14b-1a5549565377 with identifier: CL18387
2026-03-28 18:42:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd050084-8988-5b17-b14b-1a5549565377 with scrape type 1
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item cd050084-8988-5b17-b14b-1a5549565377
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd4%252F81d4bf4d4bda2a5997a5edab0191cc03%252Fpa%252FCL18387_15b2c324c7f4032fb9fb42f3a7ec32d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_15b2c324c7f4032fb9fb42f3a7ec32d8.jpg already downloaded
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd4%252F81d4bf4d4bda2a5997a5edab0191cc03%252Fpa%252FCL18387_87ff73c5df1041c9dcf8feb2cc38999e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_87ff73c5df1041c9dcf8feb2cc38999e.jpg already downloaded
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd4%252F81d4bf4d4bda2a5997a5edab0191cc03%252Fpa%252FCL18387_127d6a6564870a4d331147b0f0cef990.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_127d6a6564870a4d331147b0f0cef990.jpg already downloaded
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd4%252F81d4bf4d4bda2a5997a5edab0191cc03%252Fpa%252FCL18387_94b6a1ae7b3a38b200da1d18fd5d69dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_94b6a1ae7b3a38b200da1d18fd5d69dc.jpg already downloaded
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd4%252F81d4bf4d4bda2a5997a5edab0191cc03%252Fpa%252FCL18387_69a2073002fcde9d31b4e752f5945fb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_69a2073002fcde9d31b4e752f5945fb0.jpg already downloaded
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fd4%252F81d4bf4d4bda2a5997a5edab0191cc03%252Fpa%252FCL18387_d6798a48cdbd018eec52a0b862355108.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_d6798a48cdbd018eec52a0b862355108.jpg already downloaded
2026-03-28 18:42:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd050084-8988-5b17-b14b-1a5549565377, identifier: CL18387
2026-03-28 18:42:33 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG14715%27 HTTP/1.1" 200 None
2026-03-28 18:42:33 [auto1.de] INFO: Scrape type for LG14715: 0
2026-03-28 18:42:33 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-28 18:42:33 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-28 18:42:33 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF92726%27 HTTP/1.1" 200 None
2026-03-28 18:42:33 [auto1.de] INFO: Scrape type for BF92726: 2
2026-03-28 18:42:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a9afe3d-340a-57f2-a386-501cee4d9c04 with identifier: BF92726
2026-03-28 18:42:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a9afe3d-340a-57f2-a386-501cee4d9c04 with scrape type 2
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a9afe3d-340a-57f2-a386-501cee4d9c04 with scrape type 2
2026-03-28 18:42:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a9afe3d-340a-57f2-a386-501cee4d9c04, identifier: BF92726
2026-03-28 18:42:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd050084-8988-5b17-b14b-1a5549565377 with identifier: CL18387
2026-03-28 18:42:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd050084-8988-5b17-b14b-1a5549565377 with identifier: CL18387
2026-03-28 18:42:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd050084-8988-5b17-b14b-1a5549565377 with identifier: CL18387 to the API
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CL18387>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:23:18Z',
 'fuel_type': 'petrol',
 'id': 'cd050084-8988-5b17-b14b-1a5549565377',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL18387',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 191885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_15b2c324c7f4032fb9fb42f3a7ec32d8.jpg',
                'https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_87ff73c5df1041c9dcf8feb2cc38999e.jpg',
                'https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_127d6a6564870a4d331147b0f0cef990.jpg',
                'https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_94b6a1ae7b3a38b200da1d18fd5d69dc.jpg',
                'https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_69a2073002fcde9d31b4e752f5945fb0.jpg',
                'https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_d6798a48cdbd018eec52a0b862355108.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd050084-8988-5b17-b14b-1a5549565377/cd050084-8988-5b17-b14b-1a5549565377_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_15b2c324c7f4032fb9fb42f3a7ec32d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd050084-8988-5b17-b14b-1a5549565377/cd050084-8988-5b17-b14b-1a5549565377_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_87ff73c5df1041c9dcf8feb2cc38999e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd050084-8988-5b17-b14b-1a5549565377/cd050084-8988-5b17-b14b-1a5549565377_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_127d6a6564870a4d331147b0f0cef990.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd050084-8988-5b17-b14b-1a5549565377/cd050084-8988-5b17-b14b-1a5549565377_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_94b6a1ae7b3a38b200da1d18fd5d69dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd050084-8988-5b17-b14b-1a5549565377/cd050084-8988-5b17-b14b-1a5549565377_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_69a2073002fcde9d31b4e752f5945fb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd050084-8988-5b17-b14b-1a5549565377/cd050084-8988-5b17-b14b-1a5549565377_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/d4/81d4bf4d4bda2a5997a5edab0191cc03/pa/CL18387_d6798a48cdbd018eec52a0b862355108.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL18387%27 HTTP/1.1" 200 None
2026-03-28 18:42:33 [auto1.de] INFO: Saving data for CL18387: {'created_time': 1774723353.504606, 'last_price_update_time': 1774723353.504618, 'auction_closing_time': 1774884198.0}
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL18387') HTTP/1.1" 204 0
2026-03-28 18:42:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a9afe3d-340a-57f2-a386-501cee4d9c04 with identifier: BF92726
2026-03-28 18:42:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a9afe3d-340a-57f2-a386-501cee4d9c04 with identifier: BF92726
2026-03-28 18:42:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a9afe3d-340a-57f2-a386-501cee4d9c04 with identifier: BF92726 to the API
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:13:35Z',
 'fuel_type': 'petrol',
 'id': '9a9afe3d-340a-57f2-a386-501cee4d9c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF92726',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 214051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-22',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF92726%27 HTTP/1.1" 200 None
2026-03-28 18:42:33 [auto1.de] INFO: Saving data for BF92726: {'auction_closing_time': 1774883615.0, 'created_time': 1774522180.070826, 'last_price_update_time': 1774723353.915802}
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF92726') HTTP/1.1" 204 0
2026-03-28 18:42:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:37 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:37 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP00162%27 HTTP/1.1" 200 None
2026-03-28 18:42:37 [auto1.de] INFO: Scrape type for DP00162: 2
2026-03-28 18:42:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with identifier: DP00162
2026-03-28 18:42:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with scrape type 2
2026-03-28 18:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with scrape type 2
2026-03-28 18:42:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1, identifier: DP00162
2026-03-28 18:42:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with identifier: DP00162
2026-03-28 18:42:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with identifier: DP00162
2026-03-28 18:42:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with identifier: DP00162 to the API
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:41Z',
 'fuel_type': 'diesel',
 'id': '8245bdf6-662b-5846-b1e5-6f9dacfbf7d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP00162',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 237483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-05',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2017}
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP00162%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [auto1.de] INFO: Saving data for DP00162: {'auction_closing_time': 1774883321.0, 'created_time': 1773427075.494201, 'last_price_update_time': 1774723358.414328}
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP00162') HTTP/1.1" 204 0
2026-03-28 18:42:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB37977%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [auto1.de] INFO: Scrape type for BB37977: 2
2026-03-28 18:42:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0218e752-1b3e-526c-beff-52955fd0c744 with identifier: BB37977
2026-03-28 18:42:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0218e752-1b3e-526c-beff-52955fd0c744 with scrape type 2
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0218e752-1b3e-526c-beff-52955fd0c744 with scrape type 2
2026-03-28 18:42:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0218e752-1b3e-526c-beff-52955fd0c744, identifier: BB37977
2026-03-28 18:42:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0218e752-1b3e-526c-beff-52955fd0c744 with identifier: BB37977
2026-03-28 18:42:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0218e752-1b3e-526c-beff-52955fd0c744 with identifier: BB37977
2026-03-28 18:42:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0218e752-1b3e-526c-beff-52955fd0c744 with identifier: BB37977 to the API
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-30T15:43:43Z',
 'fuel_type': 'diesel',
 'id': '0218e752-1b3e-526c-beff-52955fd0c744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB37977',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 4',
 'odometer': 158338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-17',
 'seller_name': None,
 'title': 'Land Rover Discovery 4 3.0 TD V6 SDV6 HSE',
 'transmission': 'automatic',
 'trim': 'SDV6 HSE',
 'year': 2013}
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB37977%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [auto1.de] INFO: Saving data for BB37977: {'auction_closing_time': 1774885423.0, 'created_time': 1774521365.47602, 'last_price_update_time': 1774723358.867632}
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB37977') HTTP/1.1" 204 0
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV93929%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [auto1.de] INFO: Scrape type for YV93929: 0
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK34658%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [auto1.de] INFO: Scrape type for MK34658: 0
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR27730%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [auto1.de] INFO: Scrape type for XR27730: 0
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ02891%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [auto1.de] INFO: Scrape type for YZ02891: 0
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY14800%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [auto1.de] INFO: Scrape type for KY14800: 0
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL60244%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [auto1.de] INFO: Scrape type for XL60244: 0
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85812%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [auto1.de] INFO: Scrape type for XB85812: 0
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-28 18:42:38 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE33138%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [auto1.de] INFO: Scrape type for TE33138: 0
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV90463%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [auto1.de] INFO: Scrape type for LV90463: 0
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45055%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [auto1.de] INFO: Scrape type for FZ45055: 0
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX16558%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [auto1.de] INFO: Scrape type for SX16558: 0
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL71783%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [auto1.de] INFO: Scrape type for JL71783: 0
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ50044%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [auto1.de] INFO: Scrape type for AZ50044: 0
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ21973%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [auto1.de] INFO: Scrape type for WZ21973: 0
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF91602%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [auto1.de] INFO: Scrape type for CF91602: 0
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS24568%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [auto1.de] INFO: Scrape type for CS24568: 0
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW97614%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [auto1.de] INFO: Scrape type for NW97614: 0
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT11339%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [auto1.de] INFO: Scrape type for YT11339: 0
2026-03-28 18:42:39 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:40 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:40 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY92615%27 HTTP/1.1" 200 None
2026-03-28 18:42:40 [auto1.de] INFO: Scrape type for YY92615: 0
2026-03-28 18:42:40 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-28 18:42:40 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML67017%27 HTTP/1.1" 200 None
2026-03-28 18:42:40 [auto1.de] INFO: Scrape type for ML67017: 2
2026-03-28 18:42:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f with identifier: ML67017
2026-03-28 18:42:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f with scrape type 2
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f with scrape type 2
2026-03-28 18:42:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f, identifier: ML67017
2026-03-28 18:42:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f with identifier: ML67017
2026-03-28 18:42:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f with identifier: ML67017
2026-03-28 18:42:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f with identifier: ML67017 to the API
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:40:25Z',
 'fuel_type': 'hybrid',
 'id': '9ab8f4ae-3484-5224-a9d5-167aa23ceb6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML67017',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 26223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-28',
 'seller_name': None,
 'title': 'Kia Sorento 1.6 TGDI Plug-in Hybrid Spirit 4WD',
 'transmission': 'automatic',
 'trim': 'Spirit 4WD',
 'year': 2022}
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML67017%27 HTTP/1.1" 200 None
2026-03-28 18:42:40 [auto1.de] INFO: Saving data for ML67017: {'auction_closing_time': 1774885225.0, 'created_time': 1773344749.390344, 'last_price_update_time': 1774723360.544108}
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML67017') HTTP/1.1" 204 0
2026-03-28 18:42:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:40 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS86318%27 HTTP/1.1" 200 None
2026-03-28 18:42:40 [auto1.de] INFO: Scrape type for SS86318: 2
2026-03-28 18:42:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 584eede6-04c5-5c0b-a222-3a476e832d8e with identifier: SS86318
2026-03-28 18:42:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584eede6-04c5-5c0b-a222-3a476e832d8e with scrape type 2
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 584eede6-04c5-5c0b-a222-3a476e832d8e with scrape type 2
2026-03-28 18:42:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 584eede6-04c5-5c0b-a222-3a476e832d8e, identifier: SS86318
2026-03-28 18:42:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 584eede6-04c5-5c0b-a222-3a476e832d8e with identifier: SS86318
2026-03-28 18:42:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 584eede6-04c5-5c0b-a222-3a476e832d8e with identifier: SS86318
2026-03-28 18:42:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 584eede6-04c5-5c0b-a222-3a476e832d8e with identifier: SS86318 to the API
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:56:37Z',
 'fuel_type': 'diesel',
 'id': '584eede6-04c5-5c0b-a222-3a476e832d8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS86318',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 307127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-20',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2007}
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS86318%27 HTTP/1.1" 200 None
2026-03-28 18:42:41 [auto1.de] INFO: Saving data for SS86318: {'auction_closing_time': 1774886197.0, 'created_time': 1773429695.937796, 'last_price_update_time': 1774723361.109403}
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS86318') HTTP/1.1" 204 0
2026-03-28 18:42:41 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-28 18:42:41 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92843%27 HTTP/1.1" 200 None
2026-03-28 18:42:41 [auto1.de] INFO: Scrape type for LS92843: 0
2026-03-28 18:42:41 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB28144%27 HTTP/1.1" 200 None
2026-03-28 18:42:41 [auto1.de] INFO: Scrape type for PB28144: 0
2026-03-28 18:42:41 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-28 18:42:41 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-28 18:42:41 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-28 18:42:41 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-28 18:42:41 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD21201%27 HTTP/1.1" 200 None
2026-03-28 18:42:41 [auto1.de] INFO: Scrape type for AD21201: 0
2026-03-28 18:42:41 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-28 18:42:41 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG95107%27 HTTP/1.1" 200 None
2026-03-28 18:42:41 [auto1.de] INFO: Scrape type for RG95107: 2
2026-03-28 18:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56a92588-96dc-568d-8b35-e12fb26e50a0 with identifier: RG95107
2026-03-28 18:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56a92588-96dc-568d-8b35-e12fb26e50a0 with scrape type 2
2026-03-28 18:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56a92588-96dc-568d-8b35-e12fb26e50a0 with scrape type 2
2026-03-28 18:42:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56a92588-96dc-568d-8b35-e12fb26e50a0, identifier: RG95107
2026-03-28 18:42:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56a92588-96dc-568d-8b35-e12fb26e50a0 with identifier: RG95107
2026-03-28 18:42:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56a92588-96dc-568d-8b35-e12fb26e50a0 with identifier: RG95107
2026-03-28 18:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56a92588-96dc-568d-8b35-e12fb26e50a0 with identifier: RG95107 to the API
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:18:14Z',
 'fuel_type': 'petrol',
 'id': '56a92588-96dc-568d-8b35-e12fb26e50a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG95107',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 62529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-16',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG95107%27 HTTP/1.1" 200 None
2026-03-28 18:42:41 [auto1.de] INFO: Saving data for RG95107: {'auction_closing_time': 1774883894.0, 'created_time': 1773382713.457011, 'last_price_update_time': 1774723361.695509}
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG95107') HTTP/1.1" 204 0
2026-03-28 18:42:41 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV60739%27 HTTP/1.1" 200 None
2026-03-28 18:42:41 [auto1.de] INFO: Scrape type for SV60739: 0
2026-03-28 18:42:41 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB59521%27 HTTP/1.1" 200 None
2026-03-28 18:42:41 [auto1.de] INFO: Scrape type for UB59521: 2
2026-03-28 18:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9a9748a-a39b-5c34-83e5-c224e72ea67c with identifier: UB59521
2026-03-28 18:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9a9748a-a39b-5c34-83e5-c224e72ea67c with scrape type 2
2026-03-28 18:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9a9748a-a39b-5c34-83e5-c224e72ea67c with scrape type 2
2026-03-28 18:42:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9a9748a-a39b-5c34-83e5-c224e72ea67c, identifier: UB59521
2026-03-28 18:42:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9a9748a-a39b-5c34-83e5-c224e72ea67c with identifier: UB59521
2026-03-28 18:42:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9a9748a-a39b-5c34-83e5-c224e72ea67c with identifier: UB59521
2026-03-28 18:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9a9748a-a39b-5c34-83e5-c224e72ea67c with identifier: UB59521 to the API
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:54:50Z',
 'fuel_type': 'petrol',
 'id': 'f9a9748a-a39b-5c34-83e5-c224e72ea67c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB59521',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 139287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-16',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2012}
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB59521%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Saving data for UB59521: {'auction_closing_time': 1774886090.0, 'created_time': 1773382499.190441, 'last_price_update_time': 1774723362.252718}
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB59521') HTTP/1.1" 204 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH60355%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for FH60355: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW39556%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for KW39556: 2
2026-03-28 18:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 712182f4-dfca-5c1e-a988-8333c220bde5 with identifier: KW39556
2026-03-28 18:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 712182f4-dfca-5c1e-a988-8333c220bde5 with scrape type 2
2026-03-28 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 712182f4-dfca-5c1e-a988-8333c220bde5 with scrape type 2
2026-03-28 18:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 712182f4-dfca-5c1e-a988-8333c220bde5, identifier: KW39556
2026-03-28 18:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 712182f4-dfca-5c1e-a988-8333c220bde5 with identifier: KW39556
2026-03-28 18:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 712182f4-dfca-5c1e-a988-8333c220bde5 with identifier: KW39556
2026-03-28 18:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 712182f4-dfca-5c1e-a988-8333c220bde5 with identifier: KW39556 to the API
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:47:17Z',
 'fuel_type': 'diesel',
 'id': '712182f4-dfca-5c1e-a988-8333c220bde5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW39556',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Kombi',
 'odometer': 209662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-01',
 'seller_name': None,
 'title': 'Volkswagen T6 Kombi 2.0 TDI 4Motion',
 'transmission': 'automatic',
 'trim': '4Motion',
 'year': 2018}
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW39556%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Saving data for KW39556: {'auction_closing_time': 1774885637.0, 'created_time': 1773224144.672645, 'last_price_update_time': 1774723362.740899}
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW39556') HTTP/1.1" 204 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD67638%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for ZD67638: 2
2026-03-28 18:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab468ea0-8b9c-5757-997f-b75aefd95906 with identifier: ZD67638
2026-03-28 18:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab468ea0-8b9c-5757-997f-b75aefd95906 with scrape type 2
2026-03-28 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab468ea0-8b9c-5757-997f-b75aefd95906 with scrape type 2
2026-03-28 18:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab468ea0-8b9c-5757-997f-b75aefd95906, identifier: ZD67638
2026-03-28 18:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab468ea0-8b9c-5757-997f-b75aefd95906 with identifier: ZD67638
2026-03-28 18:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab468ea0-8b9c-5757-997f-b75aefd95906 with identifier: ZD67638
2026-03-28 18:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab468ea0-8b9c-5757-997f-b75aefd95906 with identifier: ZD67638 to the API
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:18:18Z',
 'fuel_type': 'petrol',
 'id': 'ab468ea0-8b9c-5757-997f-b75aefd95906',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD67638',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 133971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-18',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD67638%27 HTTP/1.1" 200 None
2026-03-28 18:42:43 [auto1.de] INFO: Saving data for ZD67638: {'auction_closing_time': 1774883898.0, 'created_time': 1774636658.052281, 'last_price_update_time': 1774723363.35461}
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD67638') HTTP/1.1" 204 0
2026-03-28 18:42:43 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT58505%27 HTTP/1.1" 200 None
2026-03-28 18:42:43 [auto1.de] INFO: Scrape type for GT58505: 0
2026-03-28 18:42:43 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92511%27 HTTP/1.1" 200 None
2026-03-28 18:42:43 [auto1.de] INFO: Scrape type for BD92511: 0
2026-03-28 18:42:43 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ07739%27 HTTP/1.1" 200 None
2026-03-28 18:42:43 [auto1.de] INFO: Scrape type for RZ07739: 2
2026-03-28 18:42:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73225278-d1dc-55fc-855c-ef4139203fff with identifier: RZ07739
2026-03-28 18:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73225278-d1dc-55fc-855c-ef4139203fff with scrape type 2
2026-03-28 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73225278-d1dc-55fc-855c-ef4139203fff with scrape type 2
2026-03-28 18:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73225278-d1dc-55fc-855c-ef4139203fff, identifier: RZ07739
2026-03-28 18:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73225278-d1dc-55fc-855c-ef4139203fff with identifier: RZ07739
2026-03-28 18:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73225278-d1dc-55fc-855c-ef4139203fff with identifier: RZ07739
2026-03-28 18:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73225278-d1dc-55fc-855c-ef4139203fff with identifier: RZ07739 to the API
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:48:24Z',
 'fuel_type': 'petrol',
 'id': '73225278-d1dc-55fc-855c-ef4139203fff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ07739',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 32658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2021}
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ07739%27 HTTP/1.1" 200 None
2026-03-28 18:42:43 [auto1.de] INFO: Saving data for RZ07739: {'auction_closing_time': 1774885704.0, 'created_time': 1774521673.859668, 'last_price_update_time': 1774723363.890639}
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ07739') HTTP/1.1" 204 0
2026-03-28 18:42:43 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-28 18:42:43 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-28 18:42:43 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL23730%27 HTTP/1.1" 200 None
2026-03-28 18:42:43 [auto1.de] INFO: Scrape type for EL23730: 0
2026-03-28 18:42:43 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX33214%27 HTTP/1.1" 200 None
2026-03-28 18:42:43 [auto1.de] INFO: Scrape type for TX33214: 0
2026-03-28 18:42:43 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94447%27 HTTP/1.1" 200 None
2026-03-28 18:42:43 [auto1.de] INFO: Scrape type for CJ94447: 0
2026-03-28 18:42:43 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-28 18:42:43 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW65379%27 HTTP/1.1" 200 None
2026-03-28 18:42:43 [auto1.de] INFO: Scrape type for KW65379: 0
2026-03-28 18:42:43 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-28 18:42:43 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV35373%27 HTTP/1.1" 200 None
2026-03-28 18:42:43 [auto1.de] INFO: Scrape type for UV35373: 0
2026-03-28 18:42:43 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE25450%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for EE25450: 0
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC35648%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for UC35648: 0
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34897%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for TT34897: 0
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU38253%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for KU38253: 0
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-28 18:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:44 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW03247%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for GW03247: 0
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN24608%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for TN24608: 2
2026-03-28 18:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06c38a0a-6c60-5762-9944-f3756a021120 with identifier: TN24608
2026-03-28 18:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06c38a0a-6c60-5762-9944-f3756a021120 with scrape type 2
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06c38a0a-6c60-5762-9944-f3756a021120 with scrape type 2
2026-03-28 18:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06c38a0a-6c60-5762-9944-f3756a021120, identifier: TN24608
2026-03-28 18:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06c38a0a-6c60-5762-9944-f3756a021120 with identifier: TN24608
2026-03-28 18:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06c38a0a-6c60-5762-9944-f3756a021120 with identifier: TN24608
2026-03-28 18:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06c38a0a-6c60-5762-9944-f3756a021120 with identifier: TN24608 to the API
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:10:53Z',
 'fuel_type': 'diesel',
 'id': '06c38a0a-6c60-5762-9944-f3756a021120',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN24608',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 155207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi N-Connecta 4x4',
 'transmission': 'manual',
 'trim': 'N-Connecta 4x4',
 'year': 2016}
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN24608%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Saving data for TN24608: {'auction_closing_time': 1774883453.0, 'created_time': 1774522190.94557, 'last_price_update_time': 1774723364.657898}
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN24608') HTTP/1.1" 204 0
2026-03-28 18:42:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: HD35365
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB14981%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for TB14981: 0
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER30285%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for ER30285: 0
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU47228%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for NU47228: 0
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41473%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for KS41473: 0
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ96775%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for MJ96775: 0
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA40469%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for EA40469: 0
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB77280%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for LB77280: 0
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-28 18:42:44 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET23804%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Scrape type for ET23804: 2
2026-03-28 18:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d231d52e-7650-57a0-bcba-4ce9774fcb0c with identifier: ET23804
2026-03-28 18:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d231d52e-7650-57a0-bcba-4ce9774fcb0c with scrape type 2
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d231d52e-7650-57a0-bcba-4ce9774fcb0c with scrape type 2
2026-03-28 18:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d231d52e-7650-57a0-bcba-4ce9774fcb0c, identifier: ET23804
2026-03-28 18:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d231d52e-7650-57a0-bcba-4ce9774fcb0c with identifier: ET23804
2026-03-28 18:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d231d52e-7650-57a0-bcba-4ce9774fcb0c with identifier: ET23804
2026-03-28 18:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d231d52e-7650-57a0-bcba-4ce9774fcb0c with identifier: ET23804 to the API
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:10:27Z',
 'fuel_type': 'petrol',
 'id': 'd231d52e-7650-57a0-bcba-4ce9774fcb0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET23804',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 113136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-04',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2014}
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET23804%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [auto1.de] INFO: Saving data for ET23804: {'auction_closing_time': 1774883427.0, 'created_time': 1773946964.963343, 'last_price_update_time': 1774723365.293606}
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET23804') HTTP/1.1" 204 0
2026-03-28 18:42:45 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ16195%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [auto1.de] INFO: Scrape type for FZ16195: 0
2026-03-28 18:42:45 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-28 18:42:45 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-28 18:42:45 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-28 18:42:45 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83651%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [auto1.de] INFO: Scrape type for NX83651: 0
2026-03-28 18:42:45 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-28 18:42:45 [auto1.de] INFO: Found listing with ID: SS79198
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS79198%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [auto1.de] INFO: Scrape type for SS79198: 2
2026-03-28 18:42:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77 with identifier: SS79198
2026-03-28 18:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77 with scrape type 2
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77 with scrape type 2
2026-03-28 18:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77, identifier: SS79198
2026-03-28 18:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77 with identifier: SS79198
2026-03-28 18:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77 with identifier: SS79198
2026-03-28 18:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77 with identifier: SS79198 to the API
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:36:44Z',
 'fuel_type': 'petrol',
 'id': '6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS79198',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 93476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-27',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2013}
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS79198%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [auto1.de] INFO: Saving data for SS79198: {'auction_closing_time': 1774885004.0, 'created_time': 1774034329.086343, 'last_price_update_time': 1774723365.909637}
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS79198') HTTP/1.1" 204 0
2026-03-28 18:42:45 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-28 18:42:45 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-28 18:42:45 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP30819%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [auto1.de] INFO: Scrape type for NP30819: 0
2026-03-28 18:42:45 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-28 18:42:45 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-28 18:42:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:50 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK96887%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for WK96887: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH61376%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for JH61376: 2
2026-03-28 18:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dab3910c-8064-549f-b55e-28642a91d9b9 with identifier: JH61376
2026-03-28 18:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dab3910c-8064-549f-b55e-28642a91d9b9 with scrape type 2
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dab3910c-8064-549f-b55e-28642a91d9b9 with scrape type 2
2026-03-28 18:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dab3910c-8064-549f-b55e-28642a91d9b9, identifier: JH61376
2026-03-28 18:42:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dab3910c-8064-549f-b55e-28642a91d9b9 with identifier: JH61376
2026-03-28 18:42:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dab3910c-8064-549f-b55e-28642a91d9b9 with identifier: JH61376
2026-03-28 18:42:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dab3910c-8064-549f-b55e-28642a91d9b9 with identifier: JH61376 to the API
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:41:05Z',
 'fuel_type': 'petrol',
 'id': 'dab3910c-8064-549f-b55e-28642a91d9b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH61376',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 33121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-13',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250 4Matic AMG',
 'transmission': 'automatic',
 'trim': '4Matic AMG',
 'year': 2014}
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH61376%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Saving data for JH61376: {'auction_closing_time': 1774885265.0, 'created_time': 1774550157.10966, 'last_price_update_time': 1774723370.573957}
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH61376') HTTP/1.1" 204 0
2026-03-28 18:42:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD45668%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for SD45668: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK39591%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for KK39591: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT28734%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for UT28734: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP92588%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for FP92588: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV47877%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for XV47877: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH38301%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for KH38301: 2
2026-03-28 18:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00438067-5874-5c4f-9f8b-9ab2e9067e23 with identifier: KH38301
2026-03-28 18:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00438067-5874-5c4f-9f8b-9ab2e9067e23 with scrape type 2
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00438067-5874-5c4f-9f8b-9ab2e9067e23 with scrape type 2
2026-03-28 18:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00438067-5874-5c4f-9f8b-9ab2e9067e23, identifier: KH38301
2026-03-28 18:42:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00438067-5874-5c4f-9f8b-9ab2e9067e23 with identifier: KH38301
2026-03-28 18:42:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00438067-5874-5c4f-9f8b-9ab2e9067e23 with identifier: KH38301
2026-03-28 18:42:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00438067-5874-5c4f-9f8b-9ab2e9067e23 with identifier: KH38301 to the API
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:05Z',
 'fuel_type': 'petrol',
 'id': '00438067-5874-5c4f-9f8b-9ab2e9067e23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH38301',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 79309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH38301%27 HTTP/1.1" 200 None
2026-03-28 18:42:51 [auto1.de] INFO: Saving data for KH38301: {'auction_closing_time': 1774884185.0, 'created_time': 1774034476.73897, 'last_price_update_time': 1774723371.245267}
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH38301') HTTP/1.1" 204 0
2026-03-28 18:42:51 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-28 18:42:51 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-28 18:42:51 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-28 18:42:51 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF17671%27 HTTP/1.1" 200 None
2026-03-28 18:42:51 [auto1.de] INFO: Scrape type for XF17671: 0
2026-03-28 18:42:51 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT05209%27 HTTP/1.1" 200 None
2026-03-28 18:42:51 [auto1.de] INFO: Scrape type for ZT05209: 0
2026-03-28 18:42:51 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-28 18:42:51 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB45839%27 HTTP/1.1" 200 None
2026-03-28 18:42:51 [auto1.de] INFO: Scrape type for NB45839: 0
2026-03-28 18:42:51 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-28 18:42:51 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD21444%27 HTTP/1.1" 200 None
2026-03-28 18:42:51 [auto1.de] INFO: Scrape type for BD21444: 2
2026-03-28 18:42:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbd677c3-4ade-5461-ba8e-ec215f69ff6d with identifier: BD21444
2026-03-28 18:42:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbd677c3-4ade-5461-ba8e-ec215f69ff6d with scrape type 2
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbd677c3-4ade-5461-ba8e-ec215f69ff6d with scrape type 2
2026-03-28 18:42:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbd677c3-4ade-5461-ba8e-ec215f69ff6d, identifier: BD21444
2026-03-28 18:42:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbd677c3-4ade-5461-ba8e-ec215f69ff6d with identifier: BD21444
2026-03-28 18:42:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbd677c3-4ade-5461-ba8e-ec215f69ff6d with identifier: BD21444
2026-03-28 18:42:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbd677c3-4ade-5461-ba8e-ec215f69ff6d with identifier: BD21444 to the API
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:58:59Z',
 'fuel_type': 'diesel',
 'id': 'cbd677c3-4ade-5461-ba8e-ec215f69ff6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD21444',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 166778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-25',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD21444%27 HTTP/1.1" 200 None
2026-03-28 18:42:52 [auto1.de] INFO: Saving data for BD21444: {'auction_closing_time': 1774886339.0, 'created_time': 1773225611.074423, 'last_price_update_time': 1774723372.740304}
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD21444') HTTP/1.1" 204 0
2026-03-28 18:42:52 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE08810%27 HTTP/1.1" 200 None
2026-03-28 18:42:52 [auto1.de] INFO: Scrape type for VE08810: 0
2026-03-28 18:42:52 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW71594%27 HTTP/1.1" 200 None
2026-03-28 18:42:52 [auto1.de] INFO: Scrape type for XW71594: 2
2026-03-28 18:42:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebcae088-b63d-5c7f-9581-689b769b3cad with identifier: XW71594
2026-03-28 18:42:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebcae088-b63d-5c7f-9581-689b769b3cad with scrape type 2
2026-03-28 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebcae088-b63d-5c7f-9581-689b769b3cad with scrape type 2
2026-03-28 18:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebcae088-b63d-5c7f-9581-689b769b3cad, identifier: XW71594
2026-03-28 18:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebcae088-b63d-5c7f-9581-689b769b3cad with identifier: XW71594
2026-03-28 18:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebcae088-b63d-5c7f-9581-689b769b3cad with identifier: XW71594
2026-03-28 18:42:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebcae088-b63d-5c7f-9581-689b769b3cad with identifier: XW71594 to the API
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:42:37Z',
 'fuel_type': 'diesel',
 'id': 'ebcae088-b63d-5c7f-9581-689b769b3cad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW71594',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 164758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': None,
 'title': 'BMW 5er 520d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW71594%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [auto1.de] INFO: Saving data for XW71594: {'auction_closing_time': 1774885357.0, 'created_time': 1773229706.359796, 'last_price_update_time': 1774723373.200211}
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW71594') HTTP/1.1" 204 0
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH58707%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [auto1.de] INFO: Scrape type for WH58707: 2
2026-03-28 18:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfc387fa-2d1f-59bc-becd-b4eb83d55a23 with identifier: WH58707
2026-03-28 18:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfc387fa-2d1f-59bc-becd-b4eb83d55a23 with scrape type 2
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfc387fa-2d1f-59bc-becd-b4eb83d55a23 with scrape type 2
2026-03-28 18:42:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bfc387fa-2d1f-59bc-becd-b4eb83d55a23, identifier: WH58707
2026-03-28 18:42:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bfc387fa-2d1f-59bc-becd-b4eb83d55a23 with identifier: WH58707
2026-03-28 18:42:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bfc387fa-2d1f-59bc-becd-b4eb83d55a23 with identifier: WH58707
2026-03-28 18:42:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bfc387fa-2d1f-59bc-becd-b4eb83d55a23 with identifier: WH58707 to the API
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:55:04Z',
 'fuel_type': 'petrol',
 'id': 'bfc387fa-2d1f-59bc-becd-b4eb83d55a23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH58707',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 46491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-13',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Edition 7',
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2019}
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH58707%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [auto1.de] INFO: Saving data for WH58707: {'auction_closing_time': 1774886104.0, 'created_time': 1773945881.470466, 'last_price_update_time': 1774723373.78375}
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH58707') HTTP/1.1" 204 0
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP78752%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [auto1.de] INFO: Scrape type for DP78752: 2
2026-03-28 18:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33f3b16c-7b69-558f-ae1a-0202161177f3 with identifier: DP78752
2026-03-28 18:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33f3b16c-7b69-558f-ae1a-0202161177f3 with scrape type 2
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33f3b16c-7b69-558f-ae1a-0202161177f3 with scrape type 2
2026-03-28 18:42:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33f3b16c-7b69-558f-ae1a-0202161177f3, identifier: DP78752
2026-03-28 18:42:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33f3b16c-7b69-558f-ae1a-0202161177f3 with identifier: DP78752
2026-03-28 18:42:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33f3b16c-7b69-558f-ae1a-0202161177f3 with identifier: DP78752
2026-03-28 18:42:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33f3b16c-7b69-558f-ae1a-0202161177f3 with identifier: DP78752 to the API
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-30T15:24:28Z',
 'fuel_type': 'petrol',
 'id': '33f3b16c-7b69-558f-ae1a-0202161177f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP78752',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TTS',
 'odometer': 131471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-31',
 'seller_name': None,
 'title': 'Audi TTS 2.0 TFSI quattro Coupe',
 'transmission': 'automatic',
 'trim': 'quattro Coupe',
 'year': 2016}
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP78752%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Saving data for DP78752: {'auction_closing_time': 1774884268.0, 'created_time': 1773308194.344215, 'last_price_update_time': 1774723374.261979}
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP78752') HTTP/1.1" 204 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ33404%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for PZ33404: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK98498%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for MK98498: 2
2026-03-28 18:42:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97482e3a-6c60-5566-88cc-c1cb73cfb2fa with identifier: MK98498
2026-03-28 18:42:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97482e3a-6c60-5566-88cc-c1cb73cfb2fa with scrape type 2
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97482e3a-6c60-5566-88cc-c1cb73cfb2fa with scrape type 2
2026-03-28 18:42:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97482e3a-6c60-5566-88cc-c1cb73cfb2fa, identifier: MK98498
2026-03-28 18:42:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97482e3a-6c60-5566-88cc-c1cb73cfb2fa with identifier: MK98498
2026-03-28 18:42:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97482e3a-6c60-5566-88cc-c1cb73cfb2fa with identifier: MK98498
2026-03-28 18:42:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97482e3a-6c60-5566-88cc-c1cb73cfb2fa with identifier: MK98498 to the API
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:06:44Z',
 'fuel_type': 'diesel',
 'id': '97482e3a-6c60-5566-88cc-c1cb73cfb2fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK98498',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 84614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-29',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK98498%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Saving data for MK98498: {'auction_closing_time': 1774883204.0, 'created_time': 1774350848.132728, 'last_price_update_time': 1774723374.748468}
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK98498') HTTP/1.1" 204 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT41344%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for VT41344: 2
2026-03-28 18:42:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b88936e-3414-5b11-8023-bd9586466aec with identifier: VT41344
2026-03-28 18:42:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b88936e-3414-5b11-8023-bd9586466aec with scrape type 2
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b88936e-3414-5b11-8023-bd9586466aec with scrape type 2
2026-03-28 18:42:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b88936e-3414-5b11-8023-bd9586466aec, identifier: VT41344
2026-03-28 18:42:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b88936e-3414-5b11-8023-bd9586466aec with identifier: VT41344
2026-03-28 18:42:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b88936e-3414-5b11-8023-bd9586466aec with identifier: VT41344
2026-03-28 18:42:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b88936e-3414-5b11-8023-bd9586466aec with identifier: VT41344 to the API
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:30:15Z',
 'fuel_type': 'diesel',
 'id': '2b88936e-3414-5b11-8023-bd9586466aec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT41344',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 219034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-02',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT41344%27 HTTP/1.1" 200 None
2026-03-28 18:42:55 [auto1.de] INFO: Saving data for VT41344: {'auction_closing_time': 1774884615.0, 'created_time': 1774521577.971607, 'last_price_update_time': 1774723375.711425}
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT41344') HTTP/1.1" 204 0
2026-03-28 18:42:55 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-28 18:42:55 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH98757%27 HTTP/1.1" 200 None
2026-03-28 18:42:55 [auto1.de] INFO: Scrape type for FH98757: 2
2026-03-28 18:42:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 558baaeb-a376-5287-927d-0b0dba5a804e with identifier: FH98757
2026-03-28 18:42:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 558baaeb-a376-5287-927d-0b0dba5a804e with scrape type 2
2026-03-28 18:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 558baaeb-a376-5287-927d-0b0dba5a804e with scrape type 2
2026-03-28 18:42:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 558baaeb-a376-5287-927d-0b0dba5a804e, identifier: FH98757
2026-03-28 18:42:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 558baaeb-a376-5287-927d-0b0dba5a804e with identifier: FH98757
2026-03-28 18:42:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 558baaeb-a376-5287-927d-0b0dba5a804e with identifier: FH98757
2026-03-28 18:42:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 558baaeb-a376-5287-927d-0b0dba5a804e with identifier: FH98757 to the API
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:57Z',
 'fuel_type': 'diesel',
 'id': '558baaeb-a376-5287-927d-0b0dba5a804e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH98757',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'CC',
 'odometer': 179423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-14',
 'seller_name': None,
 'title': 'Volkswagen CC 2.0 TDI BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'BlueMotion Tech',
 'year': 2013}
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH98757%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [auto1.de] INFO: Saving data for FH98757: {'auction_closing_time': 1774884897.0, 'created_time': 1773429394.454008, 'last_price_update_time': 1774723376.204052}
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH98757') HTTP/1.1" 204 0
2026-03-28 18:42:56 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-28 18:42:56 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-28 18:42:56 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:56 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC92366%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [auto1.de] INFO: Scrape type for AC92366: 2
2026-03-28 18:42:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 574ab418-ac0d-594a-810b-d4b8e3b255c9 with identifier: AC92366
2026-03-28 18:42:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 574ab418-ac0d-594a-810b-d4b8e3b255c9 with scrape type 2
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 574ab418-ac0d-594a-810b-d4b8e3b255c9 with scrape type 2
2026-03-28 18:42:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 574ab418-ac0d-594a-810b-d4b8e3b255c9, identifier: AC92366
2026-03-28 18:42:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 574ab418-ac0d-594a-810b-d4b8e3b255c9 with identifier: AC92366
2026-03-28 18:42:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 574ab418-ac0d-594a-810b-d4b8e3b255c9 with identifier: AC92366
2026-03-28 18:42:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 574ab418-ac0d-594a-810b-d4b8e3b255c9 with identifier: AC92366 to the API
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:18:30Z',
 'fuel_type': 'petrol',
 'id': '574ab418-ac0d-594a-810b-d4b8e3b255c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC92366',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 115274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC92366%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [auto1.de] INFO: Saving data for AC92366: {'auction_closing_time': 1774883910.0, 'created_time': 1774522514.911213, 'last_price_update_time': 1774723376.761296}
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC92366') HTTP/1.1" 204 0
2026-03-28 18:42:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:56 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-28 18:42:56 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-28 18:42:56 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV09356%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [auto1.de] INFO: Scrape type for CV09356: 0
2026-03-28 18:42:56 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-28 18:42:56 [auto1.de] INFO: Found listing with ID: NH48980
2026-03-28 18:42:56 [auto1.de] INFO: Found listing with ID: PW96816
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW96816%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [auto1.de] INFO: Scrape type for PW96816: 1
2026-03-28 18:42:56 [auto1.de] INFO: Found listing with ID: UZ14919
2026-03-28 18:42:56 [auto1.de] INFO: Found listing with ID: JU61936
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU61936%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [auto1.de] INFO: Scrape type for JU61936: 1
2026-03-28 18:42:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:56 [auto1.de] INFO: Found listing with ID: KC56991
2026-03-28 18:42:56 [auto1.de] INFO: Found listing with ID: FY38947
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY38947%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [auto1.de] INFO: Scrape type for FY38947: 2
2026-03-28 18:42:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7f460e6-70f5-5b2f-973e-7666d6174c0d with identifier: FY38947
2026-03-28 18:42:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7f460e6-70f5-5b2f-973e-7666d6174c0d with scrape type 2
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7f460e6-70f5-5b2f-973e-7666d6174c0d with scrape type 2
2026-03-28 18:42:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7f460e6-70f5-5b2f-973e-7666d6174c0d, identifier: FY38947
2026-03-28 18:42:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7f460e6-70f5-5b2f-973e-7666d6174c0d with identifier: FY38947
2026-03-28 18:42:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7f460e6-70f5-5b2f-973e-7666d6174c0d with identifier: FY38947
2026-03-28 18:42:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7f460e6-70f5-5b2f-973e-7666d6174c0d with identifier: FY38947 to the API
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:22:00Z',
 'fuel_type': 'petrol',
 'id': 'c7f460e6-70f5-5b2f-973e-7666d6174c0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY38947',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 61646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2020}
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY38947%27 HTTP/1.1" 200 None
2026-03-28 18:42:57 [auto1.de] INFO: Saving data for FY38947: {'auction_closing_time': 1774884120.0, 'created_time': 1774035473.419426, 'last_price_update_time': 1774723377.314437}
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY38947') HTTP/1.1" 204 0
2026-03-28 18:42:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:57 [auto1.de] INFO: Found listing with ID: MU41228
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU41228%27 HTTP/1.1" 200 None
2026-03-28 18:42:57 [auto1.de] INFO: Scrape type for MU41228: 1
2026-03-28 18:42:57 [auto1.de] INFO: Found listing with ID: NG13141
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG13141%27 HTTP/1.1" 200 None
2026-03-28 18:42:57 [auto1.de] INFO: Scrape type for NG13141: 2
2026-03-28 18:42:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 821683dd-d9c2-5258-9db6-b842fe922965 with identifier: NG13141
2026-03-28 18:42:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 821683dd-d9c2-5258-9db6-b842fe922965 with scrape type 2
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 821683dd-d9c2-5258-9db6-b842fe922965 with scrape type 2
2026-03-28 18:42:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 821683dd-d9c2-5258-9db6-b842fe922965, identifier: NG13141
2026-03-28 18:42:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 821683dd-d9c2-5258-9db6-b842fe922965 with identifier: NG13141
2026-03-28 18:42:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 821683dd-d9c2-5258-9db6-b842fe922965 with identifier: NG13141
2026-03-28 18:42:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 821683dd-d9c2-5258-9db6-b842fe922965 with identifier: NG13141 to the API
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:45:04Z',
 'fuel_type': 'diesel',
 'id': '821683dd-d9c2-5258-9db6-b842fe922965',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG13141',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 224018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-07',
 'seller_name': None,
 'title': 'Renault Talisman 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2016}
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG13141%27 HTTP/1.1" 200 None
2026-03-28 18:42:57 [auto1.de] INFO: Saving data for NG13141: {'auction_closing_time': 1774885504.0, 'created_time': 1773400327.105054, 'last_price_update_time': 1774723377.879813}
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG13141') HTTP/1.1" 204 0
2026-03-28 18:42:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:57 [auto1.de] INFO: Found listing with ID: SP37211
2026-03-28 18:42:57 [auto1.de] INFO: Found listing with ID: BP15722
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP15722%27 HTTP/1.1" 200 None
2026-03-28 18:42:57 [auto1.de] INFO: Scrape type for BP15722: 1
2026-03-28 18:42:57 [auto1.de] INFO: Found listing with ID: ZJ20785
2026-03-28 18:42:57 [auto1.de] INFO: Found listing with ID: PG70940
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG70940%27 HTTP/1.1" 200 None
2026-03-28 18:42:57 [auto1.de] INFO: Scrape type for PG70940: 2
2026-03-28 18:42:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b with identifier: PG70940
2026-03-28 18:42:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b with scrape type 2
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b with scrape type 2
2026-03-28 18:42:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b, identifier: PG70940
2026-03-28 18:42:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b with identifier: PG70940
2026-03-28 18:42:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b with identifier: PG70940
2026-03-28 18:42:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b with identifier: PG70940 to the API
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:38:19Z',
 'fuel_type': 'diesel',
 'id': 'ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG70940',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 89678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Peugeot Expert 1.6 Blue-HDi Active L2',
 'transmission': 'manual',
 'trim': 'Active L2',
 'year': 2017}
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG70940%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Saving data for PG70940: {'auction_closing_time': 1774885099.0, 'created_time': 1774349937.53173, 'last_price_update_time': 1774723378.379155}
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG70940') HTTP/1.1" 204 0
2026-03-28 18:42:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: HJ15324
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: YJ96267
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ96267%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for YJ96267: 1
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: BH45975
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45975%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for BH45975: 2
2026-03-28 18:42:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7e7246-4e93-53a6-8339-35dbb94b1040 with identifier: BH45975
2026-03-28 18:42:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7e7246-4e93-53a6-8339-35dbb94b1040 with scrape type 2
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e7e7246-4e93-53a6-8339-35dbb94b1040 with scrape type 2
2026-03-28 18:42:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e7e7246-4e93-53a6-8339-35dbb94b1040, identifier: BH45975
2026-03-28 18:42:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e7e7246-4e93-53a6-8339-35dbb94b1040 with identifier: BH45975
2026-03-28 18:42:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e7e7246-4e93-53a6-8339-35dbb94b1040 with identifier: BH45975
2026-03-28 18:42:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e7e7246-4e93-53a6-8339-35dbb94b1040 with identifier: BH45975 to the API
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:54:55Z',
 'fuel_type': 'petrol',
 'id': '9e7e7246-4e93-53a6-8339-35dbb94b1040',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH45975',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 91163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-14',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45975%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Saving data for BH45975: {'auction_closing_time': 1774886095.0, 'created_time': 1774003289.594634, 'last_price_update_time': 1774723378.863885}
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH45975') HTTP/1.1" 204 0
2026-03-28 18:42:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: JS30878
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS30878%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for JS30878: 2
2026-03-28 18:42:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89 with identifier: JS30878
2026-03-28 18:42:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89 with scrape type 2
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89 with scrape type 2
2026-03-28 18:42:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89, identifier: JS30878
2026-03-28 18:42:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89 with identifier: JS30878
2026-03-28 18:42:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89 with identifier: JS30878
2026-03-28 18:42:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89 with identifier: JS30878 to the API
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:24:37Z',
 'fuel_type': 'petrol',
 'id': '77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS30878',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 160889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-28',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS30878%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [auto1.de] INFO: Saving data for JS30878: {'auction_closing_time': 1774884277.0, 'created_time': 1774349876.786243, 'last_price_update_time': 1774723379.351641}
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS30878') HTTP/1.1" 204 0
2026-03-28 18:42:59 [auto1.de] INFO: Found listing with ID: NL79635
2026-03-28 18:42:59 [auto1.de] INFO: Found listing with ID: LF10236
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF10236%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [auto1.de] INFO: Scrape type for LF10236: 2
2026-03-28 18:42:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb with identifier: LF10236
2026-03-28 18:42:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb with scrape type 2
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb with scrape type 2
2026-03-28 18:42:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb, identifier: LF10236
2026-03-28 18:42:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb with identifier: LF10236
2026-03-28 18:42:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb with identifier: LF10236
2026-03-28 18:42:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb with identifier: LF10236 to the API
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:56:55Z',
 'fuel_type': 'diesel',
 'id': 'ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF10236',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 160356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2007}
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF10236%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [auto1.de] INFO: Saving data for LF10236: {'auction_closing_time': 1774886215.0, 'created_time': 1774034872.800773, 'last_price_update_time': 1774723379.806462}
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF10236') HTTP/1.1" 204 0
2026-03-28 18:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:59 [auto1.de] INFO: Found listing with ID: DP76469
2026-03-28 18:42:59 [auto1.de] INFO: Found listing with ID: ST53597
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST53597%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [auto1.de] INFO: Scrape type for ST53597: 2
2026-03-28 18:42:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cff15e21-ea19-53d5-a886-a085381ed24d with identifier: ST53597
2026-03-28 18:42:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cff15e21-ea19-53d5-a886-a085381ed24d with scrape type 2
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cff15e21-ea19-53d5-a886-a085381ed24d with scrape type 2
2026-03-28 18:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cff15e21-ea19-53d5-a886-a085381ed24d, identifier: ST53597
2026-03-28 18:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW96816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cff15e21-ea19-53d5-a886-a085381ed24d with identifier: ST53597
2026-03-28 18:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cff15e21-ea19-53d5-a886-a085381ed24d with identifier: ST53597
2026-03-28 18:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cff15e21-ea19-53d5-a886-a085381ed24d with identifier: ST53597 to the API
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:54:50Z',
 'fuel_type': 'diesel',
 'id': 'cff15e21-ea19-53d5-a886-a085381ed24d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST53597',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 93502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-18',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 290 L1 Sport',
 'transmission': 'automatic',
 'trim': '290 L1 Sport',
 'year': 2020}
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST53597%27 HTTP/1.1" 200 None
2026-03-28 18:43:00 [auto1.de] INFO: Saving data for ST53597: {'auction_closing_time': 1774886090.0, 'created_time': 1774034797.511256, 'last_price_update_time': 1774723380.409101}
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST53597') HTTP/1.1" 204 0
2026-03-28 18:43:00 [auto1.de] INFO: Found listing with ID: AD05986
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD05986%27 HTTP/1.1" 200 None
2026-03-28 18:43:00 [auto1.de] INFO: Scrape type for AD05986: 2
2026-03-28 18:43:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cf225da-2a58-56b8-b448-e400028bd87b with identifier: AD05986
2026-03-28 18:43:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cf225da-2a58-56b8-b448-e400028bd87b with scrape type 2
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cf225da-2a58-56b8-b448-e400028bd87b with scrape type 2
2026-03-28 18:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cf225da-2a58-56b8-b448-e400028bd87b, identifier: AD05986
2026-03-28 18:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cf225da-2a58-56b8-b448-e400028bd87b with identifier: AD05986
2026-03-28 18:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cf225da-2a58-56b8-b448-e400028bd87b with identifier: AD05986
2026-03-28 18:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cf225da-2a58-56b8-b448-e400028bd87b with identifier: AD05986 to the API
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:03:54Z',
 'fuel_type': 'petrol',
 'id': '8cf225da-2a58-56b8-b448-e400028bd87b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD05986',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 16265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-12',
 'seller_name': None,
 'title': 'MINI John Cooper Works Trim',
 'transmission': 'manual',
 'trim': 'Trim',
 'year': 2023}
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD05986%27 HTTP/1.1" 200 None
2026-03-28 18:43:00 [auto1.de] INFO: Saving data for AD05986: {'auction_closing_time': 1774883034.0, 'created_time': 1773381310.45263, 'last_price_update_time': 1774723380.831902}
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD05986') HTTP/1.1" 204 0
2026-03-28 18:43:00 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 6009 | hits on page: 40
2026-03-28 18:43:00 [auto1.de] INFO: Found listing with ID: LU20114
2026-03-28 18:43:00 [auto1.de] INFO: Found listing with ID: WT09019
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT09019%27 HTTP/1.1" 200 None
2026-03-28 18:43:00 [auto1.de] INFO: Scrape type for WT09019: 2
2026-03-28 18:43:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5d772ec-2436-5b77-a935-26c1aa1fcaf6 with identifier: WT09019
2026-03-28 18:43:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5d772ec-2436-5b77-a935-26c1aa1fcaf6 with scrape type 2
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5d772ec-2436-5b77-a935-26c1aa1fcaf6 with scrape type 2
2026-03-28 18:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5d772ec-2436-5b77-a935-26c1aa1fcaf6, identifier: WT09019
2026-03-28 18:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU41228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5d772ec-2436-5b77-a935-26c1aa1fcaf6 with identifier: WT09019
2026-03-28 18:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5d772ec-2436-5b77-a935-26c1aa1fcaf6 with identifier: WT09019
2026-03-28 18:43:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5d772ec-2436-5b77-a935-26c1aa1fcaf6 with identifier: WT09019 to the API
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:18:00Z',
 'fuel_type': 'diesel',
 'id': 'c5d772ec-2436-5b77-a935-26c1aa1fcaf6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT09019',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 127855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-12',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Xperience',
 'transmission': 'automatic',
 'trim': 'Xperience',
 'year': 2022}
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT09019%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Saving data for WT09019: {'auction_closing_time': 1774883880.0, 'created_time': 1774033579.901319, 'last_price_update_time': 1774723381.288947}
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT09019') HTTP/1.1" 204 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: CS70589
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS70589%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for CS70589: 1
2026-03-28 18:43:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: MA38279
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: PZ30496
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: CH12661
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: HC35889
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: AX97123
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX97123%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for AX97123: 2
2026-03-28 18:43:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27ac1122-fa14-5da3-b8e4-e6f17c136b6b with identifier: AX97123
2026-03-28 18:43:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27ac1122-fa14-5da3-b8e4-e6f17c136b6b with scrape type 2
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27ac1122-fa14-5da3-b8e4-e6f17c136b6b with scrape type 2
2026-03-28 18:43:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27ac1122-fa14-5da3-b8e4-e6f17c136b6b, identifier: AX97123
2026-03-28 18:43:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27ac1122-fa14-5da3-b8e4-e6f17c136b6b with identifier: AX97123
2026-03-28 18:43:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27ac1122-fa14-5da3-b8e4-e6f17c136b6b with identifier: AX97123
2026-03-28 18:43:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27ac1122-fa14-5da3-b8e4-e6f17c136b6b with identifier: AX97123 to the API
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:39:21Z',
 'fuel_type': 'hybrid',
 'id': '27ac1122-fa14-5da3-b8e4-e6f17c136b6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX97123',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 90022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Prime 4WD',
 'transmission': 'automatic',
 'trim': 'Prime 4WD',
 'year': 2022}
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX97123%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Saving data for AX97123: {'auction_closing_time': 1774885161.0, 'created_time': 1773382880.223848, 'last_price_update_time': 1774723381.76049}
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX97123') HTTP/1.1" 204 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: MK47455
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK47455%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for MK47455: 2
2026-03-28 18:43:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15876a88-6fa7-5b4b-9523-f36ede4301ad with identifier: MK47455
2026-03-28 18:43:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15876a88-6fa7-5b4b-9523-f36ede4301ad with scrape type 2
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15876a88-6fa7-5b4b-9523-f36ede4301ad with scrape type 2
2026-03-28 18:43:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15876a88-6fa7-5b4b-9523-f36ede4301ad, identifier: MK47455
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU61936/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: ZM69821
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: ZW92608
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW92608%27 HTTP/1.1" 200 None
2026-03-28 18:43:02 [auto1.de] INFO: Scrape type for ZW92608: 2
2026-03-28 18:43:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9d0dd00-ae34-5f0e-9b6c-7056e003a8de with identifier: ZW92608
2026-03-28 18:43:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d0dd00-ae34-5f0e-9b6c-7056e003a8de with scrape type 2
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9d0dd00-ae34-5f0e-9b6c-7056e003a8de with scrape type 2
2026-03-28 18:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9d0dd00-ae34-5f0e-9b6c-7056e003a8de, identifier: ZW92608
2026-03-28 18:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15876a88-6fa7-5b4b-9523-f36ede4301ad with identifier: MK47455
2026-03-28 18:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15876a88-6fa7-5b4b-9523-f36ede4301ad with identifier: MK47455
2026-03-28 18:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15876a88-6fa7-5b4b-9523-f36ede4301ad with identifier: MK47455 to the API
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:06:15Z',
 'fuel_type': 'diesel',
 'id': '15876a88-6fa7-5b4b-9523-f36ede4301ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK47455',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 132804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-30',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Bi-Turbo Vignale',
 'transmission': 'automatic',
 'trim': 'Vignale',
 'year': 2016}
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK47455%27 HTTP/1.1" 200 None
2026-03-28 18:43:02 [auto1.de] INFO: Saving data for MK47455: {'auction_closing_time': 1774883175.0, 'created_time': 1773400200.573552, 'last_price_update_time': 1774723382.451325}
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK47455') HTTP/1.1" 204 0
2026-03-28 18:43:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP15722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9d0dd00-ae34-5f0e-9b6c-7056e003a8de with identifier: ZW92608
2026-03-28 18:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9d0dd00-ae34-5f0e-9b6c-7056e003a8de with identifier: ZW92608
2026-03-28 18:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9d0dd00-ae34-5f0e-9b6c-7056e003a8de with identifier: ZW92608 to the API
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:35:34Z',
 'fuel_type': 'diesel',
 'id': 'b9d0dd00-ae34-5f0e-9b6c-7056e003a8de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW92608',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 215505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-20',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2012}
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW92608%27 HTTP/1.1" 200 None
2026-03-28 18:43:02 [auto1.de] INFO: Saving data for ZW92608: {'auction_closing_time': 1774884934.0, 'created_time': 1774034040.632428, 'last_price_update_time': 1774723382.806581}
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW92608') HTTP/1.1" 204 0
2026-03-28 18:43:02 [auto1.de] INFO: Found listing with ID: ND12794
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND12794%27 HTTP/1.1" 200 None
2026-03-28 18:43:02 [auto1.de] INFO: Scrape type for ND12794: 1
2026-03-28 18:43:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ96267/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:02 [auto1.de] INFO: Found listing with ID: KF80964
2026-03-28 18:43:02 [auto1.de] INFO: Found listing with ID: CE00984
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE00984%27 HTTP/1.1" 200 None
2026-03-28 18:43:02 [auto1.de] INFO: Scrape type for CE00984: 1
2026-03-28 18:43:02 [auto1.de] INFO: Found listing with ID: TW63260
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW63260%27 HTTP/1.1" 200 None
2026-03-28 18:43:02 [auto1.de] INFO: Scrape type for TW63260: 1
2026-03-28 18:43:02 [auto1.de] INFO: Found listing with ID: KR40526
2026-03-28 18:43:02 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-28 18:43:02 [auto1.de] INFO: Found listing with ID: UV09635
2026-03-28 18:43:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:02 [auto1.de] INFO: Found listing with ID: SE34706
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE34706%27 HTTP/1.1" 200 None
2026-03-28 18:43:02 [auto1.de] INFO: Scrape type for SE34706: 2
2026-03-28 18:43:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f1e013e-73fb-57ba-9512-38d9f3ff51af with identifier: SE34706
2026-03-28 18:43:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f1e013e-73fb-57ba-9512-38d9f3ff51af with scrape type 2
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f1e013e-73fb-57ba-9512-38d9f3ff51af with scrape type 2
2026-03-28 18:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f1e013e-73fb-57ba-9512-38d9f3ff51af, identifier: SE34706
2026-03-28 18:43:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f1e013e-73fb-57ba-9512-38d9f3ff51af with identifier: SE34706
2026-03-28 18:43:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f1e013e-73fb-57ba-9512-38d9f3ff51af with identifier: SE34706
2026-03-28 18:43:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f1e013e-73fb-57ba-9512-38d9f3ff51af with identifier: SE34706 to the API
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:58:37Z',
 'fuel_type': 'diesel',
 'id': '3f1e013e-73fb-57ba-9512-38d9f3ff51af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE34706',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 279532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-22',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2015}
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE34706%27 HTTP/1.1" 200 None
2026-03-28 18:43:03 [auto1.de] INFO: Saving data for SE34706: {'auction_closing_time': 1774886317.0, 'created_time': 1774349880.003415, 'last_price_update_time': 1774723383.429525}
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE34706') HTTP/1.1" 204 0
2026-03-28 18:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:03 [auto1.de] INFO: Found listing with ID: LR83897
2026-03-28 18:43:03 [auto1.de] INFO: Found listing with ID: EX09851
2026-03-28 18:43:03 [auto1.de] INFO: Found listing with ID: RT47788
2026-03-28 18:43:03 [auto1.de] INFO: Found listing with ID: NM77711
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM77711%27 HTTP/1.1" 200 None
2026-03-28 18:43:03 [auto1.de] INFO: Scrape type for NM77711: 2
2026-03-28 18:43:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d1827aa-97f3-57e3-948a-a93f50948e8b with identifier: NM77711
2026-03-28 18:43:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1827aa-97f3-57e3-948a-a93f50948e8b with scrape type 2
2026-03-28 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d1827aa-97f3-57e3-948a-a93f50948e8b with scrape type 2
2026-03-28 18:43:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d1827aa-97f3-57e3-948a-a93f50948e8b, identifier: NM77711
2026-03-28 18:43:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d1827aa-97f3-57e3-948a-a93f50948e8b with identifier: NM77711
2026-03-28 18:43:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d1827aa-97f3-57e3-948a-a93f50948e8b with identifier: NM77711
2026-03-28 18:43:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d1827aa-97f3-57e3-948a-a93f50948e8b with identifier: NM77711 to the API
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:38:13Z',
 'fuel_type': 'petrol',
 'id': '8d1827aa-97f3-57e3-948a-a93f50948e8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM77711',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 20434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-18',
 'seller_name': None,
 'title': 'Dacia Logan MCV 0.9 TCe Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2020}
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM77711%27 HTTP/1.1" 200 None
2026-03-28 18:43:03 [auto1.de] INFO: Saving data for NM77711: {'auction_closing_time': 1774885093.0, 'created_time': 1774034451.540025, 'last_price_update_time': 1774723383.996313}
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM77711') HTTP/1.1" 204 0
2026-03-28 18:43:04 [auto1.de] INFO: Found listing with ID: SM15553
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM15553%27 HTTP/1.1" 200 None
2026-03-28 18:43:04 [auto1.de] INFO: Scrape type for SM15553: 2
2026-03-28 18:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d016a437-a9ac-5ffb-ab79-34404855a8f6 with identifier: SM15553
2026-03-28 18:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d016a437-a9ac-5ffb-ab79-34404855a8f6 with scrape type 2
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d016a437-a9ac-5ffb-ab79-34404855a8f6 with scrape type 2
2026-03-28 18:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d016a437-a9ac-5ffb-ab79-34404855a8f6, identifier: SM15553
2026-03-28 18:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d016a437-a9ac-5ffb-ab79-34404855a8f6 with identifier: SM15553
2026-03-28 18:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d016a437-a9ac-5ffb-ab79-34404855a8f6 with identifier: SM15553
2026-03-28 18:43:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d016a437-a9ac-5ffb-ab79-34404855a8f6 with identifier: SM15553 to the API
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:45:35Z',
 'fuel_type': 'petrol',
 'id': 'd016a437-a9ac-5ffb-ab79-34404855a8f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM15553',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 101046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM15553%27 HTTP/1.1" 200 None
2026-03-28 18:43:04 [auto1.de] INFO: Saving data for SM15553: {'auction_closing_time': 1774885535.0, 'created_time': 1774118738.840991, 'last_price_update_time': 1774723384.464687}
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM15553') HTTP/1.1" 204 0
2026-03-28 18:43:04 [auto1.de] INFO: Found listing with ID: NF65308
2026-03-28 18:43:04 [auto1.de] INFO: Found listing with ID: RB21288
2026-03-28 18:43:04 [auto1.de] INFO: Found listing with ID: TL00985
2026-03-28 18:43:04 [auto1.de] INFO: Found listing with ID: WM78340
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM78340%27 HTTP/1.1" 200 None
2026-03-28 18:43:04 [auto1.de] INFO: Scrape type for WM78340: 1
2026-03-28 18:43:04 [auto1.de] INFO: Found listing with ID: NF79967
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF79967%27 HTTP/1.1" 200 None
2026-03-28 18:43:04 [auto1.de] INFO: Scrape type for NF79967: 2
2026-03-28 18:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73563d6b-fd9d-594d-ad15-b694bbd1b4ae with identifier: NF79967
2026-03-28 18:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73563d6b-fd9d-594d-ad15-b694bbd1b4ae with scrape type 2
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73563d6b-fd9d-594d-ad15-b694bbd1b4ae with scrape type 2
2026-03-28 18:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73563d6b-fd9d-594d-ad15-b694bbd1b4ae, identifier: NF79967
2026-03-28 18:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73563d6b-fd9d-594d-ad15-b694bbd1b4ae with identifier: NF79967
2026-03-28 18:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73563d6b-fd9d-594d-ad15-b694bbd1b4ae with identifier: NF79967
2026-03-28 18:43:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73563d6b-fd9d-594d-ad15-b694bbd1b4ae with identifier: NF79967 to the API
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:40:21Z',
 'fuel_type': 'petrol',
 'id': '73563d6b-fd9d-594d-ad15-b694bbd1b4ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF79967',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 68991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-29',
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF79967%27 HTTP/1.1" 200 None
2026-03-28 18:43:04 [auto1.de] INFO: Saving data for NF79967: {'auction_closing_time': 1774885221.0, 'created_time': 1774002403.064803, 'last_price_update_time': 1774723384.953752}
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF79967') HTTP/1.1" 204 0
2026-03-28 18:43:04 [auto1.de] INFO: Found listing with ID: BP86172
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP86172%27 HTTP/1.1" 200 None
2026-03-28 18:43:04 [auto1.de] INFO: Scrape type for BP86172: 1
2026-03-28 18:43:04 [auto1.de] INFO: Found listing with ID: SM64754
2026-03-28 18:43:04 [auto1.de] INFO: Found listing with ID: PL66942
2026-03-28 18:43:04 [auto1.de] INFO: Found listing with ID: LR99893
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR99893%27 HTTP/1.1" 200 None
2026-03-28 18:43:05 [auto1.de] INFO: Scrape type for LR99893: 2
2026-03-28 18:43:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aee5aa4-74e8-5913-9a47-9b82b1139669 with identifier: LR99893
2026-03-28 18:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aee5aa4-74e8-5913-9a47-9b82b1139669 with scrape type 2
2026-03-28 18:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aee5aa4-74e8-5913-9a47-9b82b1139669 with scrape type 2
2026-03-28 18:43:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5aee5aa4-74e8-5913-9a47-9b82b1139669, identifier: LR99893
2026-03-28 18:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW96816> (referer: https://www.auto1.com/v1/car-details-view/PW96816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS70589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5aee5aa4-74e8-5913-9a47-9b82b1139669 with identifier: LR99893
2026-03-28 18:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5aee5aa4-74e8-5913-9a47-9b82b1139669 with identifier: LR99893
2026-03-28 18:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5aee5aa4-74e8-5913-9a47-9b82b1139669 with identifier: LR99893 to the API
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:50Z',
 'fuel_type': 'diesel',
 'id': '5aee5aa4-74e8-5913-9a47-9b82b1139669',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR99893',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 278451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-06',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Startline 4Motion',
 'transmission': 'manual',
 'trim': 'Startline 4Motion',
 'year': 2012}
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR99893%27 HTTP/1.1" 200 None
2026-03-28 18:43:05 [auto1.de] INFO: Saving data for LR99893: {'auction_closing_time': 1774884110.0, 'created_time': 1774032137.478875, 'last_price_update_time': 1774723385.421492}
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR99893') HTTP/1.1" 204 0
2026-03-28 18:43:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:05 [auto1.de] INFO: Found listing with ID: VG16481
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG16481%27 HTTP/1.1" 200 None
2026-03-28 18:43:05 [auto1.de] INFO: Scrape type for VG16481: 2
2026-03-28 18:43:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f771b4c2-53af-5e31-8e08-62f444b96b4e with identifier: VG16481
2026-03-28 18:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f771b4c2-53af-5e31-8e08-62f444b96b4e with scrape type 2
2026-03-28 18:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f771b4c2-53af-5e31-8e08-62f444b96b4e with scrape type 2
2026-03-28 18:43:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f771b4c2-53af-5e31-8e08-62f444b96b4e, identifier: VG16481
2026-03-28 18:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f771b4c2-53af-5e31-8e08-62f444b96b4e with identifier: VG16481
2026-03-28 18:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f771b4c2-53af-5e31-8e08-62f444b96b4e with identifier: VG16481
2026-03-28 18:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f771b4c2-53af-5e31-8e08-62f444b96b4e with identifier: VG16481 to the API
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:37:44Z',
 'fuel_type': 'hybrid',
 'id': 'f771b4c2-53af-5e31-8e08-62f444b96b4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG16481',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 44016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-13',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.4 PHEV Plus Spirit 4WD',
 'transmission': 'automatic',
 'trim': 'Plus Spirit 4WD',
 'year': 2021}
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG16481%27 HTTP/1.1" 200 None
2026-03-28 18:43:05 [auto1.de] INFO: Saving data for VG16481: {'auction_closing_time': 1774885064.0, 'created_time': 1774350918.953161, 'last_price_update_time': 1774723385.975227}
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG16481') HTTP/1.1" 204 0
2026-03-28 18:43:05 [auto1.de] INFO: Found listing with ID: RU39212
2026-03-28 18:43:05 [auto1.de] INFO: Found listing with ID: PH19268
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH19268%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for PH19268: 2
2026-03-28 18:43:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf with identifier: PH19268
2026-03-28 18:43:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf with scrape type 2
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf with scrape type 2
2026-03-28 18:43:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf, identifier: PH19268
2026-03-28 18:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND12794/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MU41228> (referer: https://www.auto1.com/v1/car-details-view/MU41228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE00984/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf with identifier: PH19268
2026-03-28 18:43:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf with identifier: PH19268
2026-03-28 18:43:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf with identifier: PH19268 to the API
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:09:40Z',
 'fuel_type': 'petrol',
 'id': 'd7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH19268',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 143362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-11',
 'seller_name': None,
 'title': 'Suzuki Swift 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2007}
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH19268%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Saving data for PH19268: {'auction_closing_time': 1774883380.0, 'created_time': 1774032198.291858, 'last_price_update_time': 1774723386.525167}
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH19268') HTTP/1.1" 204 0
2026-03-28 18:43:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:06 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 6009 | hits on page: 40
2026-03-28 18:43:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21d48e29-2624-5dd5-9f06-ff897585b51b with identifier: PW96816
2026-03-28 18:43:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21d48e29-2624-5dd5-9f06-ff897585b51b with scrape type 1
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21d48e29-2624-5dd5-9f06-ff897585b51b
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb8%252Fd8b8e96b43d936ada97f156e6a348983%252Fpa%252FPW96816_dfbd0427f827b561ff071151cd274879.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_dfbd0427f827b561ff071151cd274879.jpg already downloaded
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb8%252Fd8b8e96b43d936ada97f156e6a348983%252Fpa%252FPW96816_1320192ee412a14048a1fe906be61ae1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_1320192ee412a14048a1fe906be61ae1.jpg already downloaded
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb8%252Fd8b8e96b43d936ada97f156e6a348983%252Fpa%252FPW96816_e3f70f378e2bfd16a1674bff62aedce0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_e3f70f378e2bfd16a1674bff62aedce0.jpg already downloaded
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb8%252Fd8b8e96b43d936ada97f156e6a348983%252Fpa%252FPW96816_dac239d3916726d5609a08121236cce4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_dac239d3916726d5609a08121236cce4.jpg already downloaded
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb8%252Fd8b8e96b43d936ada97f156e6a348983%252Fpa%252FPW96816_ae7af015e384b4381458a1e28c3fb63b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_ae7af015e384b4381458a1e28c3fb63b.jpg already downloaded
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb8%252Fd8b8e96b43d936ada97f156e6a348983%252Fpa%252FPW96816_5b930580924d99478afb688321dabf0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_5b930580924d99478afb688321dabf0b.jpg already downloaded
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb8%252Fd8b8e96b43d936ada97f156e6a348983%252Fpa%252FPW96816_68e9a0649e7fcc8ac8bae2c097ede326.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_68e9a0649e7fcc8ac8bae2c097ede326.jpg already downloaded
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb8%252Fd8b8e96b43d936ada97f156e6a348983%252Fpa%252FPW96816_659e5ccdde524ed6a2b29cb76f220bd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_659e5ccdde524ed6a2b29cb76f220bd3.jpg already downloaded
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb8%252Fd8b8e96b43d936ada97f156e6a348983%252Fpa%252FPW96816_67ff890b7911f0fd74b0c19f45071d17.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_67ff890b7911f0fd74b0c19f45071d17.jpg already downloaded
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb8%252Fd8b8e96b43d936ada97f156e6a348983%252Fpa%252FPW96816_1f5b1c2a00cb80696181f2f75c48f48d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_1f5b1c2a00cb80696181f2f75c48f48d.jpg already downloaded
2026-03-28 18:43:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21d48e29-2624-5dd5-9f06-ff897585b51b, identifier: PW96816
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: ZS99681
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: PU80535
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU80535%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for PU80535: 1
2026-03-28 18:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU61936> (referer: https://www.auto1.com/v1/car-details-view/JU61936/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP15722> (referer: https://www.auto1.com/v1/car-details-view/BP15722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21d48e29-2624-5dd5-9f06-ff897585b51b with identifier: PW96816
2026-03-28 18:43:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21d48e29-2624-5dd5-9f06-ff897585b51b with identifier: PW96816
2026-03-28 18:43:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21d48e29-2624-5dd5-9f06-ff897585b51b with identifier: PW96816 to the API
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PW96816>
{'auction_title': '',
 'c_o_2_emission_value': 181,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:50:01Z',
 'fuel_type': 'diesel',
 'id': '21d48e29-2624-5dd5-9f06-ff897585b51b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW96816',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 134005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_dfbd0427f827b561ff071151cd274879.jpg',
                'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_1320192ee412a14048a1fe906be61ae1.jpg',
                'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_e3f70f378e2bfd16a1674bff62aedce0.jpg',
                'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_dac239d3916726d5609a08121236cce4.jpg',
                'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_ae7af015e384b4381458a1e28c3fb63b.jpg',
                'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_5b930580924d99478afb688321dabf0b.jpg',
                'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_68e9a0649e7fcc8ac8bae2c097ede326.jpg',
                'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_659e5ccdde524ed6a2b29cb76f220bd3.jpg',
                'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_67ff890b7911f0fd74b0c19f45071d17.jpg',
                'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_1f5b1c2a00cb80696181f2f75c48f48d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21d48e29-2624-5dd5-9f06-ff897585b51b/21d48e29-2624-5dd5-9f06-ff897585b51b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3425969,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_dfbd0427f827b561ff071151cd274879.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21d48e29-2624-5dd5-9f06-ff897585b51b/21d48e29-2624-5dd5-9f06-ff897585b51b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3469691,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_1320192ee412a14048a1fe906be61ae1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21d48e29-2624-5dd5-9f06-ff897585b51b/21d48e29-2624-5dd5-9f06-ff897585b51b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3299766,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_e3f70f378e2bfd16a1674bff62aedce0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21d48e29-2624-5dd5-9f06-ff897585b51b/21d48e29-2624-5dd5-9f06-ff897585b51b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_dac239d3916726d5609a08121236cce4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21d48e29-2624-5dd5-9f06-ff897585b51b/21d48e29-2624-5dd5-9f06-ff897585b51b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2970295,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_ae7af015e384b4381458a1e28c3fb63b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21d48e29-2624-5dd5-9f06-ff897585b51b/21d48e29-2624-5dd5-9f06-ff897585b51b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3191124,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_5b930580924d99478afb688321dabf0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21d48e29-2624-5dd5-9f06-ff897585b51b/21d48e29-2624-5dd5-9f06-ff897585b51b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3270602,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_68e9a0649e7fcc8ac8bae2c097ede326.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21d48e29-2624-5dd5-9f06-ff897585b51b/21d48e29-2624-5dd5-9f06-ff897585b51b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3463487,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_659e5ccdde524ed6a2b29cb76f220bd3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21d48e29-2624-5dd5-9f06-ff897585b51b/21d48e29-2624-5dd5-9f06-ff897585b51b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3250300,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_67ff890b7911f0fd74b0c19f45071d17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21d48e29-2624-5dd5-9f06-ff897585b51b/21d48e29-2624-5dd5-9f06-ff897585b51b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2844663,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b8/d8b8e96b43d936ada97f156e6a348983/pa/PW96816_1f5b1c2a00cb80696181f2f75c48f48d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-10',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Trend',
 'transmission': 'automatic',
 'trim': '320 L1 Trend',
 'year': 2018}
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW96816%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [auto1.de] INFO: Saving data for PW96816: {'created_time': 1774723387.2015, 'last_price_update_time': 1774723387.20151, 'auction_closing_time': 1774885801.0}
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW96816') HTTP/1.1" 204 0
2026-03-28 18:43:07 [scrapy.extensions.logstats] INFO: Crawled 201 pages (at 32 pages/min), scraped 521 items (at 76 items/min)
2026-03-28 18:43:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-28 18:43:07 [auto1.de] INFO: Found listing with ID: TH39634
2026-03-28 18:43:07 [auto1.de] INFO: Found listing with ID: MY94359
2026-03-28 18:43:07 [auto1.de] INFO: Found listing with ID: FZ92426
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ92426%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [auto1.de] INFO: Scrape type for FZ92426: 1
2026-03-28 18:43:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:07 [auto1.de] INFO: Found listing with ID: AN91174
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN91174%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [auto1.de] INFO: Scrape type for AN91174: 2
2026-03-28 18:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa975e98-e574-5d82-a43b-60ac841a91e2 with identifier: AN91174
2026-03-28 18:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa975e98-e574-5d82-a43b-60ac841a91e2 with scrape type 2
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa975e98-e574-5d82-a43b-60ac841a91e2 with scrape type 2
2026-03-28 18:43:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa975e98-e574-5d82-a43b-60ac841a91e2, identifier: AN91174
2026-03-28 18:43:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa975e98-e574-5d82-a43b-60ac841a91e2 with identifier: AN91174
2026-03-28 18:43:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa975e98-e574-5d82-a43b-60ac841a91e2 with identifier: AN91174
2026-03-28 18:43:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa975e98-e574-5d82-a43b-60ac841a91e2 with identifier: AN91174 to the API
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-30T15:17:19Z',
 'fuel_type': 'petrol',
 'id': 'aa975e98-e574-5d82-a43b-60ac841a91e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN91174',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 91937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
 'transmission': 'automatic',
 'trim': 'GTI TCR',
 'year': 2019}
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN91174%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [auto1.de] INFO: Saving data for AN91174: {'auction_closing_time': 1774883839.0, 'created_time': 1774035509.919991, 'last_price_update_time': 1774723387.733917}
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN91174') HTTP/1.1" 204 0
2026-03-28 18:43:07 [auto1.de] INFO: Found listing with ID: RE77380
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE77380%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [auto1.de] INFO: Scrape type for RE77380: 1
2026-03-28 18:43:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b39126-8880-5af3-bfae-3e9b86b14547 with identifier: MU41228
2026-03-28 18:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b39126-8880-5af3-bfae-3e9b86b14547 with scrape type 1
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 15b39126-8880-5af3-bfae-3e9b86b14547
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Ff7%252F50f758218d52c2b38028b4db3808ab48%252Fpa%252FMU41228_d9f143e2a91c4d2fc080e29e0e49fa57.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_d9f143e2a91c4d2fc080e29e0e49fa57.jpg already downloaded
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Ff7%252F50f758218d52c2b38028b4db3808ab48%252Fpa%252FMU41228_866ec1278eee97674d60d025a96ab4fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_866ec1278eee97674d60d025a96ab4fa.jpg already downloaded
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Ff7%252F50f758218d52c2b38028b4db3808ab48%252Fpa%252FMU41228_24996451654a0855d6653e60f3f2d93d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_24996451654a0855d6653e60f3f2d93d.jpg already downloaded
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Ff7%252F50f758218d52c2b38028b4db3808ab48%252Fpa%252FMU41228_e7c33f99192e331cda90f21cab754b07.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_e7c33f99192e331cda90f21cab754b07.jpg already downloaded
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Ff7%252F50f758218d52c2b38028b4db3808ab48%252Fpa%252FMU41228_bbbf5bdb8508c029b43db86ca3c07d6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_bbbf5bdb8508c029b43db86ca3c07d6b.jpg already downloaded
2026-03-28 18:43:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15b39126-8880-5af3-bfae-3e9b86b14547, identifier: MU41228
2026-03-28 18:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb1bf0bf-fc4c-5c64-a965-a3459921a58e with identifier: JU61936
2026-03-28 18:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb1bf0bf-fc4c-5c64-a965-a3459921a58e with scrape type 1
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb1bf0bf-fc4c-5c64-a965-a3459921a58e
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fa9%252F71a92926736220bcea09867fd7eda0e7%252Fpa%252FJU61936_2a5a4fe1911f44e22c3fb29ebcc3ef18.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_2a5a4fe1911f44e22c3fb29ebcc3ef18.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fa9%252F71a92926736220bcea09867fd7eda0e7%252Fpa%252FJU61936_e52535e91420f1818f4da170f0904d38.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_e52535e91420f1818f4da170f0904d38.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fa9%252F71a92926736220bcea09867fd7eda0e7%252Fpa%252FJU61936_53ead034dcb0c599d308490a42154e6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_53ead034dcb0c599d308490a42154e6a.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fa9%252F71a92926736220bcea09867fd7eda0e7%252Fpa%252FJU61936_877cfac04c6c7691c6cd205113431fd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_877cfac04c6c7691c6cd205113431fd2.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fa9%252F71a92926736220bcea09867fd7eda0e7%252Fpa%252FJU61936_98560b9d3eb19f65858870b4d2352bb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_98560b9d3eb19f65858870b4d2352bb0.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fa9%252F71a92926736220bcea09867fd7eda0e7%252Fpa%252FJU61936_e721480f959b4ffadf115834e4d9ec88.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_e721480f959b4ffadf115834e4d9ec88.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fa9%252F71a92926736220bcea09867fd7eda0e7%252Fpa%252FJU61936_b7228067b3cf5fa7a21832274c34fcb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_b7228067b3cf5fa7a21832274c34fcb7.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fa9%252F71a92926736220bcea09867fd7eda0e7%252Fpa%252FJU61936_d4aea9ade747f8ed66f55d2b2a499f25.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_d4aea9ade747f8ed66f55d2b2a499f25.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fa9%252F71a92926736220bcea09867fd7eda0e7%252Fpa%252FJU61936_9d250750aacd6a4dc21146b75c71b67d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_9d250750aacd6a4dc21146b75c71b67d.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fa9%252F71a92926736220bcea09867fd7eda0e7%252Fpa%252FJU61936_320205078a7880d5afb666ad0decf8d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_320205078a7880d5afb666ad0decf8d6.jpg already downloaded
2026-03-28 18:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb1bf0bf-fc4c-5c64-a965-a3459921a58e, identifier: JU61936
2026-03-28 18:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 028472ce-5239-552b-a1ef-ba45981de032 with identifier: BP15722
2026-03-28 18:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 028472ce-5239-552b-a1ef-ba45981de032 with scrape type 1
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 028472ce-5239-552b-a1ef-ba45981de032
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F03%252F8b03e9ba3d0572b5b035c6a974ac9442%252Fpa%252FBP15722_e66d9d8b4c192b95a9304684f31001db.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_e66d9d8b4c192b95a9304684f31001db.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F03%252F8b03e9ba3d0572b5b035c6a974ac9442%252Fpa%252FBP15722_d22c90008a3766a5167f64858dbe0741.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_d22c90008a3766a5167f64858dbe0741.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F03%252F8b03e9ba3d0572b5b035c6a974ac9442%252Fpa%252FBP15722_39ce4b64b0945174e5c555778c58483f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_39ce4b64b0945174e5c555778c58483f.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F03%252F8b03e9ba3d0572b5b035c6a974ac9442%252Fpa%252FBP15722_cff62531162119b73160174f3992e061.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_cff62531162119b73160174f3992e061.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F03%252F8b03e9ba3d0572b5b035c6a974ac9442%252Fpa%252FBP15722_2d6849e895b4d9b0bf0895b0b5fe4ab1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_2d6849e895b4d9b0bf0895b0b5fe4ab1.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F03%252F8b03e9ba3d0572b5b035c6a974ac9442%252Fpa%252FBP15722_6ea48e86e0e687d57173b9f644668eed.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_6ea48e86e0e687d57173b9f644668eed.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F03%252F8b03e9ba3d0572b5b035c6a974ac9442%252Fpa%252FBP15722_93247ebb9b1f4e0e91500e25b24661f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_93247ebb9b1f4e0e91500e25b24661f9.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F03%252F8b03e9ba3d0572b5b035c6a974ac9442%252Fpa%252FBP15722_8dab971a1a31d0a2451d4eac6ad0cb0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_8dab971a1a31d0a2451d4eac6ad0cb0b.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F03%252F8b03e9ba3d0572b5b035c6a974ac9442%252Fpa%252FBP15722_687687c5cf27ff0cfedf23a62b8c91b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_687687c5cf27ff0cfedf23a62b8c91b1.jpg already downloaded
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F03%252F8b03e9ba3d0572b5b035c6a974ac9442%252Fpa%252FBP15722_33fb8ebf95004c6cbb9679f2d3bbd874.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_33fb8ebf95004c6cbb9679f2d3bbd874.jpg already downloaded
2026-03-28 18:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 028472ce-5239-552b-a1ef-ba45981de032, identifier: BP15722
2026-03-28 18:43:08 [auto1.de] INFO: Found listing with ID: AF19813
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF19813%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [auto1.de] INFO: Scrape type for AF19813: 1
2026-03-28 18:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15b39126-8880-5af3-bfae-3e9b86b14547 with identifier: MU41228
2026-03-28 18:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15b39126-8880-5af3-bfae-3e9b86b14547 with identifier: MU41228
2026-03-28 18:43:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15b39126-8880-5af3-bfae-3e9b86b14547 with identifier: MU41228 to the API
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MU41228>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:24:58Z',
 'fuel_type': 'diesel',
 'id': '15b39126-8880-5af3-bfae-3e9b86b14547',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU41228',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 304254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_d9f143e2a91c4d2fc080e29e0e49fa57.jpg',
                'https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_866ec1278eee97674d60d025a96ab4fa.jpg',
                'https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_24996451654a0855d6653e60f3f2d93d.jpg',
                'https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_e7c33f99192e331cda90f21cab754b07.jpg',
                'https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_bbbf5bdb8508c029b43db86ca3c07d6b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b39126-8880-5af3-bfae-3e9b86b14547/15b39126-8880-5af3-bfae-3e9b86b14547_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_d9f143e2a91c4d2fc080e29e0e49fa57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b39126-8880-5af3-bfae-3e9b86b14547/15b39126-8880-5af3-bfae-3e9b86b14547_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_866ec1278eee97674d60d025a96ab4fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b39126-8880-5af3-bfae-3e9b86b14547/15b39126-8880-5af3-bfae-3e9b86b14547_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_24996451654a0855d6653e60f3f2d93d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b39126-8880-5af3-bfae-3e9b86b14547/15b39126-8880-5af3-bfae-3e9b86b14547_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_e7c33f99192e331cda90f21cab754b07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15b39126-8880-5af3-bfae-3e9b86b14547/15b39126-8880-5af3-bfae-3e9b86b14547_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/f7/50f758218d52c2b38028b4db3808ab48/pa/MU41228_bbbf5bdb8508c029b43db86ca3c07d6b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Origin',
 'transmission': 'manual',
 'trim': 'Origin',
 'year': 2009}
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU41228%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [auto1.de] INFO: Saving data for MU41228: {'created_time': 1774723388.870135, 'last_price_update_time': 1774723388.870146, 'auction_closing_time': 1774884298.0}
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU41228') HTTP/1.1" 204 0
2026-03-28 18:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb1bf0bf-fc4c-5c64-a965-a3459921a58e with identifier: JU61936
2026-03-28 18:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb1bf0bf-fc4c-5c64-a965-a3459921a58e with identifier: JU61936
2026-03-28 18:43:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb1bf0bf-fc4c-5c64-a965-a3459921a58e with identifier: JU61936 to the API
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JU61936>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:25:06Z',
 'fuel_type': 'petrol',
 'id': 'bb1bf0bf-fc4c-5c64-a965-a3459921a58e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU61936',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 143765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_2a5a4fe1911f44e22c3fb29ebcc3ef18.jpg',
                'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_e52535e91420f1818f4da170f0904d38.jpg',
                'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_53ead034dcb0c599d308490a42154e6a.jpg',
                'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_877cfac04c6c7691c6cd205113431fd2.jpg',
                'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_98560b9d3eb19f65858870b4d2352bb0.jpg',
                'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_e721480f959b4ffadf115834e4d9ec88.jpg',
                'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_b7228067b3cf5fa7a21832274c34fcb7.jpg',
                'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_d4aea9ade747f8ed66f55d2b2a499f25.jpg',
                'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_9d250750aacd6a4dc21146b75c71b67d.jpg',
                'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_320205078a7880d5afb666ad0decf8d6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1bf0bf-fc4c-5c64-a965-a3459921a58e/bb1bf0bf-fc4c-5c64-a965-a3459921a58e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3704922,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_2a5a4fe1911f44e22c3fb29ebcc3ef18.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1bf0bf-fc4c-5c64-a965-a3459921a58e/bb1bf0bf-fc4c-5c64-a965-a3459921a58e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3478459,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_e52535e91420f1818f4da170f0904d38.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1bf0bf-fc4c-5c64-a965-a3459921a58e/bb1bf0bf-fc4c-5c64-a965-a3459921a58e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3190721,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_53ead034dcb0c599d308490a42154e6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1bf0bf-fc4c-5c64-a965-a3459921a58e/bb1bf0bf-fc4c-5c64-a965-a3459921a58e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3244243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_877cfac04c6c7691c6cd205113431fd2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1bf0bf-fc4c-5c64-a965-a3459921a58e/bb1bf0bf-fc4c-5c64-a965-a3459921a58e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_98560b9d3eb19f65858870b4d2352bb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1bf0bf-fc4c-5c64-a965-a3459921a58e/bb1bf0bf-fc4c-5c64-a965-a3459921a58e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3190269,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_e721480f959b4ffadf115834e4d9ec88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1bf0bf-fc4c-5c64-a965-a3459921a58e/bb1bf0bf-fc4c-5c64-a965-a3459921a58e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2953927,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_b7228067b3cf5fa7a21832274c34fcb7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1bf0bf-fc4c-5c64-a965-a3459921a58e/bb1bf0bf-fc4c-5c64-a965-a3459921a58e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_d4aea9ade747f8ed66f55d2b2a499f25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1bf0bf-fc4c-5c64-a965-a3459921a58e/bb1bf0bf-fc4c-5c64-a965-a3459921a58e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3486692,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_9d250750aacd6a4dc21146b75c71b67d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1bf0bf-fc4c-5c64-a965-a3459921a58e/bb1bf0bf-fc4c-5c64-a965-a3459921a58e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/a9/71a92926736220bcea09867fd7eda0e7/pa/JU61936_320205078a7880d5afb666ad0decf8d6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Style BlueMotion',
 'transmission': 'manual',
 'trim': 'Style BlueMotion',
 'year': 2011}
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU61936%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Saving data for JU61936: {'created_time': 1774723389.354714, 'last_price_update_time': 1774723389.354729, 'auction_closing_time': 1774884306.0}
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU61936') HTTP/1.1" 204 0
2026-03-28 18:43:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 028472ce-5239-552b-a1ef-ba45981de032 with identifier: BP15722
2026-03-28 18:43:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 028472ce-5239-552b-a1ef-ba45981de032 with identifier: BP15722
2026-03-28 18:43:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 028472ce-5239-552b-a1ef-ba45981de032 with identifier: BP15722 to the API
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BP15722>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:37:29Z',
 'fuel_type': 'petrol',
 'id': '028472ce-5239-552b-a1ef-ba45981de032',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP15722',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 187029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_e66d9d8b4c192b95a9304684f31001db.jpg',
                'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_d22c90008a3766a5167f64858dbe0741.jpg',
                'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_39ce4b64b0945174e5c555778c58483f.jpg',
                'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_cff62531162119b73160174f3992e061.jpg',
                'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_2d6849e895b4d9b0bf0895b0b5fe4ab1.jpg',
                'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_6ea48e86e0e687d57173b9f644668eed.jpg',
                'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_93247ebb9b1f4e0e91500e25b24661f9.jpg',
                'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_8dab971a1a31d0a2451d4eac6ad0cb0b.jpg',
                'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_687687c5cf27ff0cfedf23a62b8c91b1.jpg',
                'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_33fb8ebf95004c6cbb9679f2d3bbd874.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028472ce-5239-552b-a1ef-ba45981de032/028472ce-5239-552b-a1ef-ba45981de032_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3129900,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_e66d9d8b4c192b95a9304684f31001db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028472ce-5239-552b-a1ef-ba45981de032/028472ce-5239-552b-a1ef-ba45981de032_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_d22c90008a3766a5167f64858dbe0741.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028472ce-5239-552b-a1ef-ba45981de032/028472ce-5239-552b-a1ef-ba45981de032_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_39ce4b64b0945174e5c555778c58483f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028472ce-5239-552b-a1ef-ba45981de032/028472ce-5239-552b-a1ef-ba45981de032_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2871594,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_cff62531162119b73160174f3992e061.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028472ce-5239-552b-a1ef-ba45981de032/028472ce-5239-552b-a1ef-ba45981de032_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2812327,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_2d6849e895b4d9b0bf0895b0b5fe4ab1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028472ce-5239-552b-a1ef-ba45981de032/028472ce-5239-552b-a1ef-ba45981de032_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2826609,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_6ea48e86e0e687d57173b9f644668eed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028472ce-5239-552b-a1ef-ba45981de032/028472ce-5239-552b-a1ef-ba45981de032_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2842127,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_93247ebb9b1f4e0e91500e25b24661f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028472ce-5239-552b-a1ef-ba45981de032/028472ce-5239-552b-a1ef-ba45981de032_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_8dab971a1a31d0a2451d4eac6ad0cb0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028472ce-5239-552b-a1ef-ba45981de032/028472ce-5239-552b-a1ef-ba45981de032_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_687687c5cf27ff0cfedf23a62b8c91b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_028472ce-5239-552b-a1ef-ba45981de032/028472ce-5239-552b-a1ef-ba45981de032_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2778334,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/03/8b03e9ba3d0572b5b035c6a974ac9442/pa/BP15722_33fb8ebf95004c6cbb9679f2d3bbd874.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2010}
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP15722%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Saving data for BP15722: {'created_time': 1774723389.736258, 'last_price_update_time': 1774723389.736272, 'auction_closing_time': 1774885049.0}
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP15722') HTTP/1.1" 204 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: ZS85048
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: ZY92659
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: DK37949
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: ZY32657
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY32657%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for ZY32657: 1
2026-03-28 18:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ96267> (referer: https://www.auto1.com/v1/car-details-view/YJ96267/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM78340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW63260/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: DK08847
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08847%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for DK08847: 2
2026-03-28 18:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e with identifier: DK08847
2026-03-28 18:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e with scrape type 2
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e with scrape type 2
2026-03-28 18:43:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e, identifier: DK08847
2026-03-28 18:43:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e with identifier: DK08847
2026-03-28 18:43:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e with identifier: DK08847
2026-03-28 18:43:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e with identifier: DK08847 to the API
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:03:13Z',
 'fuel_type': 'diesel',
 'id': '5ff7d604-859c-5d1c-aaa9-25d8eff6c39e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK08847',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 180898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-10',
 'seller_name': None,
 'title': 'BMW 3er 320d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2016}
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08847%27 HTTP/1.1" 200 None
2026-03-28 18:43:10 [auto1.de] INFO: Saving data for DK08847: {'auction_closing_time': 1774882993.0, 'created_time': 1773429294.650338, 'last_price_update_time': 1774723390.253361}
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK08847') HTTP/1.1" 204 0
2026-03-28 18:43:10 [auto1.de] INFO: Found listing with ID: RF12873
2026-03-28 18:43:10 [auto1.de] INFO: Found listing with ID: WK31693
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK31693%27 HTTP/1.1" 200 None
2026-03-28 18:43:10 [auto1.de] INFO: Scrape type for WK31693: 1
2026-03-28 18:43:10 [auto1.de] INFO: Found listing with ID: JB87569
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB87569%27 HTTP/1.1" 200 None
2026-03-28 18:43:10 [auto1.de] INFO: Scrape type for JB87569: 2
2026-03-28 18:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46d4d1f-223a-5808-aa67-4217f9c6d7b0 with identifier: JB87569
2026-03-28 18:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46d4d1f-223a-5808-aa67-4217f9c6d7b0 with scrape type 2
2026-03-28 18:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46d4d1f-223a-5808-aa67-4217f9c6d7b0 with scrape type 2
2026-03-28 18:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c46d4d1f-223a-5808-aa67-4217f9c6d7b0, identifier: JB87569
2026-03-28 18:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c46d4d1f-223a-5808-aa67-4217f9c6d7b0 with identifier: JB87569
2026-03-28 18:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c46d4d1f-223a-5808-aa67-4217f9c6d7b0 with identifier: JB87569
2026-03-28 18:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c46d4d1f-223a-5808-aa67-4217f9c6d7b0 with identifier: JB87569 to the API
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:57Z',
 'fuel_type': 'diesel',
 'id': 'c46d4d1f-223a-5808-aa67-4217f9c6d7b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB87569',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 136506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-01',
 'seller_name': None,
 'title': 'Mazda 3 2.2 Turbodiesel Exclusive-Line',
 'transmission': 'automatic',
 'trim': 'Exclusive-Line',
 'year': 2018}
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB87569%27 HTTP/1.1" 200 None
2026-03-28 18:43:10 [auto1.de] INFO: Saving data for JB87569: {'auction_closing_time': 1774884717.0, 'created_time': 1774035030.760261, 'last_price_update_time': 1774723390.776862}
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB87569') HTTP/1.1" 204 0
2026-03-28 18:43:10 [auto1.de] INFO: Found listing with ID: XR35811
2026-03-28 18:43:10 [auto1.de] INFO: Found listing with ID: WL69602
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL69602%27 HTTP/1.1" 200 None
2026-03-28 18:43:10 [auto1.de] INFO: Scrape type for WL69602: 2
2026-03-28 18:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 504fa8b7-c57e-55aa-862c-88e1f16bbad3 with identifier: WL69602
2026-03-28 18:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504fa8b7-c57e-55aa-862c-88e1f16bbad3 with scrape type 2
2026-03-28 18:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 504fa8b7-c57e-55aa-862c-88e1f16bbad3 with scrape type 2
2026-03-28 18:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 504fa8b7-c57e-55aa-862c-88e1f16bbad3, identifier: WL69602
2026-03-28 18:43:10 [auto1.de] INFO: Found listing with ID: EE75447
2026-03-28 18:43:10 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-28 18:43:10 [auto1.de] INFO: Found listing with ID: TA77613
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA77613%27 HTTP/1.1" 200 None
2026-03-28 18:43:10 [auto1.de] INFO: Scrape type for TA77613: 2
2026-03-28 18:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e with identifier: TA77613
2026-03-28 18:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e with scrape type 2
2026-03-28 18:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e with scrape type 2
2026-03-28 18:43:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e, identifier: TA77613
2026-03-28 18:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 504fa8b7-c57e-55aa-862c-88e1f16bbad3 with identifier: WL69602
2026-03-28 18:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 504fa8b7-c57e-55aa-862c-88e1f16bbad3 with identifier: WL69602
2026-03-28 18:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 504fa8b7-c57e-55aa-862c-88e1f16bbad3 with identifier: WL69602 to the API
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:20Z',
 'fuel_type': 'petrol',
 'id': '504fa8b7-c57e-55aa-862c-88e1f16bbad3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL69602',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 73972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-19',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT IQ.DRIVE',
 'transmission': 'automatic',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL69602%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [auto1.de] INFO: Saving data for WL69602: {'auction_closing_time': 1774885940.0, 'created_time': 1774032556.7934, 'last_price_update_time': 1774723391.389742}
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL69602') HTTP/1.1" 204 0
2026-03-28 18:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e with identifier: TA77613
2026-03-28 18:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e with identifier: TA77613
2026-03-28 18:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e with identifier: TA77613 to the API
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:19:03Z',
 'fuel_type': 'diesel',
 'id': '46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA77613',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 123932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-16',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 300 L2 Trend',
 'transmission': 'manual',
 'trim': '300 L2 Trend',
 'year': 2019}
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA77613%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [auto1.de] INFO: Saving data for TA77613: {'auction_closing_time': 1774883943.0, 'created_time': 1774350026.958277, 'last_price_update_time': 1774723391.85262}
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA77613') HTTP/1.1" 204 0
2026-03-28 18:43:11 [auto1.de] INFO: Found listing with ID: NC71734
2026-03-28 18:43:11 [auto1.de] INFO: Found listing with ID: XU03488
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU03488%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [auto1.de] INFO: Scrape type for XU03488: 1
2026-03-28 18:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e90c296e-02ed-5bbd-850c-17af6f33c829 with identifier: YJ96267
2026-03-28 18:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e90c296e-02ed-5bbd-850c-17af6f33c829 with scrape type 1
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e90c296e-02ed-5bbd-850c-17af6f33c829
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F90%252Ff290c159db7ac2a7e01be5e7f3290d87%252Fpa%252FYJ96267_f08e537521e7c40a5e13c6ff953212af.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_f08e537521e7c40a5e13c6ff953212af.jpg already downloaded
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F90%252Ff290c159db7ac2a7e01be5e7f3290d87%252Fpa%252FYJ96267_4348cf99852cc7f3084e3b9ec0731e84.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_4348cf99852cc7f3084e3b9ec0731e84.jpg already downloaded
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F90%252Ff290c159db7ac2a7e01be5e7f3290d87%252Fpa%252FYJ96267_b49e70b9e5cd5a56f6810364a4e14684.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_b49e70b9e5cd5a56f6810364a4e14684.jpg already downloaded
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F90%252Ff290c159db7ac2a7e01be5e7f3290d87%252Fpa%252FYJ96267_c5a6a469f707af5a396e2da2f4182094.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_c5a6a469f707af5a396e2da2f4182094.jpg already downloaded
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F90%252Ff290c159db7ac2a7e01be5e7f3290d87%252Fpa%252FYJ96267_9ed15fe47b3cdcdb507c3a42b194444a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_9ed15fe47b3cdcdb507c3a42b194444a.jpg already downloaded
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F90%252Ff290c159db7ac2a7e01be5e7f3290d87%252Fpa%252FYJ96267_771db89396d57543204a0bb46c75c068.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_771db89396d57543204a0bb46c75c068.jpg already downloaded
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F90%252Ff290c159db7ac2a7e01be5e7f3290d87%252Fpa%252FYJ96267_657172acda284f65ed05e6655516b9eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_657172acda284f65ed05e6655516b9eb.jpg already downloaded
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F90%252Ff290c159db7ac2a7e01be5e7f3290d87%252Fpa%252FYJ96267_0e329a0c1451c0b2204695706fff8b6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_0e329a0c1451c0b2204695706fff8b6a.jpg already downloaded
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F90%252Ff290c159db7ac2a7e01be5e7f3290d87%252Fpa%252FYJ96267_4b14a58bea8dd2dc51efd20a6e404ac7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_4b14a58bea8dd2dc51efd20a6e404ac7.jpg already downloaded
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F90%252Ff290c159db7ac2a7e01be5e7f3290d87%252Fpa%252FYJ96267_26454339b3e262c832bbb873714c2099.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_26454339b3e262c832bbb873714c2099.jpg already downloaded
2026-03-28 18:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e90c296e-02ed-5bbd-850c-17af6f33c829, identifier: YJ96267
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: DW77268
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77268%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for DW77268: 1
2026-03-28 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP86172/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e90c296e-02ed-5bbd-850c-17af6f33c829 with identifier: YJ96267
2026-03-28 18:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e90c296e-02ed-5bbd-850c-17af6f33c829 with identifier: YJ96267
2026-03-28 18:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e90c296e-02ed-5bbd-850c-17af6f33c829 with identifier: YJ96267 to the API
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YJ96267>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:17:28Z',
 'fuel_type': 'diesel',
 'id': 'e90c296e-02ed-5bbd-850c-17af6f33c829',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ96267',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'BMW',
 'model': '2er',
 'odometer': 74291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_f08e537521e7c40a5e13c6ff953212af.jpg',
                'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_4348cf99852cc7f3084e3b9ec0731e84.jpg',
                'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_b49e70b9e5cd5a56f6810364a4e14684.jpg',
                'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_c5a6a469f707af5a396e2da2f4182094.jpg',
                'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_9ed15fe47b3cdcdb507c3a42b194444a.jpg',
                'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_771db89396d57543204a0bb46c75c068.jpg',
                'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_657172acda284f65ed05e6655516b9eb.jpg',
                'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_0e329a0c1451c0b2204695706fff8b6a.jpg',
                'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_4b14a58bea8dd2dc51efd20a6e404ac7.jpg',
                'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_26454339b3e262c832bbb873714c2099.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e90c296e-02ed-5bbd-850c-17af6f33c829/e90c296e-02ed-5bbd-850c-17af6f33c829_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3045592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_f08e537521e7c40a5e13c6ff953212af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e90c296e-02ed-5bbd-850c-17af6f33c829/e90c296e-02ed-5bbd-850c-17af6f33c829_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3023659,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_4348cf99852cc7f3084e3b9ec0731e84.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e90c296e-02ed-5bbd-850c-17af6f33c829/e90c296e-02ed-5bbd-850c-17af6f33c829_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3087343,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_b49e70b9e5cd5a56f6810364a4e14684.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e90c296e-02ed-5bbd-850c-17af6f33c829/e90c296e-02ed-5bbd-850c-17af6f33c829_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_c5a6a469f707af5a396e2da2f4182094.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e90c296e-02ed-5bbd-850c-17af6f33c829/e90c296e-02ed-5bbd-850c-17af6f33c829_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_9ed15fe47b3cdcdb507c3a42b194444a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e90c296e-02ed-5bbd-850c-17af6f33c829/e90c296e-02ed-5bbd-850c-17af6f33c829_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_771db89396d57543204a0bb46c75c068.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e90c296e-02ed-5bbd-850c-17af6f33c829/e90c296e-02ed-5bbd-850c-17af6f33c829_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_657172acda284f65ed05e6655516b9eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e90c296e-02ed-5bbd-850c-17af6f33c829/e90c296e-02ed-5bbd-850c-17af6f33c829_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3130906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_0e329a0c1451c0b2204695706fff8b6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e90c296e-02ed-5bbd-850c-17af6f33c829/e90c296e-02ed-5bbd-850c-17af6f33c829_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_4b14a58bea8dd2dc51efd20a6e404ac7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e90c296e-02ed-5bbd-850c-17af6f33c829/e90c296e-02ed-5bbd-850c-17af6f33c829_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/90/f290c159db7ac2a7e01be5e7f3290d87/pa/YJ96267_26454339b3e262c832bbb873714c2099.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-23',
 'seats_number': 7,
 'seller_name': None,
 'title': 'BMW 2er 220d Gran Tourer xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2020}
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ96267%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Saving data for YJ96267: {'created_time': 1774723392.569287, 'last_price_update_time': 1774723392.569301, 'auction_closing_time': 1774883848.0}
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ96267') HTTP/1.1" 204 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: JN07474
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: CT96582
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT96582%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for CT96582: 1
2026-03-28 18:43:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: SP96955
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: DJ18232
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ18232%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for DJ18232: 2
2026-03-28 18:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18e095dc-76d5-542e-ad86-0bbcbda00bc8 with identifier: DJ18232
2026-03-28 18:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18e095dc-76d5-542e-ad86-0bbcbda00bc8 with scrape type 2
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18e095dc-76d5-542e-ad86-0bbcbda00bc8 with scrape type 2
2026-03-28 18:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18e095dc-76d5-542e-ad86-0bbcbda00bc8, identifier: DJ18232
2026-03-28 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18e095dc-76d5-542e-ad86-0bbcbda00bc8 with identifier: DJ18232
2026-03-28 18:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18e095dc-76d5-542e-ad86-0bbcbda00bc8 with identifier: DJ18232
2026-03-28 18:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18e095dc-76d5-542e-ad86-0bbcbda00bc8 with identifier: DJ18232 to the API
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:37:43Z',
 'fuel_type': 'diesel',
 'id': '18e095dc-76d5-542e-ad86-0bbcbda00bc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ18232',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C6',
 'odometer': 193139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-23',
 'seller_name': None,
 'title': 'Citroen C6 2.7 V6 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2007}
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ18232%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [auto1.de] INFO: Saving data for DJ18232: {'auction_closing_time': 1774885063.0, 'created_time': 1773340730.026669, 'last_price_update_time': 1774723393.048288}
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ18232') HTTP/1.1" 204 0
2026-03-28 18:43:13 [auto1.de] INFO: Found listing with ID: XZ21442
2026-03-28 18:43:13 [auto1.de] INFO: Found listing with ID: EK71515
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK71515%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [auto1.de] INFO: Scrape type for EK71515: 2
2026-03-28 18:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3dbd7c2-b0ec-536c-84ea-1481aae7c765 with identifier: EK71515
2026-03-28 18:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3dbd7c2-b0ec-536c-84ea-1481aae7c765 with scrape type 2
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3dbd7c2-b0ec-536c-84ea-1481aae7c765 with scrape type 2
2026-03-28 18:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3dbd7c2-b0ec-536c-84ea-1481aae7c765, identifier: EK71515
2026-03-28 18:43:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS70589> (referer: https://www.auto1.com/v1/car-details-view/CS70589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:13 [auto1.de] INFO: Found listing with ID: RL54518
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL54518%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [auto1.de] INFO: Scrape type for RL54518: 2
2026-03-28 18:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0decc8e8-f0d5-573f-8287-e02d11350115 with identifier: RL54518
2026-03-28 18:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0decc8e8-f0d5-573f-8287-e02d11350115 with scrape type 2
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0decc8e8-f0d5-573f-8287-e02d11350115 with scrape type 2
2026-03-28 18:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0decc8e8-f0d5-573f-8287-e02d11350115, identifier: RL54518
2026-03-28 18:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3dbd7c2-b0ec-536c-84ea-1481aae7c765 with identifier: EK71515
2026-03-28 18:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3dbd7c2-b0ec-536c-84ea-1481aae7c765 with identifier: EK71515
2026-03-28 18:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3dbd7c2-b0ec-536c-84ea-1481aae7c765 with identifier: EK71515 to the API
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:21:41Z',
 'fuel_type': 'diesel',
 'id': 'e3dbd7c2-b0ec-536c-84ea-1481aae7c765',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK71515',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 385718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-01',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK71515%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [auto1.de] INFO: Saving data for EK71515: {'auction_closing_time': 1774884101.0, 'created_time': 1773381885.697415, 'last_price_update_time': 1774723393.660101}
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK71515') HTTP/1.1" 204 0
2026-03-28 18:43:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0decc8e8-f0d5-573f-8287-e02d11350115 with identifier: RL54518
2026-03-28 18:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0decc8e8-f0d5-573f-8287-e02d11350115 with identifier: RL54518
2026-03-28 18:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0decc8e8-f0d5-573f-8287-e02d11350115 with identifier: RL54518 to the API
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:22:57Z',
 'fuel_type': 'diesel',
 'id': '0decc8e8-f0d5-573f-8287-e02d11350115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL54518',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 31516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-05',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL54518%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [auto1.de] INFO: Saving data for RL54518: {'auction_closing_time': 1774884177.0, 'created_time': 1774349941.155665, 'last_price_update_time': 1774723394.007263}
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL54518') HTTP/1.1" 204 0
2026-03-28 18:43:14 [auto1.de] INFO: Found listing with ID: YE73742
2026-03-28 18:43:14 [auto1.de] INFO: Found listing with ID: CA87699
2026-03-28 18:43:14 [auto1.de] INFO: Found listing with ID: XU33519
2026-03-28 18:43:14 [auto1.de] INFO: Found listing with ID: HK31829
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK31829%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [auto1.de] INFO: Scrape type for HK31829: 2
2026-03-28 18:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1f58f49-a037-58ba-8a87-c7b75c1818d6 with identifier: HK31829
2026-03-28 18:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1f58f49-a037-58ba-8a87-c7b75c1818d6 with scrape type 2
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1f58f49-a037-58ba-8a87-c7b75c1818d6 with scrape type 2
2026-03-28 18:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1f58f49-a037-58ba-8a87-c7b75c1818d6, identifier: HK31829
2026-03-28 18:43:14 [auto1.de] INFO: Found listing with ID: GS31332
2026-03-28 18:43:14 [auto1.de] INFO: Found listing with ID: GS03100
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS03100%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [auto1.de] INFO: Scrape type for GS03100: 1
2026-03-28 18:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1f58f49-a037-58ba-8a87-c7b75c1818d6 with identifier: HK31829
2026-03-28 18:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1f58f49-a037-58ba-8a87-c7b75c1818d6 with identifier: HK31829
2026-03-28 18:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1f58f49-a037-58ba-8a87-c7b75c1818d6 with identifier: HK31829 to the API
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:14:31Z',
 'fuel_type': 'diesel',
 'id': 'd1f58f49-a037-58ba-8a87-c7b75c1818d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK31829',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 220923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-27',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2011}
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK31829%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [auto1.de] INFO: Saving data for HK31829: {'auction_closing_time': 1774883671.0, 'created_time': 1774350302.698907, 'last_price_update_time': 1774723394.509809}
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK31829') HTTP/1.1" 204 0
2026-03-28 18:43:14 [auto1.de] INFO: Found listing with ID: NK26673
2026-03-28 18:43:14 [auto1.de] INFO: Found listing with ID: XD40949
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD40949%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [auto1.de] INFO: Scrape type for XD40949: 1
2026-03-28 18:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND12794> (referer: https://www.auto1.com/v1/car-details-view/ND12794/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE00984> (referer: https://www.auto1.com/v1/car-details-view/CE00984/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:14 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 6009 | hits on page: 40
2026-03-28 18:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e25abb8-4370-5462-bcf6-373f9a4ab23a with identifier: CS70589
2026-03-28 18:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e25abb8-4370-5462-bcf6-373f9a4ab23a with scrape type 1
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7e25abb8-4370-5462-bcf6-373f9a4ab23a
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F61%252Fd261ec39b0612819aeceb53c33adec4f%252Fpa%252FCS70589_5676da22c7c1bae8fe82a001f35deafa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_5676da22c7c1bae8fe82a001f35deafa.jpg already downloaded
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F61%252Fd261ec39b0612819aeceb53c33adec4f%252Fpa%252FCS70589_cd7995db609d31141f0cf506dffa17c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_cd7995db609d31141f0cf506dffa17c9.jpg already downloaded
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F61%252Fd261ec39b0612819aeceb53c33adec4f%252Fpa%252FCS70589_0c91976e0a161ae30460f21f2c491c43.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_0c91976e0a161ae30460f21f2c491c43.jpg already downloaded
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F61%252Fd261ec39b0612819aeceb53c33adec4f%252Fpa%252FCS70589_7f380b75ef5fc410d5fd12c2371d2a9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_7f380b75ef5fc410d5fd12c2371d2a9a.jpg already downloaded
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F61%252Fd261ec39b0612819aeceb53c33adec4f%252Fpa%252FCS70589_ed83765858542b35cac8e13d5abdf617.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_ed83765858542b35cac8e13d5abdf617.jpg already downloaded
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F61%252Fd261ec39b0612819aeceb53c33adec4f%252Fpa%252FCS70589_88c7499e293c3476be6500eee52cedc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_88c7499e293c3476be6500eee52cedc8.jpg already downloaded
2026-03-28 18:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e25abb8-4370-5462-bcf6-373f9a4ab23a, identifier: CS70589
2026-03-28 18:43:14 [auto1.de] INFO: Found listing with ID: AM12815
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM12815%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [auto1.de] INFO: Scrape type for AM12815: 1
2026-03-28 18:43:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF19813/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ92426/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e25abb8-4370-5462-bcf6-373f9a4ab23a with identifier: CS70589
2026-03-28 18:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e25abb8-4370-5462-bcf6-373f9a4ab23a with identifier: CS70589
2026-03-28 18:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e25abb8-4370-5462-bcf6-373f9a4ab23a with identifier: CS70589 to the API
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CS70589>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:04:30Z',
 'fuel_type': 'petrol',
 'id': '7e25abb8-4370-5462-bcf6-373f9a4ab23a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS70589',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 233668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_5676da22c7c1bae8fe82a001f35deafa.jpg',
                'https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_cd7995db609d31141f0cf506dffa17c9.jpg',
                'https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_0c91976e0a161ae30460f21f2c491c43.jpg',
                'https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_7f380b75ef5fc410d5fd12c2371d2a9a.jpg',
                'https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_ed83765858542b35cac8e13d5abdf617.jpg',
                'https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_88c7499e293c3476be6500eee52cedc8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e25abb8-4370-5462-bcf6-373f9a4ab23a/7e25abb8-4370-5462-bcf6-373f9a4ab23a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_5676da22c7c1bae8fe82a001f35deafa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e25abb8-4370-5462-bcf6-373f9a4ab23a/7e25abb8-4370-5462-bcf6-373f9a4ab23a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_cd7995db609d31141f0cf506dffa17c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e25abb8-4370-5462-bcf6-373f9a4ab23a/7e25abb8-4370-5462-bcf6-373f9a4ab23a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_0c91976e0a161ae30460f21f2c491c43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e25abb8-4370-5462-bcf6-373f9a4ab23a/7e25abb8-4370-5462-bcf6-373f9a4ab23a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_7f380b75ef5fc410d5fd12c2371d2a9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e25abb8-4370-5462-bcf6-373f9a4ab23a/7e25abb8-4370-5462-bcf6-373f9a4ab23a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_ed83765858542b35cac8e13d5abdf617.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e25abb8-4370-5462-bcf6-373f9a4ab23a/7e25abb8-4370-5462-bcf6-373f9a4ab23a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/61/d261ec39b0612819aeceb53c33adec4f/pa/CS70589_88c7499e293c3476be6500eee52cedc8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 TomTom Edition',
 'transmission': 'manual',
 'trim': 'TomTom Edition',
 'year': 2012}
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS70589%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [auto1.de] INFO: Saving data for CS70589: {'created_time': 1774723395.286613, 'last_price_update_time': 1774723395.286622, 'auction_closing_time': 1774883070.0}
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS70589') HTTP/1.1" 204 0
2026-03-28 18:43:15 [auto1.de] INFO: Found listing with ID: NM76791
2026-03-28 18:43:15 [auto1.de] INFO: Found listing with ID: HA62575
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA62575%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [auto1.de] INFO: Scrape type for HA62575: 1
2026-03-28 18:43:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:15 [auto1.de] INFO: Found listing with ID: SA04539
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA04539%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [auto1.de] INFO: Scrape type for SA04539: 2
2026-03-28 18:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e50008ba-2bbe-5e83-b847-50ec08d70ddb with identifier: SA04539
2026-03-28 18:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e50008ba-2bbe-5e83-b847-50ec08d70ddb with scrape type 2
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e50008ba-2bbe-5e83-b847-50ec08d70ddb with scrape type 2
2026-03-28 18:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e50008ba-2bbe-5e83-b847-50ec08d70ddb, identifier: SA04539
2026-03-28 18:43:15 [auto1.de] INFO: Found listing with ID: FC21553
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC21553%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [auto1.de] INFO: Scrape type for FC21553: 1
2026-03-28 18:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e50008ba-2bbe-5e83-b847-50ec08d70ddb with identifier: SA04539
2026-03-28 18:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e50008ba-2bbe-5e83-b847-50ec08d70ddb with identifier: SA04539
2026-03-28 18:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e50008ba-2bbe-5e83-b847-50ec08d70ddb with identifier: SA04539 to the API
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:40:09Z',
 'fuel_type': 'petrol',
 'id': 'e50008ba-2bbe-5e83-b847-50ec08d70ddb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA04539',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 139614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-15',
 'seller_name': None,
 'title': 'Toyota Avensis 2.0 Executive Liftback',
 'transmission': 'manual',
 'trim': 'Executive Liftback',
 'year': 2003}
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA04539%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [auto1.de] INFO: Saving data for SA04539: {'auction_closing_time': 1774885209.0, 'created_time': 1773400806.793666, 'last_price_update_time': 1774723395.806074}
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA04539') HTTP/1.1" 204 0
2026-03-28 18:43:15 [auto1.de] INFO: Found listing with ID: AU44008
2026-03-28 18:43:15 [auto1.de] INFO: Found listing with ID: UN89180
2026-03-28 18:43:15 [auto1.de] INFO: Found listing with ID: WF14307
2026-03-28 18:43:15 [auto1.de] INFO: Found listing with ID: YH18669
2026-03-28 18:43:15 [auto1.de] INFO: Found listing with ID: EL96080
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL96080%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [auto1.de] INFO: Scrape type for EL96080: 1
2026-03-28 18:43:15 [auto1.de] INFO: Found listing with ID: KV17598
2026-03-28 18:43:15 [auto1.de] INFO: Found listing with ID: TV41751
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV41751%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [auto1.de] INFO: Scrape type for TV41751: 1
2026-03-28 18:43:15 [auto1.de] INFO: Found listing with ID: CT45397
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT45397%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [auto1.de] INFO: Scrape type for CT45397: 1
2026-03-28 18:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e2c115-6248-547a-b360-0908d130dbf2 with identifier: ND12794
2026-03-28 18:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e2c115-6248-547a-b360-0908d130dbf2 with scrape type 1
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89e2c115-6248-547a-b360-0908d130dbf2
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F9c%252F229c56aeb5ac9585962d9d3758546dbb%252Fpa%252FND12794_a0195777d4080fd14145576482549bf5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_a0195777d4080fd14145576482549bf5.jpg already downloaded
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F9c%252F229c56aeb5ac9585962d9d3758546dbb%252Fpa%252FND12794_2d4b9fa3a938f16c3a34b7fa707e737f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_2d4b9fa3a938f16c3a34b7fa707e737f.jpg already downloaded
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F9c%252F229c56aeb5ac9585962d9d3758546dbb%252Fpa%252FND12794_6e9e3b2f7cf1ba042e5874507b8af3bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_6e9e3b2f7cf1ba042e5874507b8af3bf.jpg already downloaded
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F9c%252F229c56aeb5ac9585962d9d3758546dbb%252Fpa%252FND12794_4754d83458b806f29057149463a2259b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_4754d83458b806f29057149463a2259b.jpg already downloaded
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F9c%252F229c56aeb5ac9585962d9d3758546dbb%252Fpa%252FND12794_93eb98ff998af092bb6868de21687211.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_93eb98ff998af092bb6868de21687211.jpg already downloaded
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F9c%252F229c56aeb5ac9585962d9d3758546dbb%252Fpa%252FND12794_0954686081784267f02b7be6f840c828.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_0954686081784267f02b7be6f840c828.jpg already downloaded
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F9c%252F229c56aeb5ac9585962d9d3758546dbb%252Fpa%252FND12794_280f6c27c3459e0b4b89e5dbd69d2adf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_280f6c27c3459e0b4b89e5dbd69d2adf.jpg already downloaded
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F9c%252F229c56aeb5ac9585962d9d3758546dbb%252Fpa%252FND12794_a1dbaf98f3b43d6135175bc2dbeaf45d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_a1dbaf98f3b43d6135175bc2dbeaf45d.jpg already downloaded
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F9c%252F229c56aeb5ac9585962d9d3758546dbb%252Fpa%252FND12794_5e970fcb4f6eeb5cf1ce0f1085f120ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_5e970fcb4f6eeb5cf1ce0f1085f120ca.jpg already downloaded
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F9c%252F229c56aeb5ac9585962d9d3758546dbb%252Fpa%252FND12794_8633a370e80fb1b7ba0dbd7e6691b192.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_8633a370e80fb1b7ba0dbd7e6691b192.jpg already downloaded
2026-03-28 18:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89e2c115-6248-547a-b360-0908d130dbf2, identifier: ND12794
2026-03-28 18:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91421c51-844c-5260-bc5c-579c13056393 with identifier: CE00984
2026-03-28 18:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91421c51-844c-5260-bc5c-579c13056393 with scrape type 1
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 91421c51-844c-5260-bc5c-579c13056393
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F0b%252Fc00b4dac0772e27c36df9a6c8cf1a0c7%252Fpa%252FCE00984_413719af4224c20d09af54276f939312.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_413719af4224c20d09af54276f939312.jpg already downloaded
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F0b%252Fc00b4dac0772e27c36df9a6c8cf1a0c7%252Fpa%252FCE00984_d3712d49d62c4e1d090078e0fdc9952f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_d3712d49d62c4e1d090078e0fdc9952f.jpg already downloaded
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F0b%252Fc00b4dac0772e27c36df9a6c8cf1a0c7%252Fpa%252FCE00984_f53196f504c13c2620fb21bbb8c24871.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_f53196f504c13c2620fb21bbb8c24871.jpg already downloaded
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F0b%252Fc00b4dac0772e27c36df9a6c8cf1a0c7%252Fpa%252FCE00984_c21e14b4633f7715802ad85c444290a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_c21e14b4633f7715802ad85c444290a9.jpg already downloaded
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F0b%252Fc00b4dac0772e27c36df9a6c8cf1a0c7%252Fpa%252FCE00984_35030328454567f041434d6e4cafb4d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_35030328454567f041434d6e4cafb4d7.jpg already downloaded
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F0b%252Fc00b4dac0772e27c36df9a6c8cf1a0c7%252Fpa%252FCE00984_6a8ae500b2fe9d2511f0efee4377b983.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_6a8ae500b2fe9d2511f0efee4377b983.jpg already downloaded
2026-03-28 18:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91421c51-844c-5260-bc5c-579c13056393, identifier: CE00984
2026-03-28 18:43:16 [auto1.de] INFO: Found listing with ID: KD63113
2026-03-28 18:43:16 [auto1.de] INFO: Found listing with ID: FL46038
2026-03-28 18:43:16 [auto1.de] INFO: Found listing with ID: NX82618
2026-03-28 18:43:16 [auto1.de] INFO: Found listing with ID: ZD28041
2026-03-28 18:43:16 [auto1.de] INFO: Found listing with ID: LK56613
2026-03-28 18:43:16 [auto1.de] INFO: Found listing with ID: DS29172
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS29172%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [auto1.de] INFO: Scrape type for DS29172: 1
2026-03-28 18:43:16 [auto1.de] INFO: Found listing with ID: HX78633
2026-03-28 18:43:16 [auto1.de] INFO: Found listing with ID: TE40935
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE40935%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [auto1.de] INFO: Scrape type for TE40935: 1
2026-03-28 18:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89e2c115-6248-547a-b360-0908d130dbf2 with identifier: ND12794
2026-03-28 18:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89e2c115-6248-547a-b360-0908d130dbf2 with identifier: ND12794
2026-03-28 18:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89e2c115-6248-547a-b360-0908d130dbf2 with identifier: ND12794 to the API
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ND12794>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:43:53Z',
 'fuel_type': 'gas',
 'id': '89e2c115-6248-547a-b360-0908d130dbf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND12794',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 71596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_a0195777d4080fd14145576482549bf5.jpg',
                'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_2d4b9fa3a938f16c3a34b7fa707e737f.jpg',
                'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_6e9e3b2f7cf1ba042e5874507b8af3bf.jpg',
                'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_4754d83458b806f29057149463a2259b.jpg',
                'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_93eb98ff998af092bb6868de21687211.jpg',
                'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_0954686081784267f02b7be6f840c828.jpg',
                'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_280f6c27c3459e0b4b89e5dbd69d2adf.jpg',
                'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_a1dbaf98f3b43d6135175bc2dbeaf45d.jpg',
                'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_5e970fcb4f6eeb5cf1ce0f1085f120ca.jpg',
                'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_8633a370e80fb1b7ba0dbd7e6691b192.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e2c115-6248-547a-b360-0908d130dbf2/89e2c115-6248-547a-b360-0908d130dbf2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_a0195777d4080fd14145576482549bf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e2c115-6248-547a-b360-0908d130dbf2/89e2c115-6248-547a-b360-0908d130dbf2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_2d4b9fa3a938f16c3a34b7fa707e737f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e2c115-6248-547a-b360-0908d130dbf2/89e2c115-6248-547a-b360-0908d130dbf2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_6e9e3b2f7cf1ba042e5874507b8af3bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e2c115-6248-547a-b360-0908d130dbf2/89e2c115-6248-547a-b360-0908d130dbf2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_4754d83458b806f29057149463a2259b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e2c115-6248-547a-b360-0908d130dbf2/89e2c115-6248-547a-b360-0908d130dbf2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_93eb98ff998af092bb6868de21687211.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e2c115-6248-547a-b360-0908d130dbf2/89e2c115-6248-547a-b360-0908d130dbf2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_0954686081784267f02b7be6f840c828.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e2c115-6248-547a-b360-0908d130dbf2/89e2c115-6248-547a-b360-0908d130dbf2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_280f6c27c3459e0b4b89e5dbd69d2adf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e2c115-6248-547a-b360-0908d130dbf2/89e2c115-6248-547a-b360-0908d130dbf2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_a1dbaf98f3b43d6135175bc2dbeaf45d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e2c115-6248-547a-b360-0908d130dbf2/89e2c115-6248-547a-b360-0908d130dbf2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_5e970fcb4f6eeb5cf1ce0f1085f120ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e2c115-6248-547a-b360-0908d130dbf2/89e2c115-6248-547a-b360-0908d130dbf2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/9c/229c56aeb5ac9585962d9d3758546dbb/pa/ND12794_8633a370e80fb1b7ba0dbd7e6691b192.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2020}
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND12794%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [auto1.de] INFO: Saving data for ND12794: {'created_time': 1774723396.823628, 'last_price_update_time': 1774723396.823638, 'auction_closing_time': 1774885433.0}
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND12794') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91421c51-844c-5260-bc5c-579c13056393 with identifier: CE00984
2026-03-28 18:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91421c51-844c-5260-bc5c-579c13056393 with identifier: CE00984
2026-03-28 18:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91421c51-844c-5260-bc5c-579c13056393 with identifier: CE00984 to the API
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CE00984>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:27:29Z',
 'fuel_type': 'diesel',
 'id': '91421c51-844c-5260-bc5c-579c13056393',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE00984',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 405894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_413719af4224c20d09af54276f939312.jpg',
                'https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_d3712d49d62c4e1d090078e0fdc9952f.jpg',
                'https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_f53196f504c13c2620fb21bbb8c24871.jpg',
                'https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_c21e14b4633f7715802ad85c444290a9.jpg',
                'https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_35030328454567f041434d6e4cafb4d7.jpg',
                'https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_6a8ae500b2fe9d2511f0efee4377b983.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91421c51-844c-5260-bc5c-579c13056393/91421c51-844c-5260-bc5c-579c13056393_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_413719af4224c20d09af54276f939312.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91421c51-844c-5260-bc5c-579c13056393/91421c51-844c-5260-bc5c-579c13056393_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_d3712d49d62c4e1d090078e0fdc9952f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91421c51-844c-5260-bc5c-579c13056393/91421c51-844c-5260-bc5c-579c13056393_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_f53196f504c13c2620fb21bbb8c24871.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91421c51-844c-5260-bc5c-579c13056393/91421c51-844c-5260-bc5c-579c13056393_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_c21e14b4633f7715802ad85c444290a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91421c51-844c-5260-bc5c-579c13056393/91421c51-844c-5260-bc5c-579c13056393_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_35030328454567f041434d6e4cafb4d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91421c51-844c-5260-bc5c-579c13056393/91421c51-844c-5260-bc5c-579c13056393_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/0b/c00b4dac0772e27c36df9a6c8cf1a0c7/pa/CE00984_6a8ae500b2fe9d2511f0efee4377b983.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE00984%27 HTTP/1.1" 200 None
2026-03-28 18:43:17 [auto1.de] INFO: Saving data for CE00984: {'created_time': 1774723397.258451, 'last_price_update_time': 1774723397.258462, 'auction_closing_time': 1774884449.0}
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE00984') HTTP/1.1" 204 0
2026-03-28 18:43:17 [auto1.de] INFO: Found listing with ID: WE31393
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE31393%27 HTTP/1.1" 200 None
2026-03-28 18:43:17 [auto1.de] INFO: Scrape type for WE31393: 1
2026-03-28 18:43:17 [auto1.de] INFO: Found listing with ID: GY13468
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY13468%27 HTTP/1.1" 200 None
2026-03-28 18:43:17 [auto1.de] INFO: Scrape type for GY13468: 2
2026-03-28 18:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7 with identifier: GY13468
2026-03-28 18:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7 with scrape type 2
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7 with scrape type 2
2026-03-28 18:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7, identifier: GY13468
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE77380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7 with identifier: GY13468
2026-03-28 18:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7 with identifier: GY13468
2026-03-28 18:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7 with identifier: GY13468 to the API
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:15:39Z',
 'fuel_type': 'petrol',
 'id': 'f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY13468',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 26044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-29',
 'seller_name': None,
 'title': 'BMW 3er 330i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2024}
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY13468%27 HTTP/1.1" 200 None
2026-03-28 18:43:17 [auto1.de] INFO: Saving data for GY13468: {'auction_closing_time': 1774883739.0, 'created_time': 1773428798.078898, 'last_price_update_time': 1774723397.732578}
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY13468') HTTP/1.1" 204 0
2026-03-28 18:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU80535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK31693/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZY32657/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:17 [auto1.de] INFO: Found listing with ID: CC29120
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC29120%27 HTTP/1.1" 200 None
2026-03-28 18:43:17 [auto1.de] INFO: Scrape type for CC29120: 1
2026-03-28 18:43:17 [auto1.de] INFO: Found listing with ID: GY83312
2026-03-28 18:43:17 [auto1.de] INFO: Found listing with ID: BG42804
2026-03-28 18:43:17 [auto1.de] INFO: Found listing with ID: GM83626
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM83626%27 HTTP/1.1" 200 None
2026-03-28 18:43:17 [auto1.de] INFO: Scrape type for GM83626: 2
2026-03-28 18:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05dd185d-c026-5546-b32d-833eab0bbe0d with identifier: GM83626
2026-03-28 18:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05dd185d-c026-5546-b32d-833eab0bbe0d with scrape type 2
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05dd185d-c026-5546-b32d-833eab0bbe0d with scrape type 2
2026-03-28 18:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05dd185d-c026-5546-b32d-833eab0bbe0d, identifier: GM83626
2026-03-28 18:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05dd185d-c026-5546-b32d-833eab0bbe0d with identifier: GM83626
2026-03-28 18:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05dd185d-c026-5546-b32d-833eab0bbe0d with identifier: GM83626
2026-03-28 18:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05dd185d-c026-5546-b32d-833eab0bbe0d with identifier: GM83626 to the API
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:57:33Z',
 'fuel_type': 'diesel',
 'id': '05dd185d-c026-5546-b32d-833eab0bbe0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM83626',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 44183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-04',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Tourneo Titanium X',
 'transmission': 'automatic',
 'trim': '320 L1 Tourneo Titanium X',
 'year': 2020}
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM83626%27 HTTP/1.1" 200 None
2026-03-28 18:43:18 [auto1.de] INFO: Saving data for GM83626: {'auction_closing_time': 1774886253.0, 'created_time': 1774350525.411405, 'last_price_update_time': 1774723398.216067}
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM83626') HTTP/1.1" 204 0
2026-03-28 18:43:18 [auto1.de] INFO: Found listing with ID: FT90380
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT90380%27 HTTP/1.1" 200 None
2026-03-28 18:43:18 [auto1.de] INFO: Scrape type for FT90380: 1
2026-03-28 18:43:18 [auto1.de] INFO: Found listing with ID: HG43188
2026-03-28 18:43:18 [auto1.de] INFO: Found listing with ID: CW85183
2026-03-28 18:43:18 [auto1.de] INFO: Found listing with ID: NP47731
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP47731%27 HTTP/1.1" 200 None
2026-03-28 18:43:18 [auto1.de] INFO: Scrape type for NP47731: 2
2026-03-28 18:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b161d4c-13d1-5cfc-8c38-102d072c9808 with identifier: NP47731
2026-03-28 18:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b161d4c-13d1-5cfc-8c38-102d072c9808 with scrape type 2
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b161d4c-13d1-5cfc-8c38-102d072c9808 with scrape type 2
2026-03-28 18:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b161d4c-13d1-5cfc-8c38-102d072c9808, identifier: NP47731
2026-03-28 18:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b161d4c-13d1-5cfc-8c38-102d072c9808 with identifier: NP47731
2026-03-28 18:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b161d4c-13d1-5cfc-8c38-102d072c9808 with identifier: NP47731
2026-03-28 18:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b161d4c-13d1-5cfc-8c38-102d072c9808 with identifier: NP47731 to the API
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:52:09Z',
 'fuel_type': 'petrol',
 'id': '7b161d4c-13d1-5cfc-8c38-102d072c9808',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP47731',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 104455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-06',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP47731%27 HTTP/1.1" 200 None
2026-03-28 18:43:18 [auto1.de] INFO: Saving data for NP47731: {'auction_closing_time': 1774885929.0, 'created_time': 1773340822.124049, 'last_price_update_time': 1774723398.719425}
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP47731') HTTP/1.1" 204 0
2026-03-28 18:43:18 [auto1.de] INFO: Found listing with ID: KV68719
2026-03-28 18:43:18 [auto1.de] INFO: Found listing with ID: JP17422
2026-03-28 18:43:18 [auto1.de] INFO: Found listing with ID: GJ18953
2026-03-28 18:43:18 [auto1.de] INFO: Found listing with ID: GR83992
2026-03-28 18:43:18 [auto1.de] INFO: Found listing with ID: JJ86463
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ86463%27 HTTP/1.1" 200 None
2026-03-28 18:43:18 [auto1.de] INFO: Scrape type for JJ86463: 2
2026-03-28 18:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 135d5cbc-1772-58d5-85c5-6a8f3789fa46 with identifier: JJ86463
2026-03-28 18:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 135d5cbc-1772-58d5-85c5-6a8f3789fa46 with scrape type 2
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 135d5cbc-1772-58d5-85c5-6a8f3789fa46 with scrape type 2
2026-03-28 18:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 135d5cbc-1772-58d5-85c5-6a8f3789fa46, identifier: JJ86463
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU03488/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW63260> (referer: https://www.auto1.com/v1/car-details-view/TW63260/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM78340> (referer: https://www.auto1.com/v1/car-details-view/WM78340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 135d5cbc-1772-58d5-85c5-6a8f3789fa46 with identifier: JJ86463
2026-03-28 18:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 135d5cbc-1772-58d5-85c5-6a8f3789fa46 with identifier: JJ86463
2026-03-28 18:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 135d5cbc-1772-58d5-85c5-6a8f3789fa46 with identifier: JJ86463 to the API
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:38:52Z',
 'fuel_type': 'petrol',
 'id': '135d5cbc-1772-58d5-85c5-6a8f3789fa46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ86463',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 310456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-06-09',
 'seller_name': None,
 'title': 'BMW 3er 323i',
 'transmission': 'manual',
 'trim': '',
 'year': 1999}
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ86463%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [auto1.de] INFO: Saving data for JJ86463: {'auction_closing_time': 1774885132.0, 'created_time': 1774118742.569574, 'last_price_update_time': 1774723399.181844}
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ86463') HTTP/1.1" 204 0
2026-03-28 18:43:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:19 [auto1.de] INFO: Found listing with ID: BV89454
2026-03-28 18:43:19 [auto1.de] INFO: Found listing with ID: MX21840
2026-03-28 18:43:19 [auto1.de] INFO: Found listing with ID: DR45963
2026-03-28 18:43:19 [auto1.de] INFO: Found listing with ID: UB44378
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB44378%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [auto1.de] INFO: Scrape type for UB44378: 1
2026-03-28 18:43:19 [auto1.de] INFO: Found listing with ID: CE18724
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE18724%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [auto1.de] INFO: Scrape type for CE18724: 2
2026-03-28 18:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fe489be-7fe9-5633-b607-60dc43c9a581 with identifier: CE18724
2026-03-28 18:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fe489be-7fe9-5633-b607-60dc43c9a581 with scrape type 2
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fe489be-7fe9-5633-b607-60dc43c9a581 with scrape type 2
2026-03-28 18:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fe489be-7fe9-5633-b607-60dc43c9a581, identifier: CE18724
2026-03-28 18:43:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW77268/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fe489be-7fe9-5633-b607-60dc43c9a581 with identifier: CE18724
2026-03-28 18:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fe489be-7fe9-5633-b607-60dc43c9a581 with identifier: CE18724
2026-03-28 18:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fe489be-7fe9-5633-b607-60dc43c9a581 with identifier: CE18724 to the API
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:40Z',
 'fuel_type': 'petrol',
 'id': '0fe489be-7fe9-5633-b607-60dc43c9a581',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE18724',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 273945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-03',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE18724%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [auto1.de] INFO: Saving data for CE18724: {'auction_closing_time': 1774883500.0, 'created_time': 1774034547.014284, 'last_price_update_time': 1774723399.796752}
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE18724') HTTP/1.1" 204 0
2026-03-28 18:43:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81 with identifier: TW63260
2026-03-28 18:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81 with scrape type 1
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_fc083484088607ff0e8cabe16d102aec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_fc083484088607ff0e8cabe16d102aec.jpg not downloaded yet
2026-03-28 18:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e0a2b6a-51b4-5b23-9088-06031bb1aed0 with identifier: WM78340
2026-03-28 18:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e0a2b6a-51b4-5b23-9088-06031bb1aed0 with scrape type 1
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e0a2b6a-51b4-5b23-9088-06031bb1aed0
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F65%252Ffb6588422bf5b9991dfdadd54666e90c%252Fpa%252FWM78340_7345587a194c5cf5fbee221e199792f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_7345587a194c5cf5fbee221e199792f0.jpg already downloaded
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F65%252Ffb6588422bf5b9991dfdadd54666e90c%252Fpa%252FWM78340_1ecaa27d3e93c6e0b02838e238792ee3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_1ecaa27d3e93c6e0b02838e238792ee3.jpg already downloaded
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F65%252Ffb6588422bf5b9991dfdadd54666e90c%252Fpa%252FWM78340_ff4bb7bd185e0652c6243faa0cab1544.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_ff4bb7bd185e0652c6243faa0cab1544.jpg already downloaded
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F65%252Ffb6588422bf5b9991dfdadd54666e90c%252Fpa%252FWM78340_b84dd8d854ce299fc9ab7e9df1d1facf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_b84dd8d854ce299fc9ab7e9df1d1facf.jpg already downloaded
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F65%252Ffb6588422bf5b9991dfdadd54666e90c%252Fpa%252FWM78340_897365e11092fbab31fc5a1a617a87d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_897365e11092fbab31fc5a1a617a87d6.jpg already downloaded
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F65%252Ffb6588422bf5b9991dfdadd54666e90c%252Fpa%252FWM78340_5c0d7f5aa7fb371f26ecc96d2ce2f71c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_5c0d7f5aa7fb371f26ecc96d2ce2f71c.jpg already downloaded
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F65%252Ffb6588422bf5b9991dfdadd54666e90c%252Fpa%252FWM78340_0019711f281407dbd1702790fd395d11.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_0019711f281407dbd1702790fd395d11.jpg already downloaded
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F65%252Ffb6588422bf5b9991dfdadd54666e90c%252Fpa%252FWM78340_c145b2899cbd3b17ce9de9be6447e44e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_c145b2899cbd3b17ce9de9be6447e44e.jpg already downloaded
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F65%252Ffb6588422bf5b9991dfdadd54666e90c%252Fpa%252FWM78340_3c2247d07430f24e14812dd2cde493bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_3c2247d07430f24e14812dd2cde493bb.jpg already downloaded
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F65%252Ffb6588422bf5b9991dfdadd54666e90c%252Fpa%252FWM78340_75188401e0e96b2853110d667a951f16.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_75188401e0e96b2853110d667a951f16.jpg already downloaded
2026-03-28 18:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e0a2b6a-51b4-5b23-9088-06031bb1aed0, identifier: WM78340
2026-03-28 18:43:20 [auto1.de] INFO: Found listing with ID: WN98696
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN98696%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [auto1.de] INFO: Scrape type for WN98696: 1
2026-03-28 18:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e0a2b6a-51b4-5b23-9088-06031bb1aed0 with identifier: WM78340
2026-03-28 18:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e0a2b6a-51b4-5b23-9088-06031bb1aed0 with identifier: WM78340
2026-03-28 18:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e0a2b6a-51b4-5b23-9088-06031bb1aed0 with identifier: WM78340 to the API
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WM78340>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:15Z',
 'fuel_type': 'diesel',
 'id': '9e0a2b6a-51b4-5b23-9088-06031bb1aed0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM78340',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 157609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_7345587a194c5cf5fbee221e199792f0.jpg',
                'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_1ecaa27d3e93c6e0b02838e238792ee3.jpg',
                'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_ff4bb7bd185e0652c6243faa0cab1544.jpg',
                'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_b84dd8d854ce299fc9ab7e9df1d1facf.jpg',
                'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_897365e11092fbab31fc5a1a617a87d6.jpg',
                'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_5c0d7f5aa7fb371f26ecc96d2ce2f71c.jpg',
                'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_0019711f281407dbd1702790fd395d11.jpg',
                'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_c145b2899cbd3b17ce9de9be6447e44e.jpg',
                'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_3c2247d07430f24e14812dd2cde493bb.jpg',
                'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_75188401e0e96b2853110d667a951f16.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0a2b6a-51b4-5b23-9088-06031bb1aed0/9e0a2b6a-51b4-5b23-9088-06031bb1aed0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3291449,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_7345587a194c5cf5fbee221e199792f0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0a2b6a-51b4-5b23-9088-06031bb1aed0/9e0a2b6a-51b4-5b23-9088-06031bb1aed0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3213094,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_1ecaa27d3e93c6e0b02838e238792ee3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0a2b6a-51b4-5b23-9088-06031bb1aed0/9e0a2b6a-51b4-5b23-9088-06031bb1aed0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2981696,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_ff4bb7bd185e0652c6243faa0cab1544.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0a2b6a-51b4-5b23-9088-06031bb1aed0/9e0a2b6a-51b4-5b23-9088-06031bb1aed0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_b84dd8d854ce299fc9ab7e9df1d1facf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0a2b6a-51b4-5b23-9088-06031bb1aed0/9e0a2b6a-51b4-5b23-9088-06031bb1aed0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_897365e11092fbab31fc5a1a617a87d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0a2b6a-51b4-5b23-9088-06031bb1aed0/9e0a2b6a-51b4-5b23-9088-06031bb1aed0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3356470,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_5c0d7f5aa7fb371f26ecc96d2ce2f71c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0a2b6a-51b4-5b23-9088-06031bb1aed0/9e0a2b6a-51b4-5b23-9088-06031bb1aed0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3057982,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_0019711f281407dbd1702790fd395d11.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0a2b6a-51b4-5b23-9088-06031bb1aed0/9e0a2b6a-51b4-5b23-9088-06031bb1aed0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3144970,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_c145b2899cbd3b17ce9de9be6447e44e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0a2b6a-51b4-5b23-9088-06031bb1aed0/9e0a2b6a-51b4-5b23-9088-06031bb1aed0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3119614,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_3c2247d07430f24e14812dd2cde493bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0a2b6a-51b4-5b23-9088-06031bb1aed0/9e0a2b6a-51b4-5b23-9088-06031bb1aed0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3438533,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/65/fb6588422bf5b9991dfdadd54666e90c/pa/WM78340_75188401e0e96b2853110d667a951f16.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2014}
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM78340%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [auto1.de] INFO: Saving data for WM78340: {'created_time': 1774723400.446605, 'last_price_update_time': 1774723400.446614, 'auction_closing_time': 1774885155.0}
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM78340') HTTP/1.1" 204 0
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_62a390da23dbe3139de652c8dfef6672.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_62a390da23dbe3139de652c8dfef6672.jpg not downloaded yet
2026-03-28 18:43:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP86172> (referer: https://www.auto1.com/v1/car-details-view/BP86172/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:20 [auto1.de] INFO: Found listing with ID: RW68722
2026-03-28 18:43:20 [auto1.de] INFO: Found listing with ID: YD40390
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD40390%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [auto1.de] INFO: Scrape type for YD40390: 1
2026-03-28 18:43:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_fca0abb01fa68a0d08e1b2206871158e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_fca0abb01fa68a0d08e1b2206871158e.jpg not downloaded yet
2026-03-28 18:43:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT96582/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:20 [auto1.de] INFO: Found listing with ID: AJ11888
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ11888%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [auto1.de] INFO: Scrape type for AJ11888: 1
2026-03-28 18:43:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_cb5b353a5f97cddef3ebf6903b922b83.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_cb5b353a5f97cddef3ebf6903b922b83.jpg not downloaded yet
2026-03-28 18:43:20 [auto1.de] INFO: Found listing with ID: EC85375
2026-03-28 18:43:20 [auto1.de] INFO: Found listing with ID: JX30830
2026-03-28 18:43:20 [auto1.de] INFO: Found listing with ID: NN03303
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN03303%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [auto1.de] INFO: Scrape type for NN03303: 1
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_5fc069f0ab88f387605d094814a144c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_5fc069f0ab88f387605d094814a144c6.jpg not downloaded yet
2026-03-28 18:43:20 [auto1.de] INFO: Found listing with ID: VX97978
2026-03-28 18:43:20 [auto1.de] INFO: Found listing with ID: LB43778
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB43778%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [auto1.de] INFO: Scrape type for LB43778: 1
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_cbf2350560910074cbe07c08bbeb25ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_cbf2350560910074cbe07c08bbeb25ce.jpg not downloaded yet
2026-03-28 18:43:20 [auto1.de] INFO: Found listing with ID: ED69500
2026-03-28 18:43:20 [auto1.de] INFO: Found listing with ID: HC86157
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC86157%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [auto1.de] INFO: Scrape type for HC86157: 2
2026-03-28 18:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 725b5dc1-d3b4-51b8-8462-8a4cf65528ae with identifier: HC86157
2026-03-28 18:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 725b5dc1-d3b4-51b8-8462-8a4cf65528ae with scrape type 2
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 725b5dc1-d3b4-51b8-8462-8a4cf65528ae with scrape type 2
2026-03-28 18:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 725b5dc1-d3b4-51b8-8462-8a4cf65528ae, identifier: HC86157
2026-03-28 18:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 764982c2-d5a5-59a9-9565-62649ecb4113 with identifier: BP86172
2026-03-28 18:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 764982c2-d5a5-59a9-9565-62649ecb4113 with scrape type 1
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 764982c2-d5a5-59a9-9565-62649ecb4113
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_c91274fb5d5a083176e68ffa01dddbff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_c91274fb5d5a083176e68ffa01dddbff.jpg not downloaded yet
2026-03-28 18:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 725b5dc1-d3b4-51b8-8462-8a4cf65528ae with identifier: HC86157
2026-03-28 18:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 725b5dc1-d3b4-51b8-8462-8a4cf65528ae with identifier: HC86157
2026-03-28 18:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 725b5dc1-d3b4-51b8-8462-8a4cf65528ae with identifier: HC86157 to the API
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:56:25Z',
 'fuel_type': 'petrol',
 'id': '725b5dc1-d3b4-51b8-8462-8a4cf65528ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC86157',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 222371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-31',
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe Night & Day',
 'transmission': 'manual',
 'trim': 'Night & Day',
 'year': 2010}
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC86157%27 HTTP/1.1" 200 None
2026-03-28 18:43:21 [auto1.de] INFO: Saving data for HC86157: {'auction_closing_time': 1774886185.0, 'created_time': 1774350048.537724, 'last_price_update_time': 1774723401.384186}
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC86157') HTTP/1.1" 204 0
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_77b4e0c5e45d42f868ef77535293319d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_77b4e0c5e45d42f868ef77535293319d.jpg not downloaded yet
2026-03-28 18:43:21 [auto1.de] INFO: Found listing with ID: AN99140
2026-03-28 18:43:21 [auto1.de] INFO: Found listing with ID: FD40697
2026-03-28 18:43:21 [auto1.de] INFO: Found listing with ID: UK28270
2026-03-28 18:43:21 [auto1.de] INFO: Found listing with ID: TM32674
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM32674%27 HTTP/1.1" 200 None
2026-03-28 18:43:21 [auto1.de] INFO: Scrape type for TM32674: 1
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_e2b0502323bc2f729413632ecdbe8456.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_e2b0502323bc2f729413632ecdbe8456.jpg not downloaded yet
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_66be70866ce7eafc10d1dc7a36a85de6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_66be70866ce7eafc10d1dc7a36a85de6.jpg not downloaded yet
2026-03-28 18:43:21 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 6009 | hits on page: 40
2026-03-28 18:43:21 [auto1.de] INFO: Found listing with ID: UG29438
2026-03-28 18:43:21 [auto1.de] INFO: Found listing with ID: NY30954
2026-03-28 18:43:21 [auto1.de] INFO: Found listing with ID: HH84481
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_ac39f65753315c89e56c8ed207dd6fb5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_ac39f65753315c89e56c8ed207dd6fb5.jpg not downloaded yet
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_1bff9f976267017de8cf17fd81c9d79c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_1bff9f976267017de8cf17fd81c9d79c.jpg not downloaded yet
2026-03-28 18:43:21 [auto1.de] INFO: Found listing with ID: NZ79152
2026-03-28 18:43:21 [auto1.de] INFO: Found listing with ID: AJ75381
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ75381%27 HTTP/1.1" 200 None
2026-03-28 18:43:21 [auto1.de] INFO: Scrape type for AJ75381: 2
2026-03-28 18:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d39891a9-ab3c-550b-8826-bff0c4e91ba8 with identifier: AJ75381
2026-03-28 18:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d39891a9-ab3c-550b-8826-bff0c4e91ba8 with scrape type 2
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d39891a9-ab3c-550b-8826-bff0c4e91ba8 with scrape type 2
2026-03-28 18:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d39891a9-ab3c-550b-8826-bff0c4e91ba8, identifier: AJ75381
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_c27f3a5a2cbf4a8a54c95a9edb9b3ba9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_c27f3a5a2cbf4a8a54c95a9edb9b3ba9.jpg not downloaded yet
2026-03-28 18:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d39891a9-ab3c-550b-8826-bff0c4e91ba8 with identifier: AJ75381
2026-03-28 18:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d39891a9-ab3c-550b-8826-bff0c4e91ba8 with identifier: AJ75381
2026-03-28 18:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d39891a9-ab3c-550b-8826-bff0c4e91ba8 with identifier: AJ75381 to the API
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:59:57Z',
 'fuel_type': 'petrol',
 'id': 'd39891a9-ab3c-550b-8826-bff0c4e91ba8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ75381',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 73422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-17',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2015}
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ75381%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [auto1.de] INFO: Saving data for AJ75381: {'auction_closing_time': 1774886397.0, 'created_time': 1774350453.075734, 'last_price_update_time': 1774723402.102145}
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ75381') HTTP/1.1" 204 0
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_493678ba7d1a9d132fa6d9eba8d0eb98.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_493678ba7d1a9d132fa6d9eba8d0eb98.jpg not downloaded yet
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: KA54911
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: TV53465
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: UP69379
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: TP61394
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: SG76993
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG76993%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [auto1.de] INFO: Scrape type for SG76993: 1
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_377aa468484cde74eb5bb5695a6f5d21.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_377aa468484cde74eb5bb5695a6f5d21.jpg not downloaded yet
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: EY95933
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95933%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [auto1.de] INFO: Scrape type for EY95933: 2
2026-03-28 18:43:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a08758-cbb6-5aac-a44a-d689a1b324dc with identifier: EY95933
2026-03-28 18:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a08758-cbb6-5aac-a44a-d689a1b324dc with scrape type 2
2026-03-28 18:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29a08758-cbb6-5aac-a44a-d689a1b324dc with scrape type 2
2026-03-28 18:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29a08758-cbb6-5aac-a44a-d689a1b324dc, identifier: EY95933
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_18ede77cbbc2a9bb4f34a26420829a89.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_18ede77cbbc2a9bb4f34a26420829a89.jpg not downloaded yet
2026-03-28 18:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29a08758-cbb6-5aac-a44a-d689a1b324dc with identifier: EY95933
2026-03-28 18:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29a08758-cbb6-5aac-a44a-d689a1b324dc with identifier: EY95933
2026-03-28 18:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29a08758-cbb6-5aac-a44a-d689a1b324dc with identifier: EY95933 to the API
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:18:10Z',
 'fuel_type': 'diesel',
 'id': '29a08758-cbb6-5aac-a44a-d689a1b324dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY95933',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'H1',
 'odometer': 139208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-13',
 'seller_name': None,
 'title': 'Hyundai H1 2.5 CRDi Travel Trend',
 'transmission': 'manual',
 'trim': 'Travel Trend',
 'year': 2017}
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95933%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [auto1.de] INFO: Saving data for EY95933: {'auction_closing_time': 1774883890.0, 'created_time': 1774032239.018308, 'last_price_update_time': 1774723402.732867}
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY95933') HTTP/1.1" 204 0
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: KR30537
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR30537%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [auto1.de] INFO: Scrape type for KR30537: 2
2026-03-28 18:43:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41d38535-6d09-556e-86fc-f9baa396f460 with identifier: KR30537
2026-03-28 18:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41d38535-6d09-556e-86fc-f9baa396f460 with scrape type 2
2026-03-28 18:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41d38535-6d09-556e-86fc-f9baa396f460 with scrape type 2
2026-03-28 18:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41d38535-6d09-556e-86fc-f9baa396f460, identifier: KR30537
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_eabe8f5cc364b27dc0e0ba33a09dc107.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_eabe8f5cc364b27dc0e0ba33a09dc107.jpg not downloaded yet
2026-03-28 18:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41d38535-6d09-556e-86fc-f9baa396f460 with identifier: KR30537
2026-03-28 18:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41d38535-6d09-556e-86fc-f9baa396f460 with identifier: KR30537
2026-03-28 18:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41d38535-6d09-556e-86fc-f9baa396f460 with identifier: KR30537 to the API
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:21:11Z',
 'fuel_type': 'petrol',
 'id': '41d38535-6d09-556e-86fc-f9baa396f460',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR30537',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 71772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-01',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR30537%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Saving data for KR30537: {'auction_closing_time': 1774884071.0, 'created_time': 1774089326.775551, 'last_price_update_time': 1774723403.290991}
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR30537') HTTP/1.1" 204 0
2026-03-28 18:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC21553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WE31393/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS03100/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA62575/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: BU21003
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: JY00372
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY00372%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for JY00372: 1
2026-03-28 18:43:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_c7af742ab6891f9c1455c5ee6c7e419b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_c7af742ab6891f9c1455c5ee6c7e419b.jpg not downloaded yet
2026-03-28 18:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM12815/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS29172/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: CG91765
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: NG66001
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: BP09693
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP09693%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for BP09693: 2
2026-03-28 18:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606c80d6-fe88-52f8-9955-fff8e5f4610f with identifier: BP09693
2026-03-28 18:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606c80d6-fe88-52f8-9955-fff8e5f4610f with scrape type 2
2026-03-28 18:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 606c80d6-fe88-52f8-9955-fff8e5f4610f with scrape type 2
2026-03-28 18:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 606c80d6-fe88-52f8-9955-fff8e5f4610f, identifier: BP09693
2026-03-28 18:43:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_0f2c4b75a292dcc95936fffce5a601ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_0f2c4b75a292dcc95936fffce5a601ee.jpg not downloaded yet
2026-03-28 18:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 606c80d6-fe88-52f8-9955-fff8e5f4610f with identifier: BP09693
2026-03-28 18:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 606c80d6-fe88-52f8-9955-fff8e5f4610f with identifier: BP09693
2026-03-28 18:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 606c80d6-fe88-52f8-9955-fff8e5f4610f with identifier: BP09693 to the API
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 326,
 'expiration_date': '2026-03-30T15:01:40Z',
 'fuel_type': 'diesel',
 'id': '606c80d6-fe88-52f8-9955-fff8e5f4610f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP09693',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 78711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-06',
 'seller_name': None,
 'title': 'BMW X3 M40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP09693%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Saving data for BP09693: {'auction_closing_time': 1774882900.0, 'created_time': 1774350645.065251, 'last_price_update_time': 1774723403.866637}
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP09693') HTTP/1.1" 204 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: BT01554
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT01554%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for BT01554: 1
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_884acff4f3036f7ce05ece59c5ff121d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_884acff4f3036f7ce05ece59c5ff121d.jpg not downloaded yet
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: BM00053
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM00053%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for BM00053: 1
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: MG61327
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG61327%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for MG61327: 2
2026-03-28 18:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce586af7-0907-5a55-87b6-814dde2b01e0 with identifier: MG61327
2026-03-28 18:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce586af7-0907-5a55-87b6-814dde2b01e0 with scrape type 2
2026-03-28 18:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce586af7-0907-5a55-87b6-814dde2b01e0 with scrape type 2
2026-03-28 18:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce586af7-0907-5a55-87b6-814dde2b01e0, identifier: MG61327
2026-03-28 18:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce586af7-0907-5a55-87b6-814dde2b01e0 with identifier: MG61327
2026-03-28 18:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce586af7-0907-5a55-87b6-814dde2b01e0 with identifier: MG61327
2026-03-28 18:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce586af7-0907-5a55-87b6-814dde2b01e0 with identifier: MG61327 to the API
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:36:55Z',
 'fuel_type': 'petrol',
 'id': 'ce586af7-0907-5a55-87b6-814dde2b01e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG61327',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 192797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-09',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG61327%27 HTTP/1.1" 200 None
2026-03-28 18:43:24 [auto1.de] INFO: Saving data for MG61327: {'auction_closing_time': 1774885015.0, 'created_time': 1773381348.983208, 'last_price_update_time': 1774723404.451195}
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG61327') HTTP/1.1" 204 0
2026-03-28 18:43:24 [auto1.de] INFO: Found listing with ID: MK22023
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK22023%27 HTTP/1.1" 200 None
2026-03-28 18:43:24 [auto1.de] INFO: Scrape type for MK22023: 1
2026-03-28 18:43:24 [auto1.de] INFO: Found listing with ID: EA38947
2026-03-28 18:43:24 [auto1.de] INFO: Found listing with ID: BG08845
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG08845%27 HTTP/1.1" 200 None
2026-03-28 18:43:24 [auto1.de] INFO: Scrape type for BG08845: 2
2026-03-28 18:43:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46e72222-5917-5acd-9ab3-a03f214418d3 with identifier: BG08845
2026-03-28 18:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e72222-5917-5acd-9ab3-a03f214418d3 with scrape type 2
2026-03-28 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46e72222-5917-5acd-9ab3-a03f214418d3 with scrape type 2
2026-03-28 18:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46e72222-5917-5acd-9ab3-a03f214418d3, identifier: BG08845
2026-03-28 18:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46e72222-5917-5acd-9ab3-a03f214418d3 with identifier: BG08845
2026-03-28 18:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46e72222-5917-5acd-9ab3-a03f214418d3 with identifier: BG08845
2026-03-28 18:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46e72222-5917-5acd-9ab3-a03f214418d3 with identifier: BG08845 to the API
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:27:50Z',
 'fuel_type': 'petrol',
 'id': '46e72222-5917-5acd-9ab3-a03f214418d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG08845',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 46113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-01',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG08845%27 HTTP/1.1" 200 None
2026-03-28 18:43:24 [auto1.de] INFO: Saving data for BG08845: {'auction_closing_time': 1774884470.0, 'created_time': 1773429540.842334, 'last_price_update_time': 1774723404.960316}
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG08845') HTTP/1.1" 204 0
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: UL05357
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL05357%27 HTTP/1.1" 200 None
2026-03-28 18:43:25 [auto1.de] INFO: Scrape type for UL05357: 2
2026-03-28 18:43:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9311a12-f9d7-56fd-9c25-3c04cb4a805e with identifier: UL05357
2026-03-28 18:43:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9311a12-f9d7-56fd-9c25-3c04cb4a805e with scrape type 2
2026-03-28 18:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9311a12-f9d7-56fd-9c25-3c04cb4a805e with scrape type 2
2026-03-28 18:43:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9311a12-f9d7-56fd-9c25-3c04cb4a805e, identifier: UL05357
2026-03-28 18:43:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9311a12-f9d7-56fd-9c25-3c04cb4a805e with identifier: UL05357
2026-03-28 18:43:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9311a12-f9d7-56fd-9c25-3c04cb4a805e with identifier: UL05357
2026-03-28 18:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9311a12-f9d7-56fd-9c25-3c04cb4a805e with identifier: UL05357 to the API
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:39:15Z',
 'fuel_type': 'petrol',
 'id': 'b9311a12-f9d7-56fd-9c25-3c04cb4a805e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL05357',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 149150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-26',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 300',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL05357%27 HTTP/1.1" 200 None
2026-03-28 18:43:25 [auto1.de] INFO: Saving data for UL05357: {'auction_closing_time': 1774885155.0, 'created_time': 1774089519.344794, 'last_price_update_time': 1774723405.621836}
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL05357') HTTP/1.1" 204 0
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: TR37501
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR37501%27 HTTP/1.1" 200 None
2026-03-28 18:43:25 [auto1.de] INFO: Scrape type for TR37501: 1
2026-03-28 18:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_493678ba7d1a9d132fa6d9eba8d0eb98.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_18ede77cbbc2a9bb4f34a26420829a89.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: HZ69536
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: TK93923
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: LW29658
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW29658%27 HTTP/1.1" 200 None
2026-03-28 18:43:25 [auto1.de] INFO: Scrape type for LW29658: 2
2026-03-28 18:43:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9d752ec-7828-572b-a9c6-59aed5aa7758 with identifier: LW29658
2026-03-28 18:43:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9d752ec-7828-572b-a9c6-59aed5aa7758 with scrape type 2
2026-03-28 18:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9d752ec-7828-572b-a9c6-59aed5aa7758 with scrape type 2
2026-03-28 18:43:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9d752ec-7828-572b-a9c6-59aed5aa7758, identifier: LW29658
2026-03-28 18:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE77380> (referer: https://www.auto1.com/v1/car-details-view/RE77380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB44378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT90380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN98696/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9d752ec-7828-572b-a9c6-59aed5aa7758 with identifier: LW29658
2026-03-28 18:43:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9d752ec-7828-572b-a9c6-59aed5aa7758 with identifier: LW29658
2026-03-28 18:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9d752ec-7828-572b-a9c6-59aed5aa7758 with identifier: LW29658 to the API
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:42:12Z',
 'fuel_type': 'petrol',
 'id': 'f9d752ec-7828-572b-a9c6-59aed5aa7758',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW29658',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 156625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-30',
 'seller_name': None,
 'title': 'BMW 4er 428i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW29658%27 HTTP/1.1" 200 None
2026-03-28 18:43:26 [auto1.de] INFO: Saving data for LW29658: {'auction_closing_time': 1774885332.0, 'created_time': 1773429370.304867, 'last_price_update_time': 1774723406.132034}
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW29658') HTTP/1.1" 204 0
2026-03-28 18:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:26 [auto1.de] INFO: Found listing with ID: DV23135
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV23135%27 HTTP/1.1" 200 None
2026-03-28 18:43:26 [auto1.de] INFO: Scrape type for DV23135: 2
2026-03-28 18:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff31bbc2-04c4-57b3-9358-8f70134967e1 with identifier: DV23135
2026-03-28 18:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff31bbc2-04c4-57b3-9358-8f70134967e1 with scrape type 2
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff31bbc2-04c4-57b3-9358-8f70134967e1 with scrape type 2
2026-03-28 18:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff31bbc2-04c4-57b3-9358-8f70134967e1, identifier: DV23135
2026-03-28 18:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff31bbc2-04c4-57b3-9358-8f70134967e1 with identifier: DV23135
2026-03-28 18:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff31bbc2-04c4-57b3-9358-8f70134967e1 with identifier: DV23135
2026-03-28 18:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff31bbc2-04c4-57b3-9358-8f70134967e1 with identifier: DV23135 to the API
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:49:24Z',
 'fuel_type': 'diesel',
 'id': 'ff31bbc2-04c4-57b3-9358-8f70134967e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV23135',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 130180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-09',
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV23135%27 HTTP/1.1" 200 None
2026-03-28 18:43:26 [auto1.de] INFO: Saving data for DV23135: {'auction_closing_time': 1774885764.0, 'created_time': 1773402196.577748, 'last_price_update_time': 1774723406.582847}
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV23135') HTTP/1.1" 204 0
2026-03-28 18:43:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD40949/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560aae10>
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_493678ba7d1a9d132fa6d9eba8d0eb98.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_493678ba7d1a9d132fa6d9eba8d0eb98.jpg saved to cache
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245616fa50>
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_18ede77cbbc2a9bb4f34a26420829a89.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_18ede77cbbc2a9bb4f34a26420829a89.jpg saved to cache
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 764982c2-d5a5-59a9-9565-62649ecb4113
2026-03-28 18:43:26 [auto1.de] INFO: Found listing with ID: VR46217
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR46217%27 HTTP/1.1" 200 None
2026-03-28 18:43:26 [auto1.de] INFO: Scrape type for VR46217: 1
2026-03-28 18:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC29120/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d32b32be-5e8b-5028-9490-b30aa4690b08 with identifier: RE77380
2026-03-28 18:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d32b32be-5e8b-5028-9490-b30aa4690b08 with scrape type 1
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d32b32be-5e8b-5028-9490-b30aa4690b08
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F38%252Fa638d0c81e258ad74814c9ee9af8c144%252Fpa%252FRE77380_2d5ce07b9fda46736ba26f0f992e1fd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_2d5ce07b9fda46736ba26f0f992e1fd2.jpg not downloaded yet
2026-03-28 18:43:26 [auto1.de] INFO: Found listing with ID: XH28612
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH28612%27 HTTP/1.1" 200 None
2026-03-28 18:43:26 [auto1.de] INFO: Scrape type for XH28612: 1
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F38%252Fa638d0c81e258ad74814c9ee9af8c144%252Fpa%252FRE77380_90c329c981516a81ffeb1cbeb6fe419b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_90c329c981516a81ffeb1cbeb6fe419b.jpg not downloaded yet
2026-03-28 18:43:27 [auto1.de] INFO: Found listing with ID: KJ41571
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ41571%27 HTTP/1.1" 200 None
2026-03-28 18:43:27 [auto1.de] INFO: Scrape type for KJ41571: 1
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F38%252Fa638d0c81e258ad74814c9ee9af8c144%252Fpa%252FRE77380_0870698b2919906366e10202510b6126.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_0870698b2919906366e10202510b6126.jpg not downloaded yet
2026-03-28 18:43:27 [auto1.de] INFO: Found listing with ID: UD70348
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD70348%27 HTTP/1.1" 200 None
2026-03-28 18:43:27 [auto1.de] INFO: Scrape type for UD70348: 2
2026-03-28 18:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 300f2c25-04dd-5b54-ae27-95cf17d8ffb5 with identifier: UD70348
2026-03-28 18:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 300f2c25-04dd-5b54-ae27-95cf17d8ffb5 with scrape type 2
2026-03-28 18:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 300f2c25-04dd-5b54-ae27-95cf17d8ffb5 with scrape type 2
2026-03-28 18:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 300f2c25-04dd-5b54-ae27-95cf17d8ffb5, identifier: UD70348
2026-03-28 18:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 300f2c25-04dd-5b54-ae27-95cf17d8ffb5 with identifier: UD70348
2026-03-28 18:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 300f2c25-04dd-5b54-ae27-95cf17d8ffb5 with identifier: UD70348
2026-03-28 18:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 300f2c25-04dd-5b54-ae27-95cf17d8ffb5 with identifier: UD70348 to the API
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:48:05Z',
 'fuel_type': 'diesel',
 'id': '300f2c25-04dd-5b54-ae27-95cf17d8ffb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD70348',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 202777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-02-17',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2004}
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD70348%27 HTTP/1.1" 200 None
2026-03-28 18:43:27 [auto1.de] INFO: Saving data for UD70348: {'auction_closing_time': 1774885685.0, 'created_time': 1773382620.844264, 'last_price_update_time': 1774723407.483662}
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD70348') HTTP/1.1" 204 0
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F38%252Fa638d0c81e258ad74814c9ee9af8c144%252Fpa%252FRE77380_1a00ffaf310baa82e5a3fa857dd8f3b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_1a00ffaf310baa82e5a3fa857dd8f3b9.jpg not downloaded yet
2026-03-28 18:43:27 [auto1.de] INFO: Found listing with ID: CS73315
2026-03-28 18:43:27 [auto1.de] INFO: Found listing with ID: SE41978
2026-03-28 18:43:27 [auto1.de] INFO: Found listing with ID: NS35557
2026-03-28 18:43:27 [auto1.de] INFO: Found listing with ID: JJ64066
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ64066%27 HTTP/1.1" 200 None
2026-03-28 18:43:27 [auto1.de] INFO: Scrape type for JJ64066: 2
2026-03-28 18:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43631074-8476-56fd-8474-72438b800c53 with identifier: JJ64066
2026-03-28 18:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43631074-8476-56fd-8474-72438b800c53 with scrape type 2
2026-03-28 18:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43631074-8476-56fd-8474-72438b800c53 with scrape type 2
2026-03-28 18:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43631074-8476-56fd-8474-72438b800c53, identifier: JJ64066
2026-03-28 18:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43631074-8476-56fd-8474-72438b800c53 with identifier: JJ64066
2026-03-28 18:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43631074-8476-56fd-8474-72438b800c53 with identifier: JJ64066
2026-03-28 18:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43631074-8476-56fd-8474-72438b800c53 with identifier: JJ64066 to the API
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:56Z',
 'fuel_type': 'petrol',
 'id': '43631074-8476-56fd-8474-72438b800c53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ64066',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 58168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-02',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ64066%27 HTTP/1.1" 200 None
2026-03-28 18:43:27 [auto1.de] INFO: Saving data for JJ64066: {'auction_closing_time': 1774885376.0, 'created_time': 1774157729.200443, 'last_price_update_time': 1774723407.959162}
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ64066') HTTP/1.1" 204 0
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F38%252Fa638d0c81e258ad74814c9ee9af8c144%252Fpa%252FRE77380_03a4cef2cc01a87b0ddc64c490b28310.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_03a4cef2cc01a87b0ddc64c490b28310.jpg not downloaded yet
2026-03-28 18:43:28 [auto1.de] INFO: Found listing with ID: MD22344
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD22344%27 HTTP/1.1" 200 None
2026-03-28 18:43:28 [auto1.de] INFO: Scrape type for MD22344: 1
2026-03-28 18:43:28 [auto1.de] INFO: Found listing with ID: LW95470
2026-03-28 18:43:28 [auto1.de] INFO: Found listing with ID: GN95458
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN95458%27 HTTP/1.1" 200 None
2026-03-28 18:43:28 [auto1.de] INFO: Scrape type for GN95458: 1
2026-03-28 18:43:28 [auto1.de] INFO: Found listing with ID: ZG18767
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG18767%27 HTTP/1.1" 200 None
2026-03-28 18:43:28 [auto1.de] INFO: Scrape type for ZG18767: 2
2026-03-28 18:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f254cf66-905e-5b8b-84ab-1b502f11f59f with identifier: ZG18767
2026-03-28 18:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f254cf66-905e-5b8b-84ab-1b502f11f59f with scrape type 2
2026-03-28 18:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f254cf66-905e-5b8b-84ab-1b502f11f59f with scrape type 2
2026-03-28 18:43:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f254cf66-905e-5b8b-84ab-1b502f11f59f, identifier: ZG18767
2026-03-28 18:43:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f254cf66-905e-5b8b-84ab-1b502f11f59f with identifier: ZG18767
2026-03-28 18:43:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f254cf66-905e-5b8b-84ab-1b502f11f59f with identifier: ZG18767
2026-03-28 18:43:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f254cf66-905e-5b8b-84ab-1b502f11f59f with identifier: ZG18767 to the API
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:29:44Z',
 'fuel_type': 'diesel',
 'id': 'f254cf66-905e-5b8b-84ab-1b502f11f59f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG18767',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 345618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-28',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Ambition Outdoor',
 'transmission': 'manual',
 'trim': 'Ambition Outdoor',
 'year': 2015}
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG18767%27 HTTP/1.1" 200 None
2026-03-28 18:43:28 [auto1.de] INFO: Saving data for ZG18767: {'auction_closing_time': 1774884584.0, 'created_time': 1774001895.575613, 'last_price_update_time': 1774723408.555694}
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG18767') HTTP/1.1" 204 0
2026-03-28 18:43:28 [auto1.de] INFO: Found listing with ID: TM38106
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM38106%27 HTTP/1.1" 200 None
2026-03-28 18:43:28 [auto1.de] INFO: Scrape type for TM38106: 1
2026-03-28 18:43:28 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-28 18:43:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ92426> (referer: https://www.auto1.com/v1/car-details-view/FZ92426/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_eabe8f5cc364b27dc0e0ba33a09dc107.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_377aa468484cde74eb5bb5695a6f5d21.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c760fd3c-3cd8-5fbb-9fae-b8d2243602c4 with identifier: FZ92426
2026-03-28 18:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4 with scrape type 1
2026-03-28 18:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_fbb9f04d9a4ae3186e27814eaf238b7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_fbb9f04d9a4ae3186e27814eaf238b7d.jpg not downloaded yet
2026-03-28 18:43:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW77268> (referer: https://www.auto1.com/v1/car-details-view/DW77268/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_3bf33c0e27a1cd72fce240d315b33f08.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_3bf33c0e27a1cd72fce240d315b33f08.jpg not downloaded yet
2026-03-28 18:43:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY00372/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456159b10>
2026-03-28 18:43:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_eabe8f5cc364b27dc0e0ba33a09dc107.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_eabe8f5cc364b27dc0e0ba33a09dc107.jpg saved to cache
2026-03-28 18:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 764982c2-d5a5-59a9-9565-62649ecb4113
2026-03-28 18:43:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456274890>
2026-03-28 18:43:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_377aa468484cde74eb5bb5695a6f5d21.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_377aa468484cde74eb5bb5695a6f5d21.jpg saved to cache
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 764982c2-d5a5-59a9-9565-62649ecb4113
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_d2c09012c2596c3a630ef306a036b352.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_d2c09012c2596c3a630ef306a036b352.jpg not downloaded yet
2026-03-28 18:43:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_c0ff1fac47cfbfd108ac496c7d68e09d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_c0ff1fac47cfbfd108ac496c7d68e09d.jpg not downloaded yet
2026-03-28 18:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD40390/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f5ff589-3999-55fb-9871-1125f3d8c1f3 with identifier: DW77268
2026-03-28 18:43:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f5ff589-3999-55fb-9871-1125f3d8c1f3 with scrape type 1
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f5ff589-3999-55fb-9871-1125f3d8c1f3
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F25%252F0425ab7e445bfae3fb63b78f692df60c%252Fpa%252FDW77268_700120a388333ac54e221e90f893a2a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_700120a388333ac54e221e90f893a2a5.jpg already downloaded
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F25%252F0425ab7e445bfae3fb63b78f692df60c%252Fpa%252FDW77268_bc18f45b4781e1b98311c5a24e2eb05f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_bc18f45b4781e1b98311c5a24e2eb05f.jpg already downloaded
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F25%252F0425ab7e445bfae3fb63b78f692df60c%252Fpa%252FDW77268_6e13fef3dd0b6bccb91ff4b8e8651253.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_6e13fef3dd0b6bccb91ff4b8e8651253.jpg already downloaded
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F25%252F0425ab7e445bfae3fb63b78f692df60c%252Fpa%252FDW77268_15a9b8cfb9f934b66aa1c58b3c07ebf9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_15a9b8cfb9f934b66aa1c58b3c07ebf9.jpg already downloaded
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F25%252F0425ab7e445bfae3fb63b78f692df60c%252Fpa%252FDW77268_b102e917985f08f25750374c09021b8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_b102e917985f08f25750374c09021b8c.jpg already downloaded
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F25%252F0425ab7e445bfae3fb63b78f692df60c%252Fpa%252FDW77268_1ad80eb398eccfb94206bea59b681cb4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_1ad80eb398eccfb94206bea59b681cb4.jpg already downloaded
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F25%252F0425ab7e445bfae3fb63b78f692df60c%252Fpa%252FDW77268_2da500f5e20e1d5a4fb01cd6a5c9b78f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_2da500f5e20e1d5a4fb01cd6a5c9b78f.jpg already downloaded
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F25%252F0425ab7e445bfae3fb63b78f692df60c%252Fpa%252FDW77268_6db2326d4938dc6e27806192a2458941.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_6db2326d4938dc6e27806192a2458941.jpg already downloaded
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F25%252F0425ab7e445bfae3fb63b78f692df60c%252Fpa%252FDW77268_b2f3909b151f8a374b9f5c9f565f34c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_b2f3909b151f8a374b9f5c9f565f34c8.jpg already downloaded
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F25%252F0425ab7e445bfae3fb63b78f692df60c%252Fpa%252FDW77268_39b35a2e05a40a7a9adb39eb4f879a92.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_39b35a2e05a40a7a9adb39eb4f879a92.jpg already downloaded
2026-03-28 18:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f5ff589-3999-55fb-9871-1125f3d8c1f3, identifier: DW77268
2026-03-28 18:43:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f5ff589-3999-55fb-9871-1125f3d8c1f3 with identifier: DW77268
2026-03-28 18:43:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f5ff589-3999-55fb-9871-1125f3d8c1f3 with identifier: DW77268
2026-03-28 18:43:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f5ff589-3999-55fb-9871-1125f3d8c1f3 with identifier: DW77268 to the API
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DW77268>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:43:03Z',
 'fuel_type': 'petrol',
 'id': '1f5ff589-3999-55fb-9871-1125f3d8c1f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW77268',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 90669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_700120a388333ac54e221e90f893a2a5.jpg',
                'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_bc18f45b4781e1b98311c5a24e2eb05f.jpg',
                'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_6e13fef3dd0b6bccb91ff4b8e8651253.jpg',
                'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_15a9b8cfb9f934b66aa1c58b3c07ebf9.jpg',
                'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_b102e917985f08f25750374c09021b8c.jpg',
                'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_1ad80eb398eccfb94206bea59b681cb4.jpg',
                'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_2da500f5e20e1d5a4fb01cd6a5c9b78f.jpg',
                'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_6db2326d4938dc6e27806192a2458941.jpg',
                'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_b2f3909b151f8a374b9f5c9f565f34c8.jpg',
                'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_39b35a2e05a40a7a9adb39eb4f879a92.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5ff589-3999-55fb-9871-1125f3d8c1f3/1f5ff589-3999-55fb-9871-1125f3d8c1f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3211333,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_700120a388333ac54e221e90f893a2a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5ff589-3999-55fb-9871-1125f3d8c1f3/1f5ff589-3999-55fb-9871-1125f3d8c1f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3250537,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_bc18f45b4781e1b98311c5a24e2eb05f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5ff589-3999-55fb-9871-1125f3d8c1f3/1f5ff589-3999-55fb-9871-1125f3d8c1f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3247875,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_6e13fef3dd0b6bccb91ff4b8e8651253.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5ff589-3999-55fb-9871-1125f3d8c1f3/1f5ff589-3999-55fb-9871-1125f3d8c1f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3297756,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_15a9b8cfb9f934b66aa1c58b3c07ebf9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5ff589-3999-55fb-9871-1125f3d8c1f3/1f5ff589-3999-55fb-9871-1125f3d8c1f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_b102e917985f08f25750374c09021b8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5ff589-3999-55fb-9871-1125f3d8c1f3/1f5ff589-3999-55fb-9871-1125f3d8c1f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_1ad80eb398eccfb94206bea59b681cb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5ff589-3999-55fb-9871-1125f3d8c1f3/1f5ff589-3999-55fb-9871-1125f3d8c1f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_2da500f5e20e1d5a4fb01cd6a5c9b78f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5ff589-3999-55fb-9871-1125f3d8c1f3/1f5ff589-3999-55fb-9871-1125f3d8c1f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3316530,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_6db2326d4938dc6e27806192a2458941.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5ff589-3999-55fb-9871-1125f3d8c1f3/1f5ff589-3999-55fb-9871-1125f3d8c1f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3125910,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_b2f3909b151f8a374b9f5c9f565f34c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f5ff589-3999-55fb-9871-1125f3d8c1f3/1f5ff589-3999-55fb-9871-1125f3d8c1f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2895414,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/25/0425ab7e445bfae3fb63b78f692df60c/pa/DW77268_39b35a2e05a40a7a9adb39eb4f879a92.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 20i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2016}
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77268%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [auto1.de] INFO: Saving data for DW77268: {'created_time': 1774723409.690335, 'last_price_update_time': 1774723409.690345, 'auction_closing_time': 1774885383.0}
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW77268') HTTP/1.1" 204 0
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_a116346d821abfd1489ceb05d1b9b148.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_a116346d821abfd1489ceb05d1b9b148.jpg not downloaded yet
2026-03-28 18:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_fbb9f04d9a4ae3186e27814eaf238b7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_3bf33c0e27a1cd72fce240d315b33f08.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MK22023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM00053/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_c2b0de2a5f1ed9a129bc49299624be23.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_c2b0de2a5f1ed9a129bc49299624be23.jpg not downloaded yet
2026-03-28 18:43:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_463e6065a37b9bf570ecaefeef087824.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_463e6065a37b9bf570ecaefeef087824.jpg not downloaded yet
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_1cadd9a25b66a96672e034066f3f6bf5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_1cadd9a25b66a96672e034066f3f6bf5.jpg not downloaded yet
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_a7a4743de24c9b34797a9077bb591c4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_a7a4743de24c9b34797a9077bb591c4f.jpg not downloaded yet
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_391b96c9a1416ce6a3ba5b5631827dff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_391b96c9a1416ce6a3ba5b5631827dff.jpg not downloaded yet
2026-03-28 18:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456174950>
2026-03-28 18:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_fbb9f04d9a4ae3186e27814eaf238b7d.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_fbb9f04d9a4ae3186e27814eaf238b7d.jpg saved to cache
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4
2026-03-28 18:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564e3350>
2026-03-28 18:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_3bf33c0e27a1cd72fce240d315b33f08.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_3bf33c0e27a1cd72fce240d315b33f08.jpg saved to cache
2026-03-28 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4
2026-03-28 18:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_c0ff1fac47cfbfd108ac496c7d68e09d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_d2c09012c2596c3a630ef306a036b352.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564e2610>
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_c0ff1fac47cfbfd108ac496c7d68e09d.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_c0ff1fac47cfbfd108ac496c7d68e09d.jpg saved to cache
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b5750>
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_d2c09012c2596c3a630ef306a036b352.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_d2c09012c2596c3a630ef306a036b352.jpg saved to cache
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4
2026-03-28 18:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_a116346d821abfd1489ceb05d1b9b148.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TE40935/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_a7a4743de24c9b34797a9077bb591c4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456336910>
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_a116346d821abfd1489ceb05d1b9b148.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_a116346d821abfd1489ceb05d1b9b148.jpg saved to cache
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4
2026-03-28 18:43:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456410c10>
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_a7a4743de24c9b34797a9077bb591c4f.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_a7a4743de24c9b34797a9077bb591c4f.jpg saved to cache
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4
2026-03-28 18:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_391b96c9a1416ce6a3ba5b5631827dff.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS29172> (referer: https://www.auto1.com/v1/car-details-view/DS29172/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245624e3d0>
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_391b96c9a1416ce6a3ba5b5631827dff.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_391b96c9a1416ce6a3ba5b5631827dff.jpg saved to cache
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4
2026-03-28 18:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5 with identifier: DS29172
2026-03-28 18:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5 with scrape type 1
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_0299e751161ae73119c6a26cd7ac55e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_0299e751161ae73119c6a26cd7ac55e4.jpg not downloaded yet
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_29fcc50c9ebbdc10b6c38a82bd02bd2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_29fcc50c9ebbdc10b6c38a82bd02bd2d.jpg not downloaded yet
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_1dccb90a6940522f98fc6e95368bcdc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_1dccb90a6940522f98fc6e95368bcdc4.jpg not downloaded yet
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_e7ba085b8e1d26b3a6fac0ed2c7cd3fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_e7ba085b8e1d26b3a6fac0ed2c7cd3fc.jpg not downloaded yet
2026-03-28 18:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS03100> (referer: https://www.auto1.com/v1/car-details-view/GS03100/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_0b74e38408a3e9d247220c184c8a7c38.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_0b74e38408a3e9d247220c184c8a7c38.jpg not downloaded yet
2026-03-28 18:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_ca854ddea2d6c602100f43ae42589e4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_ca854ddea2d6c602100f43ae42589e4f.jpg not downloaded yet
2026-03-28 18:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_1cadd9a25b66a96672e034066f3f6bf5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_4e1809a6d1eae204f9f641a17c6a77e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_4e1809a6d1eae204f9f641a17c6a77e4.jpg not downloaded yet
2026-03-28 18:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA62575> (referer: https://www.auto1.com/v1/car-details-view/HA62575/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_9e1be3bc02d1bf01226dc9cfba65384a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_9e1be3bc02d1bf01226dc9cfba65384a.jpg not downloaded yet
2026-03-28 18:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_a36b7c698012e4d0d0f89e23ec22fa04.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_a36b7c698012e4d0d0f89e23ec22fa04.jpg not downloaded yet
2026-03-28 18:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM12815> (referer: https://www.auto1.com/v1/car-details-view/AM12815/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_3c417690c116199de35b32c08174e7b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_3c417690c116199de35b32c08174e7b3.jpg not downloaded yet
2026-03-28 18:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8 with identifier: GS03100
2026-03-28 18:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8 with scrape type 1
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_55c46281c6776f60d327fdbff205cd17.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_55c46281c6776f60d327fdbff205cd17.jpg not downloaded yet
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_731ac730d99a57556f3c941294ba4e3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_731ac730d99a57556f3c941294ba4e3a.jpg not downloaded yet
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_ec2a8ab242ef40625c61ca85dfa296cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_ec2a8ab242ef40625c61ca85dfa296cf.jpg not downloaded yet
2026-03-28 18:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WE31393> (referer: https://www.auto1.com/v1/car-details-view/WE31393/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456190fd0>
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_1cadd9a25b66a96672e034066f3f6bf5.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_1cadd9a25b66a96672e034066f3f6bf5.jpg saved to cache
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_9e9f2e785b00e134683a8769a541546e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_9e9f2e785b00e134683a8769a541546e.jpg not downloaded yet
2026-03-28 18:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7faebd26-33b6-5cd5-847d-8446a68f2db1 with identifier: HA62575
2026-03-28 18:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7faebd26-33b6-5cd5-847d-8446a68f2db1 with scrape type 1
2026-03-28 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7faebd26-33b6-5cd5-847d-8446a68f2db1
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_9f2b69ee9dbb5950acb0753c16e0e7a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_9f2b69ee9dbb5950acb0753c16e0e7a2.jpg not downloaded yet
2026-03-28 18:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_4e1809a6d1eae204f9f641a17c6a77e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_d79d5a813d6a0f737e33ee72b3e6943f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_d79d5a813d6a0f737e33ee72b3e6943f.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_4555260d82b2bd703337634d8d4b5ff7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_4555260d82b2bd703337634d8d4b5ff7.jpg not downloaded yet
2026-03-28 18:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 483ad7c1-be4f-5853-a8d5-c724eb134227 with identifier: AM12815
2026-03-28 18:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 483ad7c1-be4f-5853-a8d5-c724eb134227 with scrape type 1
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 483ad7c1-be4f-5853-a8d5-c724eb134227
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_aa4e726132d645e09aa258b9c33761f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_aa4e726132d645e09aa258b9c33761f9.jpg not downloaded yet
2026-03-28 18:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_ca854ddea2d6c602100f43ae42589e4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_243554bec039822069754a2efd6110f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_243554bec039822069754a2efd6110f8.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_4f8b96fa3457b79271e9157798ec3e72.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_4f8b96fa3457b79271e9157798ec3e72.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_33c29ddc21ca337b1da07a77d52c764a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_33c29ddc21ca337b1da07a77d52c764a.jpg not downloaded yet
2026-03-28 18:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3f47c76-908f-53af-91a9-e878fa2bb1d2 with identifier: WE31393
2026-03-28 18:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3f47c76-908f-53af-91a9-e878fa2bb1d2 with scrape type 1
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3f47c76-908f-53af-91a9-e878fa2bb1d2
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_455e83097da9fd12be873057d11b869c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_455e83097da9fd12be873057d11b869c.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_1e80b9cd0954bf8e0dc2f7de065489b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_1e80b9cd0954bf8e0dc2f7de065489b6.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_ab7c6d35dab58e54587b347debc75916.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_ab7c6d35dab58e54587b347debc75916.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_325385df2f54837898b035561e723b60.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_325385df2f54837898b035561e723b60.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_59a40c80565f6e1f8b9494a9dbfeda35.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_59a40c80565f6e1f8b9494a9dbfeda35.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_61758b13814b6476cd9917415c064f2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_61758b13814b6476cd9917415c064f2c.jpg not downloaded yet
2026-03-28 18:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG76993/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564fb950>
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_4e1809a6d1eae204f9f641a17c6a77e4.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_4e1809a6d1eae204f9f641a17c6a77e4.jpg saved to cache
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561a7990>
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_ca854ddea2d6c602100f43ae42589e4f.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_ca854ddea2d6c602100f43ae42589e4f.jpg saved to cache
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_e003ce752ea7ed09fcb3f99405653118.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_e003ce752ea7ed09fcb3f99405653118.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_7e33b4e364b982019f31542a1b3dbfb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_7e33b4e364b982019f31542a1b3dbfb8.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_f115c389a722a83533f7549cd60661dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_f115c389a722a83533f7549cd60661dd.jpg not downloaded yet
2026-03-28 18:43:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_463e6065a37b9bf570ecaefeef087824.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_aa4e726132d645e09aa258b9c33761f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_9e9f2e785b00e134683a8769a541546e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_5eabf756c705c8c1c5e350dd808b8142.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_5eabf756c705c8c1c5e350dd808b8142.jpg not downloaded yet
2026-03-28 18:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM38106/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_8c0de635218eaae6cb14a6c150419906.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_8c0de635218eaae6cb14a6c150419906.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_ad76d70ef16e9b003f1b993307c9d8f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_ad76d70ef16e9b003f1b993307c9d8f7.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_0a00d98737c73c2e81b1a67e394d97a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_0a00d98737c73c2e81b1a67e394d97a3.jpg not downloaded yet
2026-03-28 18:43:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_41d79db7f4f661a9bcb53f41f3ee23fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_41d79db7f4f661a9bcb53f41f3ee23fb.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_094f911402bb58a6eb5a557cf26ca134.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_094f911402bb58a6eb5a557cf26ca134.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_070f5a5e220318dbafaa5536d4fd6c44.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_070f5a5e220318dbafaa5536d4fd6c44.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_4e92395c27f57abbb2782e28b68997c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_4e92395c27f57abbb2782e28b68997c7.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_7d8a6e327a352de712d284ea4ae0ac7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_7d8a6e327a352de712d284ea4ae0ac7e.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_a993287e4e7245d4d83308c3d835bb70.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_a993287e4e7245d4d83308c3d835bb70.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_00fd69a02743f131c1645c98f576c813.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_00fd69a02743f131c1645c98f576c813.jpg not downloaded yet
2026-03-28 18:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_59a40c80565f6e1f8b9494a9dbfeda35.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563eafd0>
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_463e6065a37b9bf570ecaefeef087824.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_463e6065a37b9bf570ecaefeef087824.jpg saved to cache
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456291850>
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_aa4e726132d645e09aa258b9c33761f9.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_aa4e726132d645e09aa258b9c33761f9.jpg saved to cache
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 483ad7c1-be4f-5853-a8d5-c724eb134227
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562cadd0>
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_9e9f2e785b00e134683a8769a541546e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_9e9f2e785b00e134683a8769a541546e.jpg saved to cache
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_ad2cfdb3afe683a97be2911af2f36a1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_ad2cfdb3afe683a97be2911af2f36a1b.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_b73e9544e5cac5cf4ba3c4923c2e7e2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_b73e9544e5cac5cf4ba3c4923c2e7e2e.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_4692a15f8aca9a3d2132d5798e44e7fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_4692a15f8aca9a3d2132d5798e44e7fd.jpg not downloaded yet
2026-03-28 18:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_325385df2f54837898b035561e723b60.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_53fbb6c997fadc7759c96a8eceb0947b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_53fbb6c997fadc7759c96a8eceb0947b.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_cbbd33911d33e1a358365648e3124815.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_cbbd33911d33e1a358365648e3124815.jpg not downloaded yet
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_d6490840a2b306e47cf0afe53d01b557.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_d6490840a2b306e47cf0afe53d01b557.jpg not downloaded yet
2026-03-28 18:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD22344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245614bb90>
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_59a40c80565f6e1f8b9494a9dbfeda35.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_59a40c80565f6e1f8b9494a9dbfeda35.jpg saved to cache
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3f47c76-908f-53af-91a9-e878fa2bb1d2
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_2691b8948c27db12cb383abccc32c005.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_2691b8948c27db12cb383abccc32c005.jpg not downloaded yet
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_f8a4a3671448df3805d78541d02e8ecd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_f8a4a3671448df3805d78541d02e8ecd.jpg not downloaded yet
2026-03-28 18:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_4e92395c27f57abbb2782e28b68997c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563ea7d0>
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_325385df2f54837898b035561e723b60.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_325385df2f54837898b035561e723b60.jpg saved to cache
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 483ad7c1-be4f-5853-a8d5-c724eb134227
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_565b16be2058b16177eab5a6da3968cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_565b16be2058b16177eab5a6da3968cc.jpg not downloaded yet
2026-03-28 18:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_4692a15f8aca9a3d2132d5798e44e7fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY00372> (referer: https://www.auto1.com/v1/car-details-view/JY00372/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_e7ba085b8e1d26b3a6fac0ed2c7cd3fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_61758b13814b6476cd9917415c064f2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC29120> (referer: https://www.auto1.com/v1/car-details-view/CC29120/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_a36b7c698012e4d0d0f89e23ec22fa04.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245649f990>
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_4e92395c27f57abbb2782e28b68997c7.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_4e92395c27f57abbb2782e28b68997c7.jpg saved to cache
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3f47c76-908f-53af-91a9-e878fa2bb1d2
2026-03-28 18:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_d6490840a2b306e47cf0afe53d01b557.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_ec2a8ab242ef40625c61ca85dfa296cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563bc950>
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_4692a15f8aca9a3d2132d5798e44e7fd.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_4692a15f8aca9a3d2132d5798e44e7fd.jpg saved to cache
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3f47c76-908f-53af-91a9-e878fa2bb1d2
2026-03-28 18:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_b73e9544e5cac5cf4ba3c4923c2e7e2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f170e5e9-1e83-5c24-924a-e38ce729509b with identifier: JY00372
2026-03-28 18:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f170e5e9-1e83-5c24-924a-e38ce729509b with scrape type 1
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f170e5e9-1e83-5c24-924a-e38ce729509b
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F1e%252F451e94d3c48318e26466bd2611511ecd%252Fpa%252FJY00372_41c9d1fee7fbb63689e211dd125b4379.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_41c9d1fee7fbb63689e211dd125b4379.jpg not downloaded yet
2026-03-28 18:43:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245630b490>
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_e7ba085b8e1d26b3a6fac0ed2c7cd3fc.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_e7ba085b8e1d26b3a6fac0ed2c7cd3fc.jpg saved to cache
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5
2026-03-28 18:43:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456432d90>
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_61758b13814b6476cd9917415c064f2c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_61758b13814b6476cd9917415c064f2c.jpg saved to cache
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8
2026-03-28 18:43:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4695c50-6ea7-5d17-8c10-a32e8b470c24 with identifier: CC29120
2026-03-28 18:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4695c50-6ea7-5d17-8c10-a32e8b470c24 with scrape type 1
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4695c50-6ea7-5d17-8c10-a32e8b470c24
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F88%252F2788397e351b85b087ea74ccd668f602%252Fpa%252FCC29120_51f4a39436386a192b20e50b3b1fc30f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_51f4a39436386a192b20e50b3b1fc30f.jpg already downloaded
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F88%252F2788397e351b85b087ea74ccd668f602%252Fpa%252FCC29120_c2ba3e0ea37adf1b8c1f6d17a533e25e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_c2ba3e0ea37adf1b8c1f6d17a533e25e.jpg already downloaded
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F88%252F2788397e351b85b087ea74ccd668f602%252Fpa%252FCC29120_fe2456cc066c7907e7f6539558f0a2d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_fe2456cc066c7907e7f6539558f0a2d6.jpg already downloaded
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F88%252F2788397e351b85b087ea74ccd668f602%252Fpa%252FCC29120_0895ef1138138665cf43f9fc29c99ce0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_0895ef1138138665cf43f9fc29c99ce0.jpg already downloaded
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F88%252F2788397e351b85b087ea74ccd668f602%252Fpa%252FCC29120_3dffb2fbb712af04c3e69337eda5831b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_3dffb2fbb712af04c3e69337eda5831b.jpg already downloaded
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F88%252F2788397e351b85b087ea74ccd668f602%252Fpa%252FCC29120_59ead3f5fd697048914d93639943c3c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_59ead3f5fd697048914d93639943c3c5.jpg already downloaded
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F88%252F2788397e351b85b087ea74ccd668f602%252Fpa%252FCC29120_3729d20858f998dbe361e3fb952a8d05.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_3729d20858f998dbe361e3fb952a8d05.jpg already downloaded
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F88%252F2788397e351b85b087ea74ccd668f602%252Fpa%252FCC29120_b20de66ae6c76ad9954769fce9c816bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_b20de66ae6c76ad9954769fce9c816bf.jpg already downloaded
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F88%252F2788397e351b85b087ea74ccd668f602%252Fpa%252FCC29120_2610d9f229db1662cc37f34d74aaef1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_2610d9f229db1662cc37f34d74aaef1b.jpg already downloaded
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F88%252F2788397e351b85b087ea74ccd668f602%252Fpa%252FCC29120_983b13388aaf3fc414824788e96c4948.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_983b13388aaf3fc414824788e96c4948.jpg already downloaded
2026-03-28 18:43:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4695c50-6ea7-5d17-8c10-a32e8b470c24, identifier: CC29120
2026-03-28 18:43:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b5110>
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_a36b7c698012e4d0d0f89e23ec22fa04.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_a36b7c698012e4d0d0f89e23ec22fa04.jpg saved to cache
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5
2026-03-28 18:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4695c50-6ea7-5d17-8c10-a32e8b470c24 with identifier: CC29120
2026-03-28 18:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4695c50-6ea7-5d17-8c10-a32e8b470c24 with identifier: CC29120
2026-03-28 18:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4695c50-6ea7-5d17-8c10-a32e8b470c24 with identifier: CC29120 to the API
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CC29120>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:17Z',
 'fuel_type': 'petrol',
 'id': 'a4695c50-6ea7-5d17-8c10-a32e8b470c24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC29120',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 55894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_51f4a39436386a192b20e50b3b1fc30f.jpg',
                'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_c2ba3e0ea37adf1b8c1f6d17a533e25e.jpg',
                'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_fe2456cc066c7907e7f6539558f0a2d6.jpg',
                'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_0895ef1138138665cf43f9fc29c99ce0.jpg',
                'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_3dffb2fbb712af04c3e69337eda5831b.jpg',
                'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_59ead3f5fd697048914d93639943c3c5.jpg',
                'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_3729d20858f998dbe361e3fb952a8d05.jpg',
                'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_b20de66ae6c76ad9954769fce9c816bf.jpg',
                'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_2610d9f229db1662cc37f34d74aaef1b.jpg',
                'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_983b13388aaf3fc414824788e96c4948.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4695c50-6ea7-5d17-8c10-a32e8b470c24/a4695c50-6ea7-5d17-8c10-a32e8b470c24_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1994717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_51f4a39436386a192b20e50b3b1fc30f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4695c50-6ea7-5d17-8c10-a32e8b470c24/a4695c50-6ea7-5d17-8c10-a32e8b470c24_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2042381,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_c2ba3e0ea37adf1b8c1f6d17a533e25e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4695c50-6ea7-5d17-8c10-a32e8b470c24/a4695c50-6ea7-5d17-8c10-a32e8b470c24_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2152175,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_fe2456cc066c7907e7f6539558f0a2d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4695c50-6ea7-5d17-8c10-a32e8b470c24/a4695c50-6ea7-5d17-8c10-a32e8b470c24_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_0895ef1138138665cf43f9fc29c99ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4695c50-6ea7-5d17-8c10-a32e8b470c24/a4695c50-6ea7-5d17-8c10-a32e8b470c24_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2089157,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_3dffb2fbb712af04c3e69337eda5831b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4695c50-6ea7-5d17-8c10-a32e8b470c24/a4695c50-6ea7-5d17-8c10-a32e8b470c24_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2661205,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_59ead3f5fd697048914d93639943c3c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4695c50-6ea7-5d17-8c10-a32e8b470c24/a4695c50-6ea7-5d17-8c10-a32e8b470c24_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_3729d20858f998dbe361e3fb952a8d05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4695c50-6ea7-5d17-8c10-a32e8b470c24/a4695c50-6ea7-5d17-8c10-a32e8b470c24_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_b20de66ae6c76ad9954769fce9c816bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4695c50-6ea7-5d17-8c10-a32e8b470c24/a4695c50-6ea7-5d17-8c10-a32e8b470c24_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2237496,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_2610d9f229db1662cc37f34d74aaef1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4695c50-6ea7-5d17-8c10-a32e8b470c24/a4695c50-6ea7-5d17-8c10-a32e8b470c24_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1978393,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/88/2788397e351b85b087ea74ccd668f602/pa/CC29120_983b13388aaf3fc414824788e96c4948.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.5 TSI ACT sport',
 'transmission': 'automatic',
 'trim': 'sport',
 'year': 2019}
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC29120%27 HTTP/1.1" 200 None
2026-03-28 18:43:33 [auto1.de] INFO: Saving data for CC29120: {'created_time': 1774723413.510462, 'last_price_update_time': 1774723413.510474, 'auction_closing_time': 1774882817.0}
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC29120') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F1e%252F451e94d3c48318e26466bd2611511ecd%252Fpa%252FJY00372_acd8a4cc82c00171b0baf8bf109b814a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_acd8a4cc82c00171b0baf8bf109b814a.jpg not downloaded yet
2026-03-28 18:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN95458/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TE40935> (referer: https://www.auto1.com/v1/car-details-view/TE40935/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F1e%252F451e94d3c48318e26466bd2611511ecd%252Fpa%252FJY00372_fab143119b99408198def7dea40c3223.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_fab143119b99408198def7dea40c3223.jpg not downloaded yet
2026-03-28 18:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM00053> (referer: https://www.auto1.com/v1/car-details-view/BM00053/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456466d90>
2026-03-28 18:43:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_d6490840a2b306e47cf0afe53d01b557.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_d6490840a2b306e47cf0afe53d01b557.jpg saved to cache
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3f47c76-908f-53af-91a9-e878fa2bb1d2
2026-03-28 18:43:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456490d50>
2026-03-28 18:43:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_ec2a8ab242ef40625c61ca85dfa296cf.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_ec2a8ab242ef40625c61ca85dfa296cf.jpg saved to cache
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8
2026-03-28 18:43:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b9f90>
2026-03-28 18:43:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_b73e9544e5cac5cf4ba3c4923c2e7e2e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_b73e9544e5cac5cf4ba3c4923c2e7e2e.jpg saved to cache
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 483ad7c1-be4f-5853-a8d5-c724eb134227
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F1e%252F451e94d3c48318e26466bd2611511ecd%252Fpa%252FJY00372_c1ca707d3dec981eee83658efacac8ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_c1ca707d3dec981eee83658efacac8ab.jpg not downloaded yet
2026-03-28 18:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with identifier: TE40935
2026-03-28 18:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with scrape type 1
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd1%252Fd8d11fd170fbc1d5fddd4a963a0bd567%252Fpa%252FTE40935_6611d76828c6bd865f83944e31e8f7a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_6611d76828c6bd865f83944e31e8f7a4.jpg already downloaded
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd1%252Fd8d11fd170fbc1d5fddd4a963a0bd567%252Fpa%252FTE40935_7d0ea95aaa3909bb6802fb8cea348291.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_7d0ea95aaa3909bb6802fb8cea348291.jpg already downloaded
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd1%252Fd8d11fd170fbc1d5fddd4a963a0bd567%252Fpa%252FTE40935_1e18c1594a48e5fbfef2d276d9477bce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_1e18c1594a48e5fbfef2d276d9477bce.jpg already downloaded
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd1%252Fd8d11fd170fbc1d5fddd4a963a0bd567%252Fpa%252FTE40935_c4d282e9d109b8bde633ce0569aefc6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_c4d282e9d109b8bde633ce0569aefc6a.jpg already downloaded
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd1%252Fd8d11fd170fbc1d5fddd4a963a0bd567%252Fpa%252FTE40935_f82131cca824a5c152f517f4bd92f79b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_f82131cca824a5c152f517f4bd92f79b.jpg already downloaded
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd1%252Fd8d11fd170fbc1d5fddd4a963a0bd567%252Fpa%252FTE40935_9dd930658f62467c5fe5257c80162a18.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_9dd930658f62467c5fe5257c80162a18.jpg already downloaded
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd1%252Fd8d11fd170fbc1d5fddd4a963a0bd567%252Fpa%252FTE40935_206d688121c12c60f0b3ca2007796cf2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_206d688121c12c60f0b3ca2007796cf2.jpg already downloaded
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd1%252Fd8d11fd170fbc1d5fddd4a963a0bd567%252Fpa%252FTE40935_08fea37c3dc8b6586e6394d8f823b7eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_08fea37c3dc8b6586e6394d8f823b7eb.jpg already downloaded
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd1%252Fd8d11fd170fbc1d5fddd4a963a0bd567%252Fpa%252FTE40935_aedd168e78b41d3b1df68e0ee2f48f3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_aedd168e78b41d3b1df68e0ee2f48f3e.jpg already downloaded
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd1%252Fd8d11fd170fbc1d5fddd4a963a0bd567%252Fpa%252FTE40935_8dc2597a2c395a372c508e6df43f1581.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_8dc2597a2c395a372c508e6df43f1581.jpg already downloaded
2026-03-28 18:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a115b0a9-c4ff-5bd2-bd26-83062c79fc48, identifier: TE40935
2026-03-28 18:43:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a62c19-099e-5cb3-9054-47fb26baf592 with identifier: BM00053
2026-03-28 18:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a62c19-099e-5cb3-9054-47fb26baf592 with scrape type 1
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2a62c19-099e-5cb3-9054-47fb26baf592
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Faf%252Fb0af0720b85226d66ce9091699421184%252Fpa%252FBM00053_efd6fd3959d510a813e1c96fb435b716.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_efd6fd3959d510a813e1c96fb435b716.jpg already downloaded
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Faf%252Fb0af0720b85226d66ce9091699421184%252Fpa%252FBM00053_50d7955796de5d594b151b6bc3c30257.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_50d7955796de5d594b151b6bc3c30257.jpg already downloaded
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Faf%252Fb0af0720b85226d66ce9091699421184%252Fpa%252FBM00053_73b6cb4fb4d4ed8b025f19209684e416.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_73b6cb4fb4d4ed8b025f19209684e416.jpg already downloaded
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Faf%252Fb0af0720b85226d66ce9091699421184%252Fpa%252FBM00053_2ad688684a6d5e6b4055d24095584123.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_2ad688684a6d5e6b4055d24095584123.jpg already downloaded
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Faf%252Fb0af0720b85226d66ce9091699421184%252Fpa%252FBM00053_3edabf1b527f8d03fad307b8f9d2e5e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_3edabf1b527f8d03fad307b8f9d2e5e0.jpg already downloaded
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Faf%252Fb0af0720b85226d66ce9091699421184%252Fpa%252FBM00053_c9da34516a28373e7763562cea947c73.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_c9da34516a28373e7763562cea947c73.jpg already downloaded
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Faf%252Fb0af0720b85226d66ce9091699421184%252Fpa%252FBM00053_289716235484dac91258923000506059.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_289716235484dac91258923000506059.jpg already downloaded
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Faf%252Fb0af0720b85226d66ce9091699421184%252Fpa%252FBM00053_55d587ff221ca8ca5804d606843b5a6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_55d587ff221ca8ca5804d606843b5a6c.jpg already downloaded
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Faf%252Fb0af0720b85226d66ce9091699421184%252Fpa%252FBM00053_f98dc045ae78414d23059530565cd14d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_f98dc045ae78414d23059530565cd14d.jpg already downloaded
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Faf%252Fb0af0720b85226d66ce9091699421184%252Fpa%252FBM00053_fab3ee217d67644c67392df0825ad660.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_fab3ee217d67644c67392df0825ad660.jpg already downloaded
2026-03-28 18:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2a62c19-099e-5cb3-9054-47fb26baf592, identifier: BM00053
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F1e%252F451e94d3c48318e26466bd2611511ecd%252Fpa%252FJY00372_2d3117ce4549d847d0f5c7616e621110.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_2d3117ce4549d847d0f5c7616e621110.jpg not downloaded yet
2026-03-28 18:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with identifier: TE40935
2026-03-28 18:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with identifier: TE40935
2026-03-28 18:43:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with identifier: TE40935 to the API
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TE40935>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:31:16Z',
 'fuel_type': 'petrol',
 'id': 'a115b0a9-c4ff-5bd2-bd26-83062c79fc48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE40935',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 99321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_6611d76828c6bd865f83944e31e8f7a4.jpg',
                'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_7d0ea95aaa3909bb6802fb8cea348291.jpg',
                'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_1e18c1594a48e5fbfef2d276d9477bce.jpg',
                'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_c4d282e9d109b8bde633ce0569aefc6a.jpg',
                'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_f82131cca824a5c152f517f4bd92f79b.jpg',
                'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_9dd930658f62467c5fe5257c80162a18.jpg',
                'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_206d688121c12c60f0b3ca2007796cf2.jpg',
                'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_08fea37c3dc8b6586e6394d8f823b7eb.jpg',
                'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_aedd168e78b41d3b1df68e0ee2f48f3e.jpg',
                'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_8dc2597a2c395a372c508e6df43f1581.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2830885,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_6611d76828c6bd865f83944e31e8f7a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_7d0ea95aaa3909bb6802fb8cea348291.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_1e18c1594a48e5fbfef2d276d9477bce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_c4d282e9d109b8bde633ce0569aefc6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_f82131cca824a5c152f517f4bd92f79b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_9dd930658f62467c5fe5257c80162a18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_206d688121c12c60f0b3ca2007796cf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2826766,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_08fea37c3dc8b6586e6394d8f823b7eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_aedd168e78b41d3b1df68e0ee2f48f3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a115b0a9-c4ff-5bd2-bd26-83062c79fc48/a115b0a9-c4ff-5bd2-bd26-83062c79fc48_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d1/d8d11fd170fbc1d5fddd4a963a0bd567/pa/TE40935_8dc2597a2c395a372c508e6df43f1581.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE40935%27 HTTP/1.1" 200 None
2026-03-28 18:43:34 [auto1.de] INFO: Saving data for TE40935: {'created_time': 1774723414.914754, 'last_price_update_time': 1774723414.914765, 'auction_closing_time': 1774884676.0}
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE40935') HTTP/1.1" 204 0
2026-03-28 18:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2a62c19-099e-5cb3-9054-47fb26baf592 with identifier: BM00053
2026-03-28 18:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2a62c19-099e-5cb3-9054-47fb26baf592 with identifier: BM00053
2026-03-28 18:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2a62c19-099e-5cb3-9054-47fb26baf592 with identifier: BM00053 to the API
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BM00053>
{'auction_title': '',
 'c_o_2_emission_value': 236,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:54:16Z',
 'fuel_type': 'diesel',
 'id': 'd2a62c19-099e-5cb3-9054-47fb26baf592',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM00053',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 211206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_efd6fd3959d510a813e1c96fb435b716.jpg',
                'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_50d7955796de5d594b151b6bc3c30257.jpg',
                'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_73b6cb4fb4d4ed8b025f19209684e416.jpg',
                'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_2ad688684a6d5e6b4055d24095584123.jpg',
                'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_3edabf1b527f8d03fad307b8f9d2e5e0.jpg',
                'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_c9da34516a28373e7763562cea947c73.jpg',
                'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_289716235484dac91258923000506059.jpg',
                'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_55d587ff221ca8ca5804d606843b5a6c.jpg',
                'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_f98dc045ae78414d23059530565cd14d.jpg',
                'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_fab3ee217d67644c67392df0825ad660.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a62c19-099e-5cb3-9054-47fb26baf592/d2a62c19-099e-5cb3-9054-47fb26baf592_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_efd6fd3959d510a813e1c96fb435b716.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a62c19-099e-5cb3-9054-47fb26baf592/d2a62c19-099e-5cb3-9054-47fb26baf592_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_50d7955796de5d594b151b6bc3c30257.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a62c19-099e-5cb3-9054-47fb26baf592/d2a62c19-099e-5cb3-9054-47fb26baf592_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_73b6cb4fb4d4ed8b025f19209684e416.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a62c19-099e-5cb3-9054-47fb26baf592/d2a62c19-099e-5cb3-9054-47fb26baf592_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_2ad688684a6d5e6b4055d24095584123.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a62c19-099e-5cb3-9054-47fb26baf592/d2a62c19-099e-5cb3-9054-47fb26baf592_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_3edabf1b527f8d03fad307b8f9d2e5e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a62c19-099e-5cb3-9054-47fb26baf592/d2a62c19-099e-5cb3-9054-47fb26baf592_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_c9da34516a28373e7763562cea947c73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a62c19-099e-5cb3-9054-47fb26baf592/d2a62c19-099e-5cb3-9054-47fb26baf592_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_289716235484dac91258923000506059.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a62c19-099e-5cb3-9054-47fb26baf592/d2a62c19-099e-5cb3-9054-47fb26baf592_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_55d587ff221ca8ca5804d606843b5a6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a62c19-099e-5cb3-9054-47fb26baf592/d2a62c19-099e-5cb3-9054-47fb26baf592_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_f98dc045ae78414d23059530565cd14d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a62c19-099e-5cb3-9054-47fb26baf592/d2a62c19-099e-5cb3-9054-47fb26baf592_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/af/b0af0720b85226d66ce9091699421184/pa/BM00053_fab3ee217d67644c67392df0825ad660.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Trafic 2.5 dCi Generation Evado',
 'transmission': 'manual',
 'trim': 'Generation Evado',
 'year': 2009}
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM00053%27 HTTP/1.1" 200 None
2026-03-28 18:43:35 [auto1.de] INFO: Saving data for BM00053: {'created_time': 1774723415.229548, 'last_price_update_time': 1774723415.22956, 'auction_closing_time': 1774886056.0}
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM00053') HTTP/1.1" 204 0
2026-03-28 18:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_41c9d1fee7fbb63689e211dd125b4379.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_53fbb6c997fadc7759c96a8eceb0947b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_ab7c6d35dab58e54587b347debc75916.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_f115c389a722a83533f7549cd60661dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_f8a4a3671448df3805d78541d02e8ecd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_565b16be2058b16177eab5a6da3968cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_2691b8948c27db12cb383abccc32c005.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_cbbd33911d33e1a358365648e3124815.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2457164410>
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f170e5e9-1e83-5c24-924a-e38ce729509b/f170e5e9-1e83-5c24-924a-e38ce729509b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F1e%252F451e94d3c48318e26466bd2611511ecd%252Fpa%252FJY00372_41c9d1fee7fbb63689e211dd125b4379.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_41c9d1fee7fbb63689e211dd125b4379.jpg saved to cache
2026-03-28 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f170e5e9-1e83-5c24-924a-e38ce729509b
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562fef50>
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_53fbb6c997fadc7759c96a8eceb0947b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_53fbb6c997fadc7759c96a8eceb0947b.jpg saved to cache
2026-03-28 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7faebd26-33b6-5cd5-847d-8446a68f2db1
2026-03-28 18:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_2d3117ce4549d847d0f5c7616e621110.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_c1ca707d3dec981eee83658efacac8ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564f9dd0>
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_ab7c6d35dab58e54587b347debc75916.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_ab7c6d35dab58e54587b347debc75916.jpg saved to cache
2026-03-28 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7faebd26-33b6-5cd5-847d-8446a68f2db1
2026-03-28 18:43:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245642d0d0>
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_f115c389a722a83533f7549cd60661dd.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_f115c389a722a83533f7549cd60661dd.jpg saved to cache
2026-03-28 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3f47c76-908f-53af-91a9-e878fa2bb1d2
2026-03-28 18:43:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b5790>
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_f8a4a3671448df3805d78541d02e8ecd.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_f8a4a3671448df3805d78541d02e8ecd.jpg saved to cache
2026-03-28 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3f47c76-908f-53af-91a9-e878fa2bb1d2
2026-03-28 18:43:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456409bd0>
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_565b16be2058b16177eab5a6da3968cc.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_565b16be2058b16177eab5a6da3968cc.jpg saved to cache
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3f47c76-908f-53af-91a9-e878fa2bb1d2
2026-03-28 18:43:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b4c10>
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_2691b8948c27db12cb383abccc32c005.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_2691b8948c27db12cb383abccc32c005.jpg saved to cache
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 483ad7c1-be4f-5853-a8d5-c724eb134227
2026-03-28 18:43:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560adfd0>
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_cbbd33911d33e1a358365648e3124815.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_cbbd33911d33e1a358365648e3124815.jpg saved to cache
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 483ad7c1-be4f-5853-a8d5-c724eb134227
2026-03-28 18:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_ad2cfdb3afe683a97be2911af2f36a1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_acd8a4cc82c00171b0baf8bf109b814a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD22344> (referer: https://www.auto1.com/v1/car-details-view/MD22344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638cb10>
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f170e5e9-1e83-5c24-924a-e38ce729509b/f170e5e9-1e83-5c24-924a-e38ce729509b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F1e%252F451e94d3c48318e26466bd2611511ecd%252Fpa%252FJY00372_2d3117ce4549d847d0f5c7616e621110.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_2d3117ce4549d847d0f5c7616e621110.jpg saved to cache
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f170e5e9-1e83-5c24-924a-e38ce729509b
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560686d0>
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f170e5e9-1e83-5c24-924a-e38ce729509b/f170e5e9-1e83-5c24-924a-e38ce729509b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F1e%252F451e94d3c48318e26466bd2611511ecd%252Fpa%252FJY00372_c1ca707d3dec981eee83658efacac8ab.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_c1ca707d3dec981eee83658efacac8ab.jpg saved to cache
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f170e5e9-1e83-5c24-924a-e38ce729509b
2026-03-28 18:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_a993287e4e7245d4d83308c3d835bb70.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_00fd69a02743f131c1645c98f576c813.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561bd390>
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_ad2cfdb3afe683a97be2911af2f36a1b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_ad2cfdb3afe683a97be2911af2f36a1b.jpg saved to cache
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7faebd26-33b6-5cd5-847d-8446a68f2db1
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547685d0>
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f170e5e9-1e83-5c24-924a-e38ce729509b/f170e5e9-1e83-5c24-924a-e38ce729509b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F1e%252F451e94d3c48318e26466bd2611511ecd%252Fpa%252FJY00372_acd8a4cc82c00171b0baf8bf109b814a.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_acd8a4cc82c00171b0baf8bf109b814a.jpg saved to cache
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f170e5e9-1e83-5c24-924a-e38ce729509b
2026-03-28 18:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbdd504e-c145-5580-b504-e04fdf61b269 with identifier: MD22344
2026-03-28 18:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbdd504e-c145-5580-b504-e04fdf61b269 with scrape type 1
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cbdd504e-c145-5580-b504-e04fdf61b269
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_83f91f7c3474e62ed2c1fed517e976f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_83f91f7c3474e62ed2c1fed517e976f7.jpg not downloaded yet
2026-03-28 18:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_0a00d98737c73c2e81b1a67e394d97a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_7bc11e02c8d1b2e5b146a3b63a752f8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_7bc11e02c8d1b2e5b146a3b63a752f8c.jpg not downloaded yet
2026-03-28 18:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_fab143119b99408198def7dea40c3223.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_f3fee6e212ae5f4715761f3f72b8c663.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_f3fee6e212ae5f4715761f3f72b8c663.jpg not downloaded yet
2026-03-28 18:43:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562e2890>
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_a993287e4e7245d4d83308c3d835bb70.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_a993287e4e7245d4d83308c3d835bb70.jpg saved to cache
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 483ad7c1-be4f-5853-a8d5-c724eb134227
2026-03-28 18:43:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562514d0>
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_00fd69a02743f131c1645c98f576c813.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_00fd69a02743f131c1645c98f576c813.jpg saved to cache
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3f47c76-908f-53af-91a9-e878fa2bb1d2
2026-03-28 18:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_41d79db7f4f661a9bcb53f41f3ee23fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_b1a61538d481e63639f7f4be2734adc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_b1a61538d481e63639f7f4be2734adc7.jpg not downloaded yet
2026-03-28 18:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_5eabf756c705c8c1c5e350dd808b8142.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_910cf372f79721ee80ff3ee2fadcff4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_910cf372f79721ee80ff3ee2fadcff4e.jpg not downloaded yet
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561ed310>
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_0a00d98737c73c2e81b1a67e394d97a3.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_0a00d98737c73c2e81b1a67e394d97a3.jpg saved to cache
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3f47c76-908f-53af-91a9-e878fa2bb1d2
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561939d0>
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f170e5e9-1e83-5c24-924a-e38ce729509b/f170e5e9-1e83-5c24-924a-e38ce729509b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F1e%252F451e94d3c48318e26466bd2611511ecd%252Fpa%252FJY00372_fab143119b99408198def7dea40c3223.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_fab143119b99408198def7dea40c3223.jpg saved to cache
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f170e5e9-1e83-5c24-924a-e38ce729509b
2026-03-28 18:43:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f170e5e9-1e83-5c24-924a-e38ce729509b, skipping ID generation
2026-03-28 18:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f170e5e9-1e83-5c24-924a-e38ce729509b with scrape type 1
2026-03-28 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f170e5e9-1e83-5c24-924a-e38ce729509b sending to next pipeline
2026-03-28 18:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f170e5e9-1e83-5c24-924a-e38ce729509b, identifier: JY00372
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_5cdd1061b79efacca12bbf959f0e693c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_5cdd1061b79efacca12bbf959f0e693c.jpg not downloaded yet
2026-03-28 18:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f170e5e9-1e83-5c24-924a-e38ce729509b with identifier: JY00372
2026-03-28 18:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f170e5e9-1e83-5c24-924a-e38ce729509b with identifier: JY00372
2026-03-28 18:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f170e5e9-1e83-5c24-924a-e38ce729509b with identifier: JY00372 to the API
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_fab143119b99408198def7dea40c3223.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:11:31Z',
 'fuel_type': 'petrol',
 'id': 'f170e5e9-1e83-5c24-924a-e38ce729509b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY00372',
 'listing': 'auction',
 'location': 'DE, Sulzbach-Rosenberg',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 140677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f170e5e9-1e83-5c24-924a-e38ce729509b/f170e5e9-1e83-5c24-924a-e38ce729509b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_41c9d1fee7fbb63689e211dd125b4379.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f170e5e9-1e83-5c24-924a-e38ce729509b/f170e5e9-1e83-5c24-924a-e38ce729509b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_acd8a4cc82c00171b0baf8bf109b814a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f170e5e9-1e83-5c24-924a-e38ce729509b/f170e5e9-1e83-5c24-924a-e38ce729509b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_fab143119b99408198def7dea40c3223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f170e5e9-1e83-5c24-924a-e38ce729509b/f170e5e9-1e83-5c24-924a-e38ce729509b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_c1ca707d3dec981eee83658efacac8ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f170e5e9-1e83-5c24-924a-e38ce729509b/f170e5e9-1e83-5c24-924a-e38ce729509b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 150591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/1e/451e94d3c48318e26466bd2611511ecd/pa/JY00372_2d3117ce4549d847d0f5c7616e621110.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 Life Gewinner Caddy',
 'transmission': 'manual',
 'trim': 'Life Gewinner',
 'year': 2009}
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY00372%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [auto1.de] INFO: Saving data for JY00372: {'created_time': 1774723417.527997, 'last_price_update_time': 1774723417.528009, 'auction_closing_time': 1774883491.0}
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY00372') HTTP/1.1" 204 0
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_46511f96c057783feb3b91e60551e0f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_46511f96c057783feb3b91e60551e0f7.jpg not downloaded yet
2026-03-28 18:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM38106> (referer: https://www.auto1.com/v1/car-details-view/TM38106/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_b1a61538d481e63639f7f4be2734adc7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_f3fee6e212ae5f4715761f3f72b8c663.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN95458> (referer: https://www.auto1.com/v1/car-details-view/GN95458/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_865f139ca0d90d0dcab91be12207fa06.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_865f139ca0d90d0dcab91be12207fa06.jpg not downloaded yet
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561ee4d0>
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_41d79db7f4f661a9bcb53f41f3ee23fb.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_41d79db7f4f661a9bcb53f41f3ee23fb.jpg saved to cache
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564bb190>
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_5eabf756c705c8c1c5e350dd808b8142.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_5eabf756c705c8c1c5e350dd808b8142.jpg saved to cache
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_9073cfa74297711d736e8283fb42bc05.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_9073cfa74297711d736e8283fb42bc05.jpg not downloaded yet
2026-03-28 18:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG76993> (referer: https://www.auto1.com/v1/car-details-view/SG76993/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_5dbe16bdf6e3914c2e9d719a196c61b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_5dbe16bdf6e3914c2e9d719a196c61b0.jpg not downloaded yet
2026-03-28 18:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b8c5b06-f98b-5961-b34e-21a68d12f23e with identifier: TM38106
2026-03-28 18:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b8c5b06-f98b-5961-b34e-21a68d12f23e with scrape type 1
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4b8c5b06-f98b-5961-b34e-21a68d12f23e
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc9%252Fb3c9cecfc3ce30b319e4e13808d04b26%252Fpa%252FTM38106_1a75e11e2289440eb487871426cec00d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_1a75e11e2289440eb487871426cec00d.jpg not downloaded yet
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456518150>
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_b1a61538d481e63639f7f4be2734adc7.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_b1a61538d481e63639f7f4be2734adc7.jpg saved to cache
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cbdd504e-c145-5580-b504-e04fdf61b269
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454762090>
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_f3fee6e212ae5f4715761f3f72b8c663.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_f3fee6e212ae5f4715761f3f72b8c663.jpg saved to cache
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cbdd504e-c145-5580-b504-e04fdf61b269
2026-03-28 18:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 473c30f5-9434-5bb9-9f28-3e1ced61ff3c with identifier: GN95458
2026-03-28 18:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c with scrape type 1
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_d50145a04aa79a83949a430d22e20c15.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_d50145a04aa79a83949a430d22e20c15.jpg not downloaded yet
2026-03-28 18:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_7bc11e02c8d1b2e5b146a3b63a752f8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_83f91f7c3474e62ed2c1fed517e976f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc9%252Fb3c9cecfc3ce30b319e4e13808d04b26%252Fpa%252FTM38106_7eaef8e4f6da6394cdf221c193dcff22.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_7eaef8e4f6da6394cdf221c193dcff22.jpg not downloaded yet
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_495dac7a2d1209d756adf1fdea1bb9c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_495dac7a2d1209d756adf1fdea1bb9c3.jpg not downloaded yet
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc9%252Fb3c9cecfc3ce30b319e4e13808d04b26%252Fpa%252FTM38106_27b29c57ce0da3975cac336c2040ef66.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_27b29c57ce0da3975cac336c2040ef66.jpg not downloaded yet
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_80339bfd22e08fe1c796c1c320c19b83.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_80339bfd22e08fe1c796c1c320c19b83.jpg not downloaded yet
2026-03-28 18:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64 with identifier: SG76993
2026-03-28 18:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64 with scrape type 1
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_54e9d6373368dd83667828c8dcb22936.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_54e9d6373368dd83667828c8dcb22936.jpg not downloaded yet
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc9%252Fb3c9cecfc3ce30b319e4e13808d04b26%252Fpa%252FTM38106_771b0c22997b8e7c7508a979616be3f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_771b0c22997b8e7c7508a979616be3f2.jpg not downloaded yet
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_b269c06d898131dd7992748def11218d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_b269c06d898131dd7992748def11218d.jpg not downloaded yet
2026-03-28 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_431863067c38972e690d00dc8ed79d59.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_431863067c38972e690d00dc8ed79d59.jpg not downloaded yet
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc9%252Fb3c9cecfc3ce30b319e4e13808d04b26%252Fpa%252FTM38106_e064c6d24bf7625598c85e4d578dd8d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_e064c6d24bf7625598c85e4d578dd8d3.jpg not downloaded yet
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_82c52eb5330d3b7a0bdac2a34b6d201a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_82c52eb5330d3b7a0bdac2a34b6d201a.jpg not downloaded yet
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_f916707b1ec39f72833ee1a38cbf5665.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_f916707b1ec39f72833ee1a38cbf5665.jpg not downloaded yet
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564f8e10>
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_7bc11e02c8d1b2e5b146a3b63a752f8c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_7bc11e02c8d1b2e5b146a3b63a752f8c.jpg saved to cache
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cbdd504e-c145-5580-b504-e04fdf61b269
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458560a50>
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_83f91f7c3474e62ed2c1fed517e976f7.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_83f91f7c3474e62ed2c1fed517e976f7.jpg saved to cache
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cbdd504e-c145-5580-b504-e04fdf61b269
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_e003ce752ea7ed09fcb3f99405653118.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_a19dfe5de71ec5d8a3d04787825c5938.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_a19dfe5de71ec5d8a3d04787825c5938.jpg not downloaded yet
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_90f155b5afbde0feff1da1e7405eed11.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_90f155b5afbde0feff1da1e7405eed11.jpg not downloaded yet
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_7d8a6e327a352de712d284ea4ae0ac7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_46511f96c057783feb3b91e60551e0f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_4b967715b462f571fd2edd4008d643c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_4b967715b462f571fd2edd4008d643c8.jpg not downloaded yet
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_50ef1f3dd151753a542654a7f1ef3db8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_50ef1f3dd151753a542654a7f1ef3db8.jpg not downloaded yet
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_094f911402bb58a6eb5a557cf26ca134.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_8c0de635218eaae6cb14a6c150419906.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_6c7ae63fb3255fa22520b1d9e39940c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_6c7ae63fb3255fa22520b1d9e39940c5.jpg not downloaded yet
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_3be17b8c5286b553a6a83c2b6a35a133.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_3be17b8c5286b553a6a83c2b6a35a133.jpg not downloaded yet
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_7f3e5f336cf550e40d500347bd20363c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_7f3e5f336cf550e40d500347bd20363c.jpg not downloaded yet
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_6c15dde2148b5c8c7530ef3eb808b67b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_6c15dde2148b5c8c7530ef3eb808b67b.jpg not downloaded yet
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bad50>
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_e003ce752ea7ed09fcb3f99405653118.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_e003ce752ea7ed09fcb3f99405653118.jpg saved to cache
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7faebd26-33b6-5cd5-847d-8446a68f2db1
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_9987be63bd80ef3350a2f5a6554ef449.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_9987be63bd80ef3350a2f5a6554ef449.jpg not downloaded yet
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_9d05bc1b0f1352f9be17ee1275ea6c38.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_9d05bc1b0f1352f9be17ee1275ea6c38.jpg not downloaded yet
2026-03-28 18:43:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456157050>
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_7d8a6e327a352de712d284ea4ae0ac7e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_7d8a6e327a352de712d284ea4ae0ac7e.jpg saved to cache
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7faebd26-33b6-5cd5-847d-8446a68f2db1
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458a68110>
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_46511f96c057783feb3b91e60551e0f7.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_46511f96c057783feb3b91e60551e0f7.jpg saved to cache
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cbdd504e-c145-5580-b504-e04fdf61b269
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_5a919ac4df2d545ddd8e54eb888e558e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_5a919ac4df2d545ddd8e54eb888e558e.jpg not downloaded yet
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_5cdd1061b79efacca12bbf959f0e693c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_1e80b9cd0954bf8e0dc2f7de065489b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_ef3f1554b3dee214994e61dd830ad043.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_ef3f1554b3dee214994e61dd830ad043.jpg not downloaded yet
2026-03-28 18:43:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561cda50>
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_094f911402bb58a6eb5a557cf26ca134.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_094f911402bb58a6eb5a557cf26ca134.jpg saved to cache
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7faebd26-33b6-5cd5-847d-8446a68f2db1
2026-03-28 18:43:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456491110>
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_8c0de635218eaae6cb14a6c150419906.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_8c0de635218eaae6cb14a6c150419906.jpg saved to cache
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7faebd26-33b6-5cd5-847d-8446a68f2db1
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_070f5a5e220318dbafaa5536d4fd6c44.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_ad76d70ef16e9b003f1b993307c9d8f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245650dc90>
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_5cdd1061b79efacca12bbf959f0e693c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_5cdd1061b79efacca12bbf959f0e693c.jpg saved to cache
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cbdd504e-c145-5580-b504-e04fdf61b269
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454775710>
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_1e80b9cd0954bf8e0dc2f7de065489b6.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_1e80b9cd0954bf8e0dc2f7de065489b6.jpg saved to cache
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_f916707b1ec39f72833ee1a38cbf5665.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_7e33b4e364b982019f31542a1b3dbfb8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_1a75e11e2289440eb487871426cec00d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_910cf372f79721ee80ff3ee2fadcff4e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_9073cfa74297711d736e8283fb42bc05.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_d50145a04aa79a83949a430d22e20c15.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bdd50>
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_070f5a5e220318dbafaa5536d4fd6c44.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_070f5a5e220318dbafaa5536d4fd6c44.jpg saved to cache
2026-03-28 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 483ad7c1-be4f-5853-a8d5-c724eb134227
2026-03-28 18:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_5a919ac4df2d545ddd8e54eb888e558e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456287650>
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_ad76d70ef16e9b003f1b993307c9d8f7.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_ad76d70ef16e9b003f1b993307c9d8f7.jpg saved to cache
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 483ad7c1-be4f-5853-a8d5-c724eb134227
2026-03-28 18:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_e064c6d24bf7625598c85e4d578dd8d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_9987be63bd80ef3350a2f5a6554ef449.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475aed0>
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_f916707b1ec39f72833ee1a38cbf5665.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_f916707b1ec39f72833ee1a38cbf5665.jpg saved to cache
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64
2026-03-28 18:43:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245476c590>
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_7e33b4e364b982019f31542a1b3dbfb8.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_7e33b4e364b982019f31542a1b3dbfb8.jpg saved to cache
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 483ad7c1-be4f-5853-a8d5-c724eb134227
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b9810>
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8c5b06-f98b-5961-b34e-21a68d12f23e/4b8c5b06-f98b-5961-b34e-21a68d12f23e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc9%252Fb3c9cecfc3ce30b319e4e13808d04b26%252Fpa%252FTM38106_1a75e11e2289440eb487871426cec00d.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_1a75e11e2289440eb487871426cec00d.jpg saved to cache
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b8c5b06-f98b-5961-b34e-21a68d12f23e
2026-03-28 18:43:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456374710>
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_910cf372f79721ee80ff3ee2fadcff4e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_910cf372f79721ee80ff3ee2fadcff4e.jpg saved to cache
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cbdd504e-c145-5580-b504-e04fdf61b269
2026-03-28 18:43:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456274150>
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_9073cfa74297711d736e8283fb42bc05.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_9073cfa74297711d736e8283fb42bc05.jpg saved to cache
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cbdd504e-c145-5580-b504-e04fdf61b269
2026-03-28 18:43:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458634590>
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_d50145a04aa79a83949a430d22e20c15.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_d50145a04aa79a83949a430d22e20c15.jpg saved to cache
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c
2026-03-28 18:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_6c15dde2148b5c8c7530ef3eb808b67b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_9d05bc1b0f1352f9be17ee1275ea6c38.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245624f610>
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_5a919ac4df2d545ddd8e54eb888e558e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_5a919ac4df2d545ddd8e54eb888e558e.jpg saved to cache
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456294310>
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8c5b06-f98b-5961-b34e-21a68d12f23e/4b8c5b06-f98b-5961-b34e-21a68d12f23e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc9%252Fb3c9cecfc3ce30b319e4e13808d04b26%252Fpa%252FTM38106_e064c6d24bf7625598c85e4d578dd8d3.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_e064c6d24bf7625598c85e4d578dd8d3.jpg saved to cache
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b8c5b06-f98b-5961-b34e-21a68d12f23e
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454762510>
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_9987be63bd80ef3350a2f5a6554ef449.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_9987be63bd80ef3350a2f5a6554ef449.jpg saved to cache
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c
2026-03-28 18:43:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563e8ad0>
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_6c15dde2148b5c8c7530ef3eb808b67b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_6c15dde2148b5c8c7530ef3eb808b67b.jpg saved to cache
2026-03-28 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64
2026-03-28 18:43:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245614a650>
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_9d05bc1b0f1352f9be17ee1275ea6c38.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_9d05bc1b0f1352f9be17ee1275ea6c38.jpg saved to cache
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_50ef1f3dd151753a542654a7f1ef3db8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_3be17b8c5286b553a6a83c2b6a35a133.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_90f155b5afbde0feff1da1e7405eed11.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_ef3f1554b3dee214994e61dd830ad043.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_82c52eb5330d3b7a0bdac2a34b6d201a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_7f3e5f336cf550e40d500347bd20363c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_4b967715b462f571fd2edd4008d643c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_431863067c38972e690d00dc8ed79d59.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_27b29c57ce0da3975cac336c2040ef66.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_771b0c22997b8e7c7508a979616be3f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_54e9d6373368dd83667828c8dcb22936.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245632f450>
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_50ef1f3dd151753a542654a7f1ef3db8.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_50ef1f3dd151753a542654a7f1ef3db8.jpg saved to cache
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245624fd90>
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_3be17b8c5286b553a6a83c2b6a35a133.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_3be17b8c5286b553a6a83c2b6a35a133.jpg saved to cache
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_6c7ae63fb3255fa22520b1d9e39940c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_a19dfe5de71ec5d8a3d04787825c5938.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_7eaef8e4f6da6394cdf221c193dcff22.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454763d10>
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_90f155b5afbde0feff1da1e7405eed11.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_90f155b5afbde0feff1da1e7405eed11.jpg saved to cache
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64
2026-03-28 18:43:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245632f450>
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_ef3f1554b3dee214994e61dd830ad043.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_ef3f1554b3dee214994e61dd830ad043.jpg saved to cache
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64
2026-03-28 18:43:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562d6590>
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_82c52eb5330d3b7a0bdac2a34b6d201a.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_82c52eb5330d3b7a0bdac2a34b6d201a.jpg saved to cache
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c
2026-03-28 18:43:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456306b90>
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_7f3e5f336cf550e40d500347bd20363c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_7f3e5f336cf550e40d500347bd20363c.jpg saved to cache
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c
2026-03-28 18:43:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b7850>
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_4b967715b462f571fd2edd4008d643c8.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_4b967715b462f571fd2edd4008d643c8.jpg saved to cache
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245632fcd0>
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_431863067c38972e690d00dc8ed79d59.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_431863067c38972e690d00dc8ed79d59.jpg saved to cache
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456156910>
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8c5b06-f98b-5961-b34e-21a68d12f23e/4b8c5b06-f98b-5961-b34e-21a68d12f23e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc9%252Fb3c9cecfc3ce30b319e4e13808d04b26%252Fpa%252FTM38106_27b29c57ce0da3975cac336c2040ef66.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_27b29c57ce0da3975cac336c2040ef66.jpg saved to cache
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b8c5b06-f98b-5961-b34e-21a68d12f23e
2026-03-28 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_495dac7a2d1209d756adf1fdea1bb9c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855e2d0>
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8c5b06-f98b-5961-b34e-21a68d12f23e/4b8c5b06-f98b-5961-b34e-21a68d12f23e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc9%252Fb3c9cecfc3ce30b319e4e13808d04b26%252Fpa%252FTM38106_771b0c22997b8e7c7508a979616be3f2.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_771b0c22997b8e7c7508a979616be3f2.jpg saved to cache
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b8c5b06-f98b-5961-b34e-21a68d12f23e
2026-03-28 18:43:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561d1590>
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff1%252Fb0f1c26000c56aeb171651be46bc2987%252Fpa%252FSG76993_54e9d6373368dd83667828c8dcb22936.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_54e9d6373368dd83667828c8dcb22936.jpg saved to cache
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64
2026-03-28 18:43:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64, skipping ID generation
2026-03-28 18:43:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64 with scrape type 1
2026-03-28 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64 sending to next pipeline
2026-03-28 18:43:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64, identifier: SG76993
2026-03-28 18:43:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561e1a90>
2026-03-28 18:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_6c7ae63fb3255fa22520b1d9e39940c5.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_6c7ae63fb3255fa22520b1d9e39940c5.jpg saved to cache
2026-03-28 18:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c
2026-03-28 18:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562d5810>
2026-03-28 18:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_a19dfe5de71ec5d8a3d04787825c5938.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_a19dfe5de71ec5d8a3d04787825c5938.jpg saved to cache
2026-03-28 18:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c
2026-03-28 18:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456286b50>
2026-03-28 18:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b8c5b06-f98b-5961-b34e-21a68d12f23e/4b8c5b06-f98b-5961-b34e-21a68d12f23e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Fc9%252Fb3c9cecfc3ce30b319e4e13808d04b26%252Fpa%252FTM38106_7eaef8e4f6da6394cdf221c193dcff22.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_7eaef8e4f6da6394cdf221c193dcff22.jpg saved to cache
2026-03-28 18:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b8c5b06-f98b-5961-b34e-21a68d12f23e
2026-03-28 18:43:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b8c5b06-f98b-5961-b34e-21a68d12f23e, skipping ID generation
2026-03-28 18:43:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b8c5b06-f98b-5961-b34e-21a68d12f23e with scrape type 1
2026-03-28 18:43:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b8c5b06-f98b-5961-b34e-21a68d12f23e sending to next pipeline
2026-03-28 18:43:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b8c5b06-f98b-5961-b34e-21a68d12f23e, identifier: TM38106
2026-03-28 18:43:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64 with identifier: SG76993
2026-03-28 18:43:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64 with identifier: SG76993
2026-03-28 18:43:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64 with identifier: SG76993 to the API
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_54e9d6373368dd83667828c8dcb22936.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:01Z',
 'fuel_type': 'diesel',
 'id': '55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG76993',
 'listing': 'auction',
 'location': 'DE, Offenbach am Main',
 'make': 'BMW',
 'model': '2er',
 'odometer': 82086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287100,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_54e9d6373368dd83667828c8dcb22936.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50431,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_431863067c38972e690d00dc8ed79d59.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54697,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_f916707b1ec39f72833ee1a38cbf5665.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276431,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_90f155b5afbde0feff1da1e7405eed11.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52346,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_50ef1f3dd151753a542654a7f1ef3db8.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55754,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_3be17b8c5286b553a6a83c2b6a35a133.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266562,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_6c15dde2148b5c8c7530ef3eb808b67b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307846,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_9d05bc1b0f1352f9be17ee1275ea6c38.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53833,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_5a919ac4df2d545ddd8e54eb888e558e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64/55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337994,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f1/b0f1c26000c56aeb171651be46bc2987/pa/SG76993_ef3f1554b3dee214994e61dd830ad043.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 2er 218d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG76993%27 HTTP/1.1" 200 None
2026-03-28 18:43:41 [auto1.de] INFO: Saving data for SG76993: {'created_time': 1774723421.921905, 'last_price_update_time': 1774723421.921918, 'auction_closing_time': 1774885561.0}
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG76993') HTTP/1.1" 204 0
2026-03-28 18:43:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b8c5b06-f98b-5961-b34e-21a68d12f23e with identifier: TM38106
2026-03-28 18:43:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b8c5b06-f98b-5961-b34e-21a68d12f23e with identifier: TM38106
2026-03-28 18:43:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b8c5b06-f98b-5961-b34e-21a68d12f23e with identifier: TM38106 to the API
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_7eaef8e4f6da6394cdf221c193dcff22.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:20:40Z',
 'fuel_type': 'petrol',
 'id': '4b8c5b06-f98b-5961-b34e-21a68d12f23e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM38106',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 158430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8c5b06-f98b-5961-b34e-21a68d12f23e/4b8c5b06-f98b-5961-b34e-21a68d12f23e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_1a75e11e2289440eb487871426cec00d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8c5b06-f98b-5961-b34e-21a68d12f23e/4b8c5b06-f98b-5961-b34e-21a68d12f23e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_7eaef8e4f6da6394cdf221c193dcff22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8c5b06-f98b-5961-b34e-21a68d12f23e/4b8c5b06-f98b-5961-b34e-21a68d12f23e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_27b29c57ce0da3975cac336c2040ef66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8c5b06-f98b-5961-b34e-21a68d12f23e/4b8c5b06-f98b-5961-b34e-21a68d12f23e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_771b0c22997b8e7c7508a979616be3f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b8c5b06-f98b-5961-b34e-21a68d12f23e/4b8c5b06-f98b-5961-b34e-21a68d12f23e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/c9/b3c9cecfc3ce30b319e4e13808d04b26/pa/TM38106_e064c6d24bf7625598c85e4d578dd8d3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 FSI Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM38106%27 HTTP/1.1" 200 None
2026-03-28 18:43:42 [auto1.de] INFO: Saving data for TM38106: {'created_time': 1774723422.364126, 'last_price_update_time': 1774723422.364139, 'auction_closing_time': 1774884040.0}
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM38106') HTTP/1.1" 204 0
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456287dd0>
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_495dac7a2d1209d756adf1fdea1bb9c3.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_495dac7a2d1209d756adf1fdea1bb9c3.jpg saved to cache
2026-03-28 18:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c
2026-03-28 18:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_80339bfd22e08fe1c796c1c320c19b83.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_b269c06d898131dd7992748def11218d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_865f139ca0d90d0dcab91be12207fa06.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_5dbe16bdf6e3914c2e9d719a196c61b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563f5710>
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_80339bfd22e08fe1c796c1c320c19b83.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_80339bfd22e08fe1c796c1c320c19b83.jpg saved to cache
2026-03-28 18:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c
2026-03-28 18:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_243554bec039822069754a2efd6110f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_33c29ddc21ca337b1da07a77d52c764a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454785c90>
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F6c%252Fb56c5d7f5d991f748ba743ce0e818847%252Fpa%252FGN95458_b269c06d898131dd7992748def11218d.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_b269c06d898131dd7992748def11218d.jpg saved to cache
2026-03-28 18:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c
2026-03-28 18:43:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 473c30f5-9434-5bb9-9f28-3e1ced61ff3c, skipping ID generation
2026-03-28 18:43:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c with scrape type 1
2026-03-28 18:43:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c sending to next pipeline
2026-03-28 18:43:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 473c30f5-9434-5bb9-9f28-3e1ced61ff3c, identifier: GN95458
2026-03-28 18:43:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bcb10>
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_865f139ca0d90d0dcab91be12207fa06.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_865f139ca0d90d0dcab91be12207fa06.jpg saved to cache
2026-03-28 18:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cbdd504e-c145-5580-b504-e04fdf61b269
2026-03-28 18:43:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561a5fd0>
2026-03-28 18:43:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F37%252F7a372b18d75651d96c7fdf898880a831%252Fpa%252FMD22344_5dbe16bdf6e3914c2e9d719a196c61b0.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_5dbe16bdf6e3914c2e9d719a196c61b0.jpg saved to cache
2026-03-28 18:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cbdd504e-c145-5580-b504-e04fdf61b269
2026-03-28 18:43:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cbdd504e-c145-5580-b504-e04fdf61b269, skipping ID generation
2026-03-28 18:43:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbdd504e-c145-5580-b504-e04fdf61b269 with scrape type 1
2026-03-28 18:43:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cbdd504e-c145-5580-b504-e04fdf61b269 sending to next pipeline
2026-03-28 18:43:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbdd504e-c145-5580-b504-e04fdf61b269, identifier: MD22344
2026-03-28 18:43:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 473c30f5-9434-5bb9-9f28-3e1ced61ff3c with identifier: GN95458
2026-03-28 18:43:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 473c30f5-9434-5bb9-9f28-3e1ced61ff3c with identifier: GN95458
2026-03-28 18:43:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 473c30f5-9434-5bb9-9f28-3e1ced61ff3c with identifier: GN95458 to the API
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_b269c06d898131dd7992748def11218d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:22:22Z',
 'fuel_type': 'diesel',
 'id': '473c30f5-9434-5bb9-9f28-3e1ced61ff3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN95458',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 257967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3016154,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_d50145a04aa79a83949a430d22e20c15.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_495dac7a2d1209d756adf1fdea1bb9c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3023075,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_80339bfd22e08fe1c796c1c320c19b83.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3017357,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_b269c06d898131dd7992748def11218d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2993557,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_82c52eb5330d3b7a0bdac2a34b6d201a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_a19dfe5de71ec5d8a3d04787825c5938.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3070368,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_4b967715b462f571fd2edd4008d643c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3062006,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_6c7ae63fb3255fa22520b1d9e39940c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3006546,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_7f3e5f336cf550e40d500347bd20363c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c30f5-9434-5bb9-9f28-3e1ced61ff3c/473c30f5-9434-5bb9-9f28-3e1ced61ff3c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/6c/b56c5d7f5d991f748ba743ce0e818847/pa/GN95458_9987be63bd80ef3350a2f5a6554ef449.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2012}
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN95458%27 HTTP/1.1" 200 None
2026-03-28 18:43:43 [auto1.de] INFO: Saving data for GN95458: {'created_time': 1774723423.704745, 'last_price_update_time': 1774723423.704757, 'auction_closing_time': 1774884142.0}
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN95458') HTTP/1.1" 204 0
2026-03-28 18:43:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbdd504e-c145-5580-b504-e04fdf61b269 with identifier: MD22344
2026-03-28 18:43:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbdd504e-c145-5580-b504-e04fdf61b269 with identifier: MD22344
2026-03-28 18:43:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbdd504e-c145-5580-b504-e04fdf61b269 with identifier: MD22344 to the API
2026-03-28 18:43:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_5dbe16bdf6e3914c2e9d719a196c61b0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': 'Rental',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:26:34Z',
 'fuel_type': 'petrol',
 'id': 'cbdd504e-c145-5580-b504-e04fdf61b269',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD22344',
 'listing': 'auction',
 'location': 'DE, Böblingen',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 136401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_83f91f7c3474e62ed2c1fed517e976f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_7bc11e02c8d1b2e5b146a3b63a752f8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_f3fee6e212ae5f4715761f3f72b8c663.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_b1a61538d481e63639f7f4be2734adc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643036,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_910cf372f79721ee80ff3ee2fadcff4e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_5cdd1061b79efacca12bbf959f0e693c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_46511f96c057783feb3b91e60551e0f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2627137,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_865f139ca0d90d0dcab91be12207fa06.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2717221,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_9073cfa74297711d736e8283fb42bc05.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbdd504e-c145-5580-b504-e04fdf61b269/cbdd504e-c145-5580-b504-e04fdf61b269_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2963887,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/37/7a372b18d75651d96c7fdf898880a831/pa/MD22344_5dbe16bdf6e3914c2e9d719a196c61b0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD22344%27 HTTP/1.1" 200 None
2026-03-28 18:43:44 [auto1.de] INFO: Saving data for MD22344: {'created_time': 1774723424.112328, 'last_price_update_time': 1774723424.112375, 'auction_closing_time': 1774884394.0}
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD22344') HTTP/1.1" 204 0
2026-03-28 18:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_55c46281c6776f60d327fdbff205cd17.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_3c417690c116199de35b32c08174e7b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245624bc50>
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_243554bec039822069754a2efd6110f8.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_243554bec039822069754a2efd6110f8.jpg saved to cache
2026-03-28 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456410310>
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F28%252F8928377ac4ef8bdd2f753289b912cc2d%252Fpa%252FAM12815_33c29ddc21ca337b1da07a77d52c764a.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_33c29ddc21ca337b1da07a77d52c764a.jpg saved to cache
2026-03-28 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 483ad7c1-be4f-5853-a8d5-c724eb134227
2026-03-28 18:43:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 483ad7c1-be4f-5853-a8d5-c724eb134227, skipping ID generation
2026-03-28 18:43:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 483ad7c1-be4f-5853-a8d5-c724eb134227 with scrape type 1
2026-03-28 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 483ad7c1-be4f-5853-a8d5-c724eb134227 sending to next pipeline
2026-03-28 18:43:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 483ad7c1-be4f-5853-a8d5-c724eb134227, identifier: AM12815
2026-03-28 18:43:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 483ad7c1-be4f-5853-a8d5-c724eb134227 with identifier: AM12815
2026-03-28 18:43:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 483ad7c1-be4f-5853-a8d5-c724eb134227 with identifier: AM12815
2026-03-28 18:43:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 483ad7c1-be4f-5853-a8d5-c724eb134227 with identifier: AM12815 to the API
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_33c29ddc21ca337b1da07a77d52c764a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:40:50Z',
 'fuel_type': 'petrol',
 'id': '483ad7c1-be4f-5853-a8d5-c724eb134227',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM12815',
 'listing': 'auction',
 'location': 'DE, Schwäbisch Hall',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 158200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_aa4e726132d645e09aa258b9c33761f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_33c29ddc21ca337b1da07a77d52c764a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_325385df2f54837898b035561e723b60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2629732,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_7e33b4e364b982019f31542a1b3dbfb8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2761600,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_ad76d70ef16e9b003f1b993307c9d8f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2912429,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_070f5a5e220318dbafaa5536d4fd6c44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2483195,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_a993287e4e7245d4d83308c3d835bb70.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_b73e9544e5cac5cf4ba3c4923c2e7e2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2894778,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_cbbd33911d33e1a358365648e3124815.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_483ad7c1-be4f-5853-a8d5-c724eb134227/483ad7c1-be4f-5853-a8d5-c724eb134227_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2924310,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/28/8928377ac4ef8bdd2f753289b912cc2d/pa/AM12815_2691b8948c27db12cb383abccc32c005.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM12815%27 HTTP/1.1" 200 None
2026-03-28 18:43:44 [auto1.de] INFO: Saving data for AM12815: {'created_time': 1774723424.715222, 'last_price_update_time': 1774723424.715234, 'auction_closing_time': 1774885250.0}
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM12815') HTTP/1.1" 204 0
2026-03-28 18:43:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_4f8b96fa3457b79271e9157798ec3e72.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_9e1be3bc02d1bf01226dc9cfba65384a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563110d0>
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_55c46281c6776f60d327fdbff205cd17.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_55c46281c6776f60d327fdbff205cd17.jpg saved to cache
2026-03-28 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456248750>
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_3c417690c116199de35b32c08174e7b3.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_3c417690c116199de35b32c08174e7b3.jpg saved to cache
2026-03-28 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5
2026-03-28 18:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_455e83097da9fd12be873057d11b869c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a2210>
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_4f8b96fa3457b79271e9157798ec3e72.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_4f8b96fa3457b79271e9157798ec3e72.jpg saved to cache
2026-03-28 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7faebd26-33b6-5cd5-847d-8446a68f2db1
2026-03-28 18:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_9f2b69ee9dbb5950acb0753c16e0e7a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_4555260d82b2bd703337634d8d4b5ff7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_0b74e38408a3e9d247220c184c8a7c38.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638d350>
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_9e1be3bc02d1bf01226dc9cfba65384a.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_9e1be3bc02d1bf01226dc9cfba65384a.jpg saved to cache
2026-03-28 18:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5
2026-03-28 18:43:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456311c10>
2026-03-28 18:43:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F0a%252F220abaedbd7a12939741699332f22519%252Fpa%252FWE31393_455e83097da9fd12be873057d11b869c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_455e83097da9fd12be873057d11b869c.jpg saved to cache
2026-03-28 18:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3f47c76-908f-53af-91a9-e878fa2bb1d2
2026-03-28 18:43:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3f47c76-908f-53af-91a9-e878fa2bb1d2, skipping ID generation
2026-03-28 18:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3f47c76-908f-53af-91a9-e878fa2bb1d2 with scrape type 1
2026-03-28 18:43:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3f47c76-908f-53af-91a9-e878fa2bb1d2 sending to next pipeline
2026-03-28 18:43:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3f47c76-908f-53af-91a9-e878fa2bb1d2, identifier: WE31393
2026-03-28 18:43:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3f47c76-908f-53af-91a9-e878fa2bb1d2 with identifier: WE31393
2026-03-28 18:43:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3f47c76-908f-53af-91a9-e878fa2bb1d2 with identifier: WE31393
2026-03-28 18:43:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3f47c76-908f-53af-91a9-e878fa2bb1d2 with identifier: WE31393 to the API
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_455e83097da9fd12be873057d11b869c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:06:26Z',
 'fuel_type': 'diesel',
 'id': 'f3f47c76-908f-53af-91a9-e878fa2bb1d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE31393',
 'listing': 'auction',
 'location': 'DE, Kumhausen',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 323201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3031984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_455e83097da9fd12be873057d11b869c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_59a40c80565f6e1f8b9494a9dbfeda35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2919908,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_f115c389a722a83533f7549cd60661dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_0a00d98737c73c2e81b1a67e394d97a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_4e92395c27f57abbb2782e28b68997c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2929063,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_00fd69a02743f131c1645c98f576c813.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_4692a15f8aca9a3d2132d5798e44e7fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_d6490840a2b306e47cf0afe53d01b557.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2953154,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_f8a4a3671448df3805d78541d02e8ecd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f47c76-908f-53af-91a9-e878fa2bb1d2/f3f47c76-908f-53af-91a9-e878fa2bb1d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3269565,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/0a/220abaedbd7a12939741699332f22519/pa/WE31393_565b16be2058b16177eab5a6da3968cc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE31393%27 HTTP/1.1" 200 None
2026-03-28 18:43:45 [auto1.de] INFO: Saving data for WE31393: {'created_time': 1774723425.658101, 'last_price_update_time': 1774723425.658111, 'auction_closing_time': 1774883186.0}
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE31393') HTTP/1.1" 204 0
2026-03-28 18:43:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_29fcc50c9ebbdc10b6c38a82bd02bd2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_1a00ffaf310baa82e5a3fa857dd8f3b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_03a4cef2cc01a87b0ddc64c490b28310.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562d6ed0>
2026-03-28 18:43:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_9f2b69ee9dbb5950acb0753c16e0e7a2.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_9f2b69ee9dbb5950acb0753c16e0e7a2.jpg saved to cache
2026-03-28 18:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7faebd26-33b6-5cd5-847d-8446a68f2db1
2026-03-28 18:43:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477c410>
2026-03-28 18:43:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Feb%252Ff1eb40319e21cd68563a37f1b656e555%252Fpa%252FHA62575_4555260d82b2bd703337634d8d4b5ff7.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_4555260d82b2bd703337634d8d4b5ff7.jpg saved to cache
2026-03-28 18:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7faebd26-33b6-5cd5-847d-8446a68f2db1
2026-03-28 18:43:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7faebd26-33b6-5cd5-847d-8446a68f2db1, skipping ID generation
2026-03-28 18:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7faebd26-33b6-5cd5-847d-8446a68f2db1 with scrape type 1
2026-03-28 18:43:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7faebd26-33b6-5cd5-847d-8446a68f2db1 sending to next pipeline
2026-03-28 18:43:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7faebd26-33b6-5cd5-847d-8446a68f2db1, identifier: HA62575
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563342d0>
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_0b74e38408a3e9d247220c184c8a7c38.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_0b74e38408a3e9d247220c184c8a7c38.jpg saved to cache
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5
2026-03-28 18:43:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7faebd26-33b6-5cd5-847d-8446a68f2db1 with identifier: HA62575
2026-03-28 18:43:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7faebd26-33b6-5cd5-847d-8446a68f2db1 with identifier: HA62575
2026-03-28 18:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7faebd26-33b6-5cd5-847d-8446a68f2db1 with identifier: HA62575 to the API
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_4555260d82b2bd703337634d8d4b5ff7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:53:31Z',
 'fuel_type': 'petrol',
 'id': '7faebd26-33b6-5cd5-847d-8446a68f2db1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA62575',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 131472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2725726,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_9f2b69ee9dbb5950acb0753c16e0e7a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2674229,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_4555260d82b2bd703337634d8d4b5ff7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2551239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_4f8b96fa3457b79271e9157798ec3e72.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491319,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_ab7c6d35dab58e54587b347debc75916.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_e003ce752ea7ed09fcb3f99405653118.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2083776,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_8c0de635218eaae6cb14a6c150419906.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2043602,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_094f911402bb58a6eb5a557cf26ca134.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1958536,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_7d8a6e327a352de712d284ea4ae0ac7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_ad2cfdb3afe683a97be2911af2f36a1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faebd26-33b6-5cd5-847d-8446a68f2db1/7faebd26-33b6-5cd5-847d-8446a68f2db1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/eb/f1eb40319e21cd68563a37f1b656e555/pa/HA62575_53fbb6c997fadc7759c96a8eceb0947b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 e-VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA62575%27 HTTP/1.1" 200 None
2026-03-28 18:43:46 [auto1.de] INFO: Saving data for HA62575: {'created_time': 1774723426.502455, 'last_price_update_time': 1774723426.502467, 'auction_closing_time': 1774886011.0}
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA62575') HTTP/1.1" 204 0
2026-03-28 18:43:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_0870698b2919906366e10202510b6126.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD40390> (referer: https://www.auto1.com/v1/car-details-view/YD40390/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477ce90>
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_29fcc50c9ebbdc10b6c38a82bd02bd2d.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_29fcc50c9ebbdc10b6c38a82bd02bd2d.jpg saved to cache
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456249290>
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d32b32be-5e8b-5028-9490-b30aa4690b08/d32b32be-5e8b-5028-9490-b30aa4690b08_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F38%252Fa638d0c81e258ad74814c9ee9af8c144%252Fpa%252FRE77380_1a00ffaf310baa82e5a3fa857dd8f3b9.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_1a00ffaf310baa82e5a3fa857dd8f3b9.jpg saved to cache
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d32b32be-5e8b-5028-9490-b30aa4690b08
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563b6b10>
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d32b32be-5e8b-5028-9490-b30aa4690b08/d32b32be-5e8b-5028-9490-b30aa4690b08_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F38%252Fa638d0c81e258ad74814c9ee9af8c144%252Fpa%252FRE77380_03a4cef2cc01a87b0ddc64c490b28310.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_03a4cef2cc01a87b0ddc64c490b28310.jpg saved to cache
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d32b32be-5e8b-5028-9490-b30aa4690b08
2026-03-28 18:43:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_d79d5a813d6a0f737e33ee72b3e6943f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_731ac730d99a57556f3c941294ba4e3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456174c90>
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d32b32be-5e8b-5028-9490-b30aa4690b08/d32b32be-5e8b-5028-9490-b30aa4690b08_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F38%252Fa638d0c81e258ad74814c9ee9af8c144%252Fpa%252FRE77380_0870698b2919906366e10202510b6126.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_0870698b2919906366e10202510b6126.jpg saved to cache
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d32b32be-5e8b-5028-9490-b30aa4690b08
2026-03-28 18:43:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b with identifier: YD40390
2026-03-28 18:43:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b with scrape type 1
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff7%252F1ff7a64a69fa21229d0a66a9e09ed4c3%252Fpa%252FYD40390_40e23d9588819f5467282ef0c1e8e715.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_40e23d9588819f5467282ef0c1e8e715.jpg not downloaded yet
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff7%252F1ff7a64a69fa21229d0a66a9e09ed4c3%252Fpa%252FYD40390_b2acfa50655806caf5948a7276ee64f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_b2acfa50655806caf5948a7276ee64f6.jpg not downloaded yet
2026-03-28 18:43:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_90c329c981516a81ffeb1cbeb6fe419b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_2d5ce07b9fda46736ba26f0f992e1fd2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff7%252F1ff7a64a69fa21229d0a66a9e09ed4c3%252Fpa%252FYD40390_db2735ef9cf81e83b3ddc85d16743620.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_db2735ef9cf81e83b3ddc85d16743620.jpg not downloaded yet
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff7%252F1ff7a64a69fa21229d0a66a9e09ed4c3%252Fpa%252FYD40390_3cf23cbd6cb66a86573f611c8521c8ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_3cf23cbd6cb66a86573f611c8521c8ef.jpg not downloaded yet
2026-03-28 18:43:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245608cb10>
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_d79d5a813d6a0f737e33ee72b3e6943f.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_d79d5a813d6a0f737e33ee72b3e6943f.jpg saved to cache
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff7%252F1ff7a64a69fa21229d0a66a9e09ed4c3%252Fpa%252FYD40390_f72d30f1ffa2867a494c6a58fb303146.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_f72d30f1ffa2867a494c6a58fb303146.jpg not downloaded yet
2026-03-28 18:43:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245636fa50>
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F56%252Fdb5600fb25e0766b78ea19c8c8650286%252Fpa%252FGS03100_731ac730d99a57556f3c941294ba4e3a.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_731ac730d99a57556f3c941294ba4e3a.jpg saved to cache
2026-03-28 18:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8
2026-03-28 18:43:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8, skipping ID generation
2026-03-28 18:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8 with scrape type 1
2026-03-28 18:43:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8 sending to next pipeline
2026-03-28 18:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8, identifier: GS03100
2026-03-28 18:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8 with identifier: GS03100
2026-03-28 18:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8 with identifier: GS03100
2026-03-28 18:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8 with identifier: GS03100 to the API
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_731ac730d99a57556f3c941294ba4e3a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:00:13Z',
 'fuel_type': 'petrol',
 'id': '6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS03100',
 'listing': 'auction',
 'location': 'DE, Lübeck',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 90805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_55c46281c6776f60d327fdbff205cd17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3404189,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_731ac730d99a57556f3c941294ba4e3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3260476,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_ec2a8ab242ef40625c61ca85dfa296cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_9e9f2e785b00e134683a8769a541546e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3265004,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_d79d5a813d6a0f737e33ee72b3e6943f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_243554bec039822069754a2efd6110f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_1e80b9cd0954bf8e0dc2f7de065489b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2646547,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_61758b13814b6476cd9917415c064f2c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_5eabf756c705c8c1c5e350dd808b8142.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8/6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/56/db5600fb25e0766b78ea19c8c8650286/pa/GS03100_41d79db7f4f661a9bcb53f41f3ee23fb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS03100%27 HTTP/1.1" 200 None
2026-03-28 18:43:47 [auto1.de] INFO: Saving data for GS03100: {'created_time': 1774723427.684049, 'last_price_update_time': 1774723427.684063, 'auction_closing_time': 1774882813.0}
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS03100') HTTP/1.1" 204 0
2026-03-28 18:43:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245605bed0>
2026-03-28 18:43:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d32b32be-5e8b-5028-9490-b30aa4690b08/d32b32be-5e8b-5028-9490-b30aa4690b08_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F38%252Fa638d0c81e258ad74814c9ee9af8c144%252Fpa%252FRE77380_90c329c981516a81ffeb1cbeb6fe419b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_90c329c981516a81ffeb1cbeb6fe419b.jpg saved to cache
2026-03-28 18:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d32b32be-5e8b-5028-9490-b30aa4690b08
2026-03-28 18:43:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245607af50>
2026-03-28 18:43:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d32b32be-5e8b-5028-9490-b30aa4690b08/d32b32be-5e8b-5028-9490-b30aa4690b08_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F38%252Fa638d0c81e258ad74814c9ee9af8c144%252Fpa%252FRE77380_2d5ce07b9fda46736ba26f0f992e1fd2.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_2d5ce07b9fda46736ba26f0f992e1fd2.jpg saved to cache
2026-03-28 18:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d32b32be-5e8b-5028-9490-b30aa4690b08
2026-03-28 18:43:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d32b32be-5e8b-5028-9490-b30aa4690b08, skipping ID generation
2026-03-28 18:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d32b32be-5e8b-5028-9490-b30aa4690b08 with scrape type 1
2026-03-28 18:43:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d32b32be-5e8b-5028-9490-b30aa4690b08 sending to next pipeline
2026-03-28 18:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d32b32be-5e8b-5028-9490-b30aa4690b08, identifier: RE77380
2026-03-28 18:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD40949> (referer: https://www.auto1.com/v1/car-details-view/XD40949/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ41571/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH28612/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB44378> (referer: https://www.auto1.com/v1/car-details-view/UB44378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d32b32be-5e8b-5028-9490-b30aa4690b08 with identifier: RE77380
2026-03-28 18:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d32b32be-5e8b-5028-9490-b30aa4690b08 with identifier: RE77380
2026-03-28 18:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d32b32be-5e8b-5028-9490-b30aa4690b08 with identifier: RE77380 to the API
2026-03-28 18:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_2d5ce07b9fda46736ba26f0f992e1fd2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.8L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:06:41Z',
 'fuel_type': 'petrol',
 'id': 'd32b32be-5e8b-5028-9490-b30aa4690b08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE77380',
 'listing': 'auction',
 'location': 'DE, Gelsenkirchen',
 'make': 'Toyota',
 'model': 'Corolla Verso',
 'odometer': 220200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d32b32be-5e8b-5028-9490-b30aa4690b08/d32b32be-5e8b-5028-9490-b30aa4690b08_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_2d5ce07b9fda46736ba26f0f992e1fd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d32b32be-5e8b-5028-9490-b30aa4690b08/d32b32be-5e8b-5028-9490-b30aa4690b08_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_90c329c981516a81ffeb1cbeb6fe419b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d32b32be-5e8b-5028-9490-b30aa4690b08/d32b32be-5e8b-5028-9490-b30aa4690b08_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_0870698b2919906366e10202510b6126.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d32b32be-5e8b-5028-9490-b30aa4690b08/d32b32be-5e8b-5028-9490-b30aa4690b08_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_1a00ffaf310baa82e5a3fa857dd8f3b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d32b32be-5e8b-5028-9490-b30aa4690b08/d32b32be-5e8b-5028-9490-b30aa4690b08_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/38/a638d0c81e258ad74814c9ee9af8c144/pa/RE77380_03a4cef2cc01a87b0ddc64c490b28310.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Corolla Verso 1.8 Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2003}
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE77380%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [auto1.de] INFO: Saving data for RE77380: {'created_time': 1774723428.319872, 'last_price_update_time': 1774723428.319882, 'auction_closing_time': 1774883201.0}
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE77380') HTTP/1.1" 204 0
2026-03-28 18:43:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN98696> (referer: https://www.auto1.com/v1/car-details-view/WN98696/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT90380> (referer: https://www.auto1.com/v1/car-details-view/FT90380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_db2735ef9cf81e83b3ddc85d16743620.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_3cf23cbd6cb66a86573f611c8521c8ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MK22023> (referer: https://www.auto1.com/v1/car-details-view/MK22023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_f72d30f1ffa2867a494c6a58fb303146.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2b35c26-8b63-5a37-9c29-939b9ef43fba with identifier: XD40949
2026-03-28 18:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2b35c26-8b63-5a37-9c29-939b9ef43fba with scrape type 1
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2b35c26-8b63-5a37-9c29-939b9ef43fba
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_41895e868502209390df1b3cf5132e12.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_41895e868502209390df1b3cf5132e12.jpg not downloaded yet
2026-03-28 18:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 631fc12c-c425-58b2-920f-935a9c081e00 with identifier: UB44378
2026-03-28 18:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 631fc12c-c425-58b2-920f-935a9c081e00 with scrape type 1
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 631fc12c-c425-58b2-920f-935a9c081e00
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_70014c2ee852ccad4836a84228635cb9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_70014c2ee852ccad4836a84228635cb9.jpg not downloaded yet
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_b5e5c5701abf7e6b3155d6bf8832103a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_b5e5c5701abf7e6b3155d6bf8832103a.jpg not downloaded yet
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_cc45f9d2b9711016c00077fd4783e21c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_cc45f9d2b9711016c00077fd4783e21c.jpg not downloaded yet
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_afe7e938126daff28b4fbd1bed720225.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_afe7e938126daff28b4fbd1bed720225.jpg not downloaded yet
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_009f0de44d43e62898cf222d187867c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_009f0de44d43e62898cf222d187867c7.jpg not downloaded yet
2026-03-28 18:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_40e23d9588819f5467282ef0c1e8e715.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_1dccb90a6940522f98fc6e95368bcdc4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_d01757ca9070a1e8648734adaab9e5e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_d01757ca9070a1e8648734adaab9e5e4.jpg not downloaded yet
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_8c302689e96f9284d803d25d4576a279.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_8c302689e96f9284d803d25d4576a279.jpg not downloaded yet
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_4f9479930fbcce1270100d92f77b5262.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_4f9479930fbcce1270100d92f77b5262.jpg not downloaded yet
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_ebd12688fc00c71be035232b01e6fb48.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_ebd12688fc00c71be035232b01e6fb48.jpg not downloaded yet
2026-03-28 18:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db18e522-6670-54d3-a7d1-0ace20592ac6 with identifier: WN98696
2026-03-28 18:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db18e522-6670-54d3-a7d1-0ace20592ac6 with scrape type 1
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db18e522-6670-54d3-a7d1-0ace20592ac6
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_addaade9196a47f933d95760b5ae8c11.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_addaade9196a47f933d95760b5ae8c11.jpg not downloaded yet
2026-03-28 18:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7d2f42-760d-5aa5-ac65-062955d47841 with identifier: FT90380
2026-03-28 18:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7d2f42-760d-5aa5-ac65-062955d47841 with scrape type 1
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e7d2f42-760d-5aa5-ac65-062955d47841
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_733467c7cd4de16ab1998d15aa6037bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_733467c7cd4de16ab1998d15aa6037bf.jpg not downloaded yet
2026-03-28 18:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456210350>
2026-03-28 18:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8d421e-03a1-53cc-8ef0-70adfdc2b25b/0b8d421e-03a1-53cc-8ef0-70adfdc2b25b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff7%252F1ff7a64a69fa21229d0a66a9e09ed4c3%252Fpa%252FYD40390_db2735ef9cf81e83b3ddc85d16743620.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_db2735ef9cf81e83b3ddc85d16743620.jpg saved to cache
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b
2026-03-28 18:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245632f250>
2026-03-28 18:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8d421e-03a1-53cc-8ef0-70adfdc2b25b/0b8d421e-03a1-53cc-8ef0-70adfdc2b25b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff7%252F1ff7a64a69fa21229d0a66a9e09ed4c3%252Fpa%252FYD40390_3cf23cbd6cb66a86573f611c8521c8ef.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_3cf23cbd6cb66a86573f611c8521c8ef.jpg saved to cache
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b
2026-03-28 18:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e86676-a5b6-5fcb-80ea-59c9a73978e8 with identifier: MK22023
2026-03-28 18:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e86676-a5b6-5fcb-80ea-59c9a73978e8 with scrape type 1
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 55e86676-a5b6-5fcb-80ea-59c9a73978e8
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fd1%252F7bd157cc7ae04c634ee056d90453f197%252Fpa%252FMK22023_4434f7c671838aaacb82df4623c5c97e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_4434f7c671838aaacb82df4623c5c97e.jpg already downloaded
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fd1%252F7bd157cc7ae04c634ee056d90453f197%252Fpa%252FMK22023_5ce647e6d0b68dc6a903514d79a5d29f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_5ce647e6d0b68dc6a903514d79a5d29f.jpg already downloaded
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fd1%252F7bd157cc7ae04c634ee056d90453f197%252Fpa%252FMK22023_d4f3ac1bb8795c5dacc3e7d366542a49.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_d4f3ac1bb8795c5dacc3e7d366542a49.jpg already downloaded
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fd1%252F7bd157cc7ae04c634ee056d90453f197%252Fpa%252FMK22023_c81848ce8e56e78692cb6c28969b6f31.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_c81848ce8e56e78692cb6c28969b6f31.jpg already downloaded
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fd1%252F7bd157cc7ae04c634ee056d90453f197%252Fpa%252FMK22023_8441bf1392d37a758bb12f7b5ff75bf6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_8441bf1392d37a758bb12f7b5ff75bf6.jpg already downloaded
2026-03-28 18:43:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55e86676-a5b6-5fcb-80ea-59c9a73978e8, identifier: MK22023
2026-03-28 18:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456295010>
2026-03-28 18:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8d421e-03a1-53cc-8ef0-70adfdc2b25b/0b8d421e-03a1-53cc-8ef0-70adfdc2b25b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff7%252F1ff7a64a69fa21229d0a66a9e09ed4c3%252Fpa%252FYD40390_f72d30f1ffa2867a494c6a58fb303146.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_f72d30f1ffa2867a494c6a58fb303146.jpg saved to cache
2026-03-28 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b
2026-03-28 18:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_0299e751161ae73119c6a26cd7ac55e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55e86676-a5b6-5fcb-80ea-59c9a73978e8 with identifier: MK22023
2026-03-28 18:43:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55e86676-a5b6-5fcb-80ea-59c9a73978e8 with identifier: MK22023
2026-03-28 18:43:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55e86676-a5b6-5fcb-80ea-59c9a73978e8 with identifier: MK22023 to the API
2026-03-28 18:43:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MK22023>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:46:46Z',
 'fuel_type': 'diesel',
 'id': '55e86676-a5b6-5fcb-80ea-59c9a73978e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK22023',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'BMW',
 'model': '1er',
 'odometer': 317803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_4434f7c671838aaacb82df4623c5c97e.jpg',
                'https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_5ce647e6d0b68dc6a903514d79a5d29f.jpg',
                'https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_d4f3ac1bb8795c5dacc3e7d366542a49.jpg',
                'https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_c81848ce8e56e78692cb6c28969b6f31.jpg',
                'https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_8441bf1392d37a758bb12f7b5ff75bf6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e86676-a5b6-5fcb-80ea-59c9a73978e8/55e86676-a5b6-5fcb-80ea-59c9a73978e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_4434f7c671838aaacb82df4623c5c97e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e86676-a5b6-5fcb-80ea-59c9a73978e8/55e86676-a5b6-5fcb-80ea-59c9a73978e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_5ce647e6d0b68dc6a903514d79a5d29f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e86676-a5b6-5fcb-80ea-59c9a73978e8/55e86676-a5b6-5fcb-80ea-59c9a73978e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_d4f3ac1bb8795c5dacc3e7d366542a49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e86676-a5b6-5fcb-80ea-59c9a73978e8/55e86676-a5b6-5fcb-80ea-59c9a73978e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_c81848ce8e56e78692cb6c28969b6f31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e86676-a5b6-5fcb-80ea-59c9a73978e8/55e86676-a5b6-5fcb-80ea-59c9a73978e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/d1/7bd157cc7ae04c634ee056d90453f197/pa/MK22023_8441bf1392d37a758bb12f7b5ff75bf6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK22023%27 HTTP/1.1" 200 None
2026-03-28 18:43:49 [auto1.de] INFO: Saving data for MK22023: {'created_time': 1774723429.172058, 'last_price_update_time': 1774723429.172069, 'auction_closing_time': 1774885606.0}
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK22023') HTTP/1.1" 204 0
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_ea25f2ada4fbf2a773d0a607a4e2d7b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_ea25f2ada4fbf2a773d0a607a4e2d7b7.jpg not downloaded yet
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_3f69426057c5e18f6aeb723c399c2ca5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_3f69426057c5e18f6aeb723c399c2ca5.jpg not downloaded yet
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_8f4803c4b3b9ac1baad99644a39b8ef0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_8f4803c4b3b9ac1baad99644a39b8ef0.jpg not downloaded yet
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_2bff00faed735dfc037aaa56d1abf4c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_2bff00faed735dfc037aaa56d1abf4c5.jpg not downloaded yet
2026-03-28 18:43:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_b2acfa50655806caf5948a7276ee64f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_c7af742ab6891f9c1455c5ee6c7e419b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_9bb929c3d509d6d864adde242bc3322d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_9bb929c3d509d6d864adde242bc3322d.jpg not downloaded yet
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_c9f4423b38c67ec867cc39b65edfed25.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_c9f4423b38c67ec867cc39b65edfed25.jpg not downloaded yet
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_ff9ac875417b5230587e726b89f4669a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_ff9ac875417b5230587e726b89f4669a.jpg not downloaded yet
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_f139df98615601cd2a9e30135f1ebf61.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_f139df98615601cd2a9e30135f1ebf61.jpg not downloaded yet
2026-03-28 18:43:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245648bdd0>
2026-03-28 18:43:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8d421e-03a1-53cc-8ef0-70adfdc2b25b/0b8d421e-03a1-53cc-8ef0-70adfdc2b25b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff7%252F1ff7a64a69fa21229d0a66a9e09ed4c3%252Fpa%252FYD40390_40e23d9588819f5467282ef0c1e8e715.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_40e23d9588819f5467282ef0c1e8e715.jpg saved to cache
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b
2026-03-28 18:43:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456374950>
2026-03-28 18:43:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_1dccb90a6940522f98fc6e95368bcdc4.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_1dccb90a6940522f98fc6e95368bcdc4.jpg saved to cache
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5
2026-03-28 18:43:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475a010>
2026-03-28 18:43:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9a%252Ffa9a0d0fef5e78f98e057e44f1be1d00%252Fpa%252FDS29172_0299e751161ae73119c6a26cd7ac55e4.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_0299e751161ae73119c6a26cd7ac55e4.jpg saved to cache
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5
2026-03-28 18:43:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5, skipping ID generation
2026-03-28 18:43:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5 with scrape type 1
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5 sending to next pipeline
2026-03-28 18:43:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5, identifier: DS29172
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_aca268c1bcbb51397a156fb2097b4bc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_aca268c1bcbb51397a156fb2097b4bc6.jpg not downloaded yet
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_3ad691c20892905f5fc5e58ea415bbda.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_3ad691c20892905f5fc5e58ea415bbda.jpg not downloaded yet
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_6848c72ea2883ead46eea4a340f05b3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_6848c72ea2883ead46eea4a340f05b3e.jpg not downloaded yet
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_7ccb4859e25024f5a508103dd26139b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_7ccb4859e25024f5a508103dd26139b7.jpg not downloaded yet
2026-03-28 18:43:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5 with identifier: DS29172
2026-03-28 18:43:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5 with identifier: DS29172
2026-03-28 18:43:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5 with identifier: DS29172 to the API
2026-03-28 18:43:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_0299e751161ae73119c6a26cd7ac55e4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:08:11Z',
 'fuel_type': 'diesel',
 'id': '6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS29172',
 'listing': 'auction',
 'location': 'DE, Landsberg am Lech',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 79215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2679820,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_0299e751161ae73119c6a26cd7ac55e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_29fcc50c9ebbdc10b6c38a82bd02bd2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2645611,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_1dccb90a6940522f98fc6e95368bcdc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2438467,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_e7ba085b8e1d26b3a6fac0ed2c7cd3fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_0b74e38408a3e9d247220c184c8a7c38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_ca854ddea2d6c602100f43ae42589e4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_4e1809a6d1eae204f9f641a17c6a77e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_9e1be3bc02d1bf01226dc9cfba65384a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2596446,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_a36b7c698012e4d0d0f89e23ec22fa04.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5/6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9a/fa9a0d0fef5e78f98e057e44f1be1d00/pa/DS29172_3c417690c116199de35b32c08174e7b3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-29',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 300 L2 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '300 L2 Tourneo Titanium',
 'year': 2015}
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS29172%27 HTTP/1.1" 200 None
2026-03-28 18:43:50 [auto1.de] INFO: Saving data for DS29172: {'created_time': 1774723430.148292, 'last_price_update_time': 1774723430.148303, 'auction_closing_time': 1774883291.0}
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS29172') HTTP/1.1" 204 0
2026-03-28 18:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_cc45f9d2b9711016c00077fd4783e21c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_009f0de44d43e62898cf222d187867c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_cae235463b2fc8bd8c363eab77931db9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_cae235463b2fc8bd8c363eab77931db9.jpg not downloaded yet
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_b0ba0b7ae9f1c526d2f7b5ffcbdaf786.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_b0ba0b7ae9f1c526d2f7b5ffcbdaf786.jpg not downloaded yet
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_343cfac773b2a9af86ca90e239610bdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_343cfac773b2a9af86ca90e239610bdd.jpg not downloaded yet
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_46cdb89877cbd9ee202e3f62586a3aae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_46cdb89877cbd9ee202e3f62586a3aae.jpg not downloaded yet
2026-03-28 18:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT96582> (referer: https://www.auto1.com/v1/car-details-view/CT96582/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564d0950>
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8d421e-03a1-53cc-8ef0-70adfdc2b25b/0b8d421e-03a1-53cc-8ef0-70adfdc2b25b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Ff7%252F1ff7a64a69fa21229d0a66a9e09ed4c3%252Fpa%252FYD40390_b2acfa50655806caf5948a7276ee64f6.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_b2acfa50655806caf5948a7276ee64f6.jpg saved to cache
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b
2026-03-28 18:43:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b, skipping ID generation
2026-03-28 18:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b with scrape type 1
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b sending to next pipeline
2026-03-28 18:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b, identifier: YD40390
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456313dd0>
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_c7af742ab6891f9c1455c5ee6c7e419b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_c7af742ab6891f9c1455c5ee6c7e419b.jpg saved to cache
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 764982c2-d5a5-59a9-9565-62649ecb4113
2026-03-28 18:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT01554/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC21553> (referer: https://www.auto1.com/v1/car-details-view/FC21553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b with identifier: YD40390
2026-03-28 18:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b with identifier: YD40390
2026-03-28 18:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b with identifier: YD40390 to the API
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_b2acfa50655806caf5948a7276ee64f6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:12:27Z',
 'fuel_type': 'petrol',
 'id': '0b8d421e-03a1-53cc-8ef0-70adfdc2b25b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD40390',
 'listing': 'auction',
 'location': 'DE, Stuttgart',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 121059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8d421e-03a1-53cc-8ef0-70adfdc2b25b/0b8d421e-03a1-53cc-8ef0-70adfdc2b25b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_40e23d9588819f5467282ef0c1e8e715.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8d421e-03a1-53cc-8ef0-70adfdc2b25b/0b8d421e-03a1-53cc-8ef0-70adfdc2b25b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_b2acfa50655806caf5948a7276ee64f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8d421e-03a1-53cc-8ef0-70adfdc2b25b/0b8d421e-03a1-53cc-8ef0-70adfdc2b25b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_db2735ef9cf81e83b3ddc85d16743620.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8d421e-03a1-53cc-8ef0-70adfdc2b25b/0b8d421e-03a1-53cc-8ef0-70adfdc2b25b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_3cf23cbd6cb66a86573f611c8521c8ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8d421e-03a1-53cc-8ef0-70adfdc2b25b/0b8d421e-03a1-53cc-8ef0-70adfdc2b25b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/f7/1ff7a64a69fa21229d0a66a9e09ed4c3/pa/YD40390_f72d30f1ffa2867a494c6a58fb303146.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto 1.2 More',
 'transmission': 'manual',
 'trim': 'More',
 'year': 2012}
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD40390%27 HTTP/1.1" 200 None
2026-03-28 18:43:50 [auto1.de] INFO: Saving data for YD40390: {'created_time': 1774723430.791673, 'last_price_update_time': 1774723430.791685, 'auction_closing_time': 1774883547.0}
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD40390') HTTP/1.1" 204 0
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_e5d66d4619691745cf43f0ba65b643af.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_e5d66d4619691745cf43f0ba65b643af.jpg not downloaded yet
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_b16ac87ecd50e93179056dd52a902908.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_b16ac87ecd50e93179056dd52a902908.jpg not downloaded yet
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_69176cce0d14a75b043f93a2785c78fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_69176cce0d14a75b043f93a2785c78fd.jpg not downloaded yet
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_4c4d41eb491d37e6bb18c75239601193.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_4c4d41eb491d37e6bb18c75239601193.jpg not downloaded yet
2026-03-28 18:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_c2b0de2a5f1ed9a129bc49299624be23.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d0bd0>
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_cc45f9d2b9711016c00077fd4783e21c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_cc45f9d2b9711016c00077fd4783e21c.jpg saved to cache
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 631fc12c-c425-58b2-920f-935a9c081e00
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245605d350>
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_009f0de44d43e62898cf222d187867c7.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_009f0de44d43e62898cf222d187867c7.jpg saved to cache
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 631fc12c-c425-58b2-920f-935a9c081e00
2026-03-28 18:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89c4e953-abb0-5306-8d55-d68a1fa3b745 with identifier: CT96582
2026-03-28 18:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89c4e953-abb0-5306-8d55-d68a1fa3b745 with scrape type 1
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 89c4e953-abb0-5306-8d55-d68a1fa3b745
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fbc%252F00bc27e0a7d666583a5c37436a6b4290%252Fpa%252FCT96582_ce57ef52128649b0013871d429beb080.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_ce57ef52128649b0013871d429beb080.jpg not downloaded yet
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_4493470942653c0e1c0745a23d25dcc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_4493470942653c0e1c0745a23d25dcc8.jpg not downloaded yet
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_4ed1ed699404ed3a0bbca296f3c4e5e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_4ed1ed699404ed3a0bbca296f3c4e5e8.jpg not downloaded yet
2026-03-28 18:43:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_7ccb4859e25024f5a508103dd26139b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_6848c72ea2883ead46eea4a340f05b3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fbc%252F00bc27e0a7d666583a5c37436a6b4290%252Fpa%252FCT96582_ae558a92238d31b5633cd34722d6eb9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_ae558a92238d31b5633cd34722d6eb9e.jpg not downloaded yet
2026-03-28 18:43:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with identifier: FC21553
2026-03-28 18:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with scrape type 1
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_2427ef043b052608ca1e3f95b142e974.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_2427ef043b052608ca1e3f95b142e974.jpg not downloaded yet
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_049c72aedb747aacbc7d9f2f8c225408.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_049c72aedb747aacbc7d9f2f8c225408.jpg not downloaded yet
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_2ea902420042024b873dc45a4f04fd49.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_2ea902420042024b873dc45a4f04fd49.jpg not downloaded yet
2026-03-28 18:43:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456312490>
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fec%252F85ecc8ddf40c4e09c7c783cd3fc6ee79%252Fpa%252FFZ92426_c2b0de2a5f1ed9a129bc49299624be23.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_c2b0de2a5f1ed9a129bc49299624be23.jpg saved to cache
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4
2026-03-28 18:43:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c760fd3c-3cd8-5fbb-9fae-b8d2243602c4, skipping ID generation
2026-03-28 18:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4 with scrape type 1
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4 sending to next pipeline
2026-03-28 18:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c760fd3c-3cd8-5fbb-9fae-b8d2243602c4, identifier: FZ92426
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fbc%252F00bc27e0a7d666583a5c37436a6b4290%252Fpa%252FCT96582_a72fb950ab9197306bb872a27cc37d21.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_a72fb950ab9197306bb872a27cc37d21.jpg not downloaded yet
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_008a51341c85bfcde8cecd691ab30f57.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_008a51341c85bfcde8cecd691ab30f57.jpg not downloaded yet
2026-03-28 18:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c760fd3c-3cd8-5fbb-9fae-b8d2243602c4 with identifier: FZ92426
2026-03-28 18:43:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c760fd3c-3cd8-5fbb-9fae-b8d2243602c4 with identifier: FZ92426
2026-03-28 18:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c760fd3c-3cd8-5fbb-9fae-b8d2243602c4 with identifier: FZ92426 to the API
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_c2b0de2a5f1ed9a129bc49299624be23.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:56:36Z',
 'fuel_type': 'petrol',
 'id': 'c760fd3c-3cd8-5fbb-9fae-b8d2243602c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ92426',
 'listing': 'auction',
 'location': 'DE, Cham',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 125240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_fbb9f04d9a4ae3186e27814eaf238b7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_3bf33c0e27a1cd72fce240d315b33f08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_d2c09012c2596c3a630ef306a036b352.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2848182,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_c0ff1fac47cfbfd108ac496c7d68e09d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3436972,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_a116346d821abfd1489ceb05d1b9b148.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3110217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_c2b0de2a5f1ed9a129bc49299624be23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3025673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_463e6065a37b9bf570ecaefeef087824.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_1cadd9a25b66a96672e034066f3f6bf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3525495,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_a7a4743de24c9b34797a9077bb591c4f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c760fd3c-3cd8-5fbb-9fae-b8d2243602c4/c760fd3c-3cd8-5fbb-9fae-b8d2243602c4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/ec/85ecc8ddf40c4e09c7c783cd3fc6ee79/pa/FZ92426_391b96c9a1416ce6a3ba5b5631827dff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ92426%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [auto1.de] INFO: Saving data for FZ92426: {'created_time': 1774723431.727927, 'last_price_update_time': 1774723431.727938, 'auction_closing_time': 1774886196.0}
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ92426') HTTP/1.1" 204 0
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_cd694bbedcbdb45a1d85dabd7a031265.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_cd694bbedcbdb45a1d85dabd7a031265.jpg not downloaded yet
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_227eab83b3186fcbbd5d5e04c4c78a88.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_227eab83b3186fcbbd5d5e04c4c78a88.jpg not downloaded yet
2026-03-28 18:43:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_aca268c1bcbb51397a156fb2097b4bc6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_f139df98615601cd2a9e30135f1ebf61.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fbc%252F00bc27e0a7d666583a5c37436a6b4290%252Fpa%252FCT96582_4053dc5f0dd53fd87928647b82150e43.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_4053dc5f0dd53fd87928647b82150e43.jpg not downloaded yet
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_0073509da3fee662306420edcac10fba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_0073509da3fee662306420edcac10fba.jpg not downloaded yet
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245605a010>
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_7ccb4859e25024f5a508103dd26139b7.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_7ccb4859e25024f5a508103dd26139b7.jpg saved to cache
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e7d2f42-760d-5aa5-ac65-062955d47841
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454778bd0>
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_6848c72ea2883ead46eea4a340f05b3e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_6848c72ea2883ead46eea4a340f05b3e.jpg saved to cache
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db18e522-6670-54d3-a7d1-0ace20592ac6
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_ecc2ab63937cd29d7f913f6dedf11574.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_ecc2ab63937cd29d7f913f6dedf11574.jpg not downloaded yet
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_3e09e618085124328837b3bed51caf6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_3e09e618085124328837b3bed51caf6a.jpg not downloaded yet
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fbc%252F00bc27e0a7d666583a5c37436a6b4290%252Fpa%252FCT96582_8526f499645ec41629393dc031ecc417.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_8526f499645ec41629393dc031ecc417.jpg not downloaded yet
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_b2c705d2d4eb10f3fb8a0ffe0a395366.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_b2c705d2d4eb10f3fb8a0ffe0a395366.jpg not downloaded yet
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456499390>
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_aca268c1bcbb51397a156fb2097b4bc6.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_aca268c1bcbb51397a156fb2097b4bc6.jpg saved to cache
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2b35c26-8b63-5a37-9c29-939b9ef43fba
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a58d0>
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_f139df98615601cd2a9e30135f1ebf61.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_f139df98615601cd2a9e30135f1ebf61.jpg saved to cache
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e7d2f42-760d-5aa5-ac65-062955d47841
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_9a39d5cebb596272b7d35e54d10abe2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_9a39d5cebb596272b7d35e54d10abe2b.jpg not downloaded yet
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_246271eaef140e6976d6ef650272b220.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_246271eaef140e6976d6ef650272b220.jpg not downloaded yet
2026-03-28 18:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_46cdb89877cbd9ee202e3f62586a3aae.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_ff9ac875417b5230587e726b89f4669a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_79c5c8c25e0e3e90e02bd497e4e6fc15.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_79c5c8c25e0e3e90e02bd497e4e6fc15.jpg not downloaded yet
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_7eb2847627a86ba0747cc62738c2e22b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_7eb2847627a86ba0747cc62738c2e22b.jpg not downloaded yet
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_f6213f3e0a62324c0a8d5c7e9476a70d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_f6213f3e0a62324c0a8d5c7e9476a70d.jpg not downloaded yet
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_ced8024e14a9c09531be679e50d27c1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_ced8024e14a9c09531be679e50d27c1b.jpg not downloaded yet
2026-03-28 18:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_884acff4f3036f7ce05ece59c5ff121d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_c27f3a5a2cbf4a8a54c95a9edb9b3ba9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_ac39f65753315c89e56c8ed207dd6fb5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_1bff9f976267017de8cf17fd81c9d79c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_0f2c4b75a292dcc95936fffce5a601ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_3ad691c20892905f5fc5e58ea415bbda.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475f510>
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_46cdb89877cbd9ee202e3f62586a3aae.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_46cdb89877cbd9ee202e3f62586a3aae.jpg saved to cache
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e7d2f42-760d-5aa5-ac65-062955d47841
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245632e310>
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_ff9ac875417b5230587e726b89f4669a.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_ff9ac875417b5230587e726b89f4669a.jpg saved to cache
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db18e522-6670-54d3-a7d1-0ace20592ac6
2026-03-28 18:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_a72fb950ab9197306bb872a27cc37d21.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456336bd0>
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_884acff4f3036f7ce05ece59c5ff121d.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_884acff4f3036f7ce05ece59c5ff121d.jpg saved to cache
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 764982c2-d5a5-59a9-9565-62649ecb4113
2026-03-28 18:43:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477ddd0>
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_c27f3a5a2cbf4a8a54c95a9edb9b3ba9.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_c27f3a5a2cbf4a8a54c95a9edb9b3ba9.jpg saved to cache
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 764982c2-d5a5-59a9-9565-62649ecb4113
2026-03-28 18:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_b0ba0b7ae9f1c526d2f7b5ffcbdaf786.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_ce57ef52128649b0013871d429beb080.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_343cfac773b2a9af86ca90e239610bdd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458245dd0>
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_ac39f65753315c89e56c8ed207dd6fb5.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_ac39f65753315c89e56c8ed207dd6fb5.jpg saved to cache
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 764982c2-d5a5-59a9-9565-62649ecb4113
2026-03-28 18:43:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245640c950>
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_1bff9f976267017de8cf17fd81c9d79c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_1bff9f976267017de8cf17fd81c9d79c.jpg saved to cache
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81
2026-03-28 18:43:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245636fb50>
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_0f2c4b75a292dcc95936fffce5a601ee.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_0f2c4b75a292dcc95936fffce5a601ee.jpg saved to cache
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 764982c2-d5a5-59a9-9565-62649ecb4113
2026-03-28 18:43:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547592d0>
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_3ad691c20892905f5fc5e58ea415bbda.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_3ad691c20892905f5fc5e58ea415bbda.jpg saved to cache
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 631fc12c-c425-58b2-920f-935a9c081e00
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b3710>
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89c4e953-abb0-5306-8d55-d68a1fa3b745/89c4e953-abb0-5306-8d55-d68a1fa3b745_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fbc%252F00bc27e0a7d666583a5c37436a6b4290%252Fpa%252FCT96582_a72fb950ab9197306bb872a27cc37d21.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_a72fb950ab9197306bb872a27cc37d21.jpg saved to cache
2026-03-28 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89c4e953-abb0-5306-8d55-d68a1fa3b745
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458274f50>
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_b0ba0b7ae9f1c526d2f7b5ffcbdaf786.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_b0ba0b7ae9f1c526d2f7b5ffcbdaf786.jpg saved to cache
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 631fc12c-c425-58b2-920f-935a9c081e00
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458560c10>
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89c4e953-abb0-5306-8d55-d68a1fa3b745/89c4e953-abb0-5306-8d55-d68a1fa3b745_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fbc%252F00bc27e0a7d666583a5c37436a6b4290%252Fpa%252FCT96582_ce57ef52128649b0013871d429beb080.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_ce57ef52128649b0013871d429beb080.jpg saved to cache
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89c4e953-abb0-5306-8d55-d68a1fa3b745
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456363850>
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_343cfac773b2a9af86ca90e239610bdd.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_343cfac773b2a9af86ca90e239610bdd.jpg saved to cache
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db18e522-6670-54d3-a7d1-0ace20592ac6
2026-03-28 18:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_b2c705d2d4eb10f3fb8a0ffe0a395366.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_4c4d41eb491d37e6bb18c75239601193.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_9a39d5cebb596272b7d35e54d10abe2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_008a51341c85bfcde8cecd691ab30f57.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_ced8024e14a9c09531be679e50d27c1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_f6213f3e0a62324c0a8d5c7e9476a70d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_8526f499645ec41629393dc031ecc417.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_0073509da3fee662306420edcac10fba.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24582b8750>
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_b2c705d2d4eb10f3fb8a0ffe0a395366.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_b2c705d2d4eb10f3fb8a0ffe0a395366.jpg saved to cache
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-03-28 18:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_79c5c8c25e0e3e90e02bd497e4e6fc15.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_4053dc5f0dd53fd87928647b82150e43.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b4210>
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_4c4d41eb491d37e6bb18c75239601193.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_4c4d41eb491d37e6bb18c75239601193.jpg saved to cache
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e7d2f42-760d-5aa5-ac65-062955d47841
2026-03-28 18:43:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456295cd0>
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_9a39d5cebb596272b7d35e54d10abe2b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_9a39d5cebb596272b7d35e54d10abe2b.jpg saved to cache
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-03-28 18:43:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454744ad0>
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_008a51341c85bfcde8cecd691ab30f57.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_008a51341c85bfcde8cecd691ab30f57.jpg saved to cache
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-03-28 18:43:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245603e510>
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_ced8024e14a9c09531be679e50d27c1b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_ced8024e14a9c09531be679e50d27c1b.jpg saved to cache
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245828b4d0>
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_f6213f3e0a62324c0a8d5c7e9476a70d.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_f6213f3e0a62324c0a8d5c7e9476a70d.jpg saved to cache
2026-03-28 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245615a150>
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89c4e953-abb0-5306-8d55-d68a1fa3b745/89c4e953-abb0-5306-8d55-d68a1fa3b745_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fbc%252F00bc27e0a7d666583a5c37436a6b4290%252Fpa%252FCT96582_8526f499645ec41629393dc031ecc417.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_8526f499645ec41629393dc031ecc417.jpg saved to cache
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89c4e953-abb0-5306-8d55-d68a1fa3b745
2026-03-28 18:43:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2457154d50>
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_0073509da3fee662306420edcac10fba.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_0073509da3fee662306420edcac10fba.jpg saved to cache
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-03-28 18:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR46217/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855ab10>
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_79c5c8c25e0e3e90e02bd497e4e6fc15.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_79c5c8c25e0e3e90e02bd497e4e6fc15.jpg saved to cache
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638d690>
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89c4e953-abb0-5306-8d55-d68a1fa3b745/89c4e953-abb0-5306-8d55-d68a1fa3b745_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fbc%252F00bc27e0a7d666583a5c37436a6b4290%252Fpa%252FCT96582_4053dc5f0dd53fd87928647b82150e43.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_4053dc5f0dd53fd87928647b82150e43.jpg saved to cache
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89c4e953-abb0-5306-8d55-d68a1fa3b745
2026-03-28 18:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_246271eaef140e6976d6ef650272b220.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_3e09e618085124328837b3bed51caf6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_7eb2847627a86ba0747cc62738c2e22b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_ecc2ab63937cd29d7f913f6dedf11574.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547612d0>
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_246271eaef140e6976d6ef650272b220.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_246271eaef140e6976d6ef650272b220.jpg saved to cache
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-03-28 18:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_ae558a92238d31b5633cd34722d6eb9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_2ea902420042024b873dc45a4f04fd49.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458532c90>
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_3e09e618085124328837b3bed51caf6a.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_3e09e618085124328837b3bed51caf6a.jpg saved to cache
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e7d2f42-760d-5aa5-ac65-062955d47841
2026-03-28 18:43:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245826d210>
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_7eb2847627a86ba0747cc62738c2e22b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_7eb2847627a86ba0747cc62738c2e22b.jpg saved to cache
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-03-28 18:43:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454773990>
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_ecc2ab63937cd29d7f913f6dedf11574.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_ecc2ab63937cd29d7f913f6dedf11574.jpg saved to cache
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db18e522-6670-54d3-a7d1-0ace20592ac6
2026-03-28 18:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_049c72aedb747aacbc7d9f2f8c225408.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245630f050>
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89c4e953-abb0-5306-8d55-d68a1fa3b745/89c4e953-abb0-5306-8d55-d68a1fa3b745_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fbc%252F00bc27e0a7d666583a5c37436a6b4290%252Fpa%252FCT96582_ae558a92238d31b5633cd34722d6eb9e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_ae558a92238d31b5633cd34722d6eb9e.jpg saved to cache
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89c4e953-abb0-5306-8d55-d68a1fa3b745
2026-03-28 18:43:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89c4e953-abb0-5306-8d55-d68a1fa3b745, skipping ID generation
2026-03-28 18:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89c4e953-abb0-5306-8d55-d68a1fa3b745 with scrape type 1
2026-03-28 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89c4e953-abb0-5306-8d55-d68a1fa3b745 sending to next pipeline
2026-03-28 18:43:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89c4e953-abb0-5306-8d55-d68a1fa3b745, identifier: CT96582
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245828a190>
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_2ea902420042024b873dc45a4f04fd49.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_2ea902420042024b873dc45a4f04fd49.jpg saved to cache
2026-03-28 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e7d2f42-760d-5aa5-ac65-062955d47841
2026-03-28 18:43:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89c4e953-abb0-5306-8d55-d68a1fa3b745 with identifier: CT96582
2026-03-28 18:43:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89c4e953-abb0-5306-8d55-d68a1fa3b745 with identifier: CT96582
2026-03-28 18:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89c4e953-abb0-5306-8d55-d68a1fa3b745 with identifier: CT96582 to the API
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_ae558a92238d31b5633cd34722d6eb9e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:38:08Z',
 'fuel_type': 'petrol',
 'id': '89c4e953-abb0-5306-8d55-d68a1fa3b745',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT96582',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 162372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89c4e953-abb0-5306-8d55-d68a1fa3b745/89c4e953-abb0-5306-8d55-d68a1fa3b745_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_ce57ef52128649b0013871d429beb080.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89c4e953-abb0-5306-8d55-d68a1fa3b745/89c4e953-abb0-5306-8d55-d68a1fa3b745_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_ae558a92238d31b5633cd34722d6eb9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89c4e953-abb0-5306-8d55-d68a1fa3b745/89c4e953-abb0-5306-8d55-d68a1fa3b745_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_a72fb950ab9197306bb872a27cc37d21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89c4e953-abb0-5306-8d55-d68a1fa3b745/89c4e953-abb0-5306-8d55-d68a1fa3b745_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_4053dc5f0dd53fd87928647b82150e43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89c4e953-abb0-5306-8d55-d68a1fa3b745/89c4e953-abb0-5306-8d55-d68a1fa3b745_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/bc/00bc27e0a7d666583a5c37436a6b4290/pa/CT96582_8526f499645ec41629393dc031ecc417.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2011}
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT96582%27 HTTP/1.1" 200 None
2026-03-28 18:43:55 [auto1.de] INFO: Saving data for CT96582: {'created_time': 1774723435.569645, 'last_price_update_time': 1774723435.569657, 'auction_closing_time': 1774885088.0}
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT96582') HTTP/1.1" 204 0
2026-03-28 18:43:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_e5d66d4619691745cf43f0ba65b643af.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_b16ac87ecd50e93179056dd52a902908.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT01554> (referer: https://www.auto1.com/v1/car-details-view/BT01554/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_2427ef043b052608ca1e3f95b142e974.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564336d0>
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_049c72aedb747aacbc7d9f2f8c225408.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_049c72aedb747aacbc7d9f2f8c225408.jpg saved to cache
2026-03-28 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db18e522-6670-54d3-a7d1-0ace20592ac6
2026-03-28 18:43:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_cd694bbedcbdb45a1d85dabd7a031265.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_4ed1ed699404ed3a0bbca296f3c4e5e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_cae235463b2fc8bd8c363eab77931db9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_227eab83b3186fcbbd5d5e04c4c78a88.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_4493470942653c0e1c0745a23d25dcc8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_69176cce0d14a75b043f93a2785c78fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456433190>
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_e5d66d4619691745cf43f0ba65b643af.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_e5d66d4619691745cf43f0ba65b643af.jpg saved to cache
2026-03-28 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2b35c26-8b63-5a37-9c29-939b9ef43fba
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456312510>
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_b16ac87ecd50e93179056dd52a902908.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_b16ac87ecd50e93179056dd52a902908.jpg saved to cache
2026-03-28 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 631fc12c-c425-58b2-920f-935a9c081e00
2026-03-28 18:43:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65484d54-8a63-5ef0-9ec8-7299f1a362a1 with identifier: BT01554
2026-03-28 18:43:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65484d54-8a63-5ef0-9ec8-7299f1a362a1 with scrape type 1
2026-03-28 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 65484d54-8a63-5ef0-9ec8-7299f1a362a1
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F66%252F4f66aaf126a26079300daa09eb7aa753%252Fpa%252FBT01554_2448e4648ff836f3d21fcbb3aa5c7161.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_2448e4648ff836f3d21fcbb3aa5c7161.jpg not downloaded yet
2026-03-28 18:43:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563263d0>
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fe5%252Ff9e555f1747a5beb3f6b2070e16a146f%252Fpa%252FFC21553_2427ef043b052608ca1e3f95b142e974.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_2427ef043b052608ca1e3f95b142e974.jpg saved to cache
2026-03-28 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827
2026-03-28 18:43:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827, skipping ID generation
2026-03-28 18:43:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with scrape type 1
2026-03-28 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 sending to next pipeline
2026-03-28 18:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827, identifier: FC21553
2026-03-28 18:43:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245608f890>
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_cd694bbedcbdb45a1d85dabd7a031265.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_cd694bbedcbdb45a1d85dabd7a031265.jpg saved to cache
2026-03-28 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db18e522-6670-54d3-a7d1-0ace20592ac6
2026-03-28 18:43:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477b8d0>
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_4ed1ed699404ed3a0bbca296f3c4e5e8.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_4ed1ed699404ed3a0bbca296f3c4e5e8.jpg saved to cache
2026-03-28 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e7d2f42-760d-5aa5-ac65-062955d47841
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245616d950>
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_cae235463b2fc8bd8c363eab77931db9.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_cae235463b2fc8bd8c363eab77931db9.jpg saved to cache
2026-03-28 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2b35c26-8b63-5a37-9c29-939b9ef43fba
2026-03-28 18:43:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456430250>
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_227eab83b3186fcbbd5d5e04c4c78a88.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_227eab83b3186fcbbd5d5e04c4c78a88.jpg saved to cache
2026-03-28 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e7d2f42-760d-5aa5-ac65-062955d47841
2026-03-28 18:43:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456263c50>
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_4493470942653c0e1c0745a23d25dcc8.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_4493470942653c0e1c0745a23d25dcc8.jpg saved to cache
2026-03-28 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db18e522-6670-54d3-a7d1-0ace20592ac6
2026-03-28 18:43:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245624c690>
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_69176cce0d14a75b043f93a2785c78fd.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_69176cce0d14a75b043f93a2785c78fd.jpg saved to cache
2026-03-28 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db18e522-6670-54d3-a7d1-0ace20592ac6
2026-03-28 18:43:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_c9f4423b38c67ec867cc39b65edfed25.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with identifier: FC21553
2026-03-28 18:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with identifier: FC21553
2026-03-28 18:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with identifier: FC21553 to the API
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_2427ef043b052608ca1e3f95b142e974.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:27:08Z',
 'fuel_type': 'diesel',
 'id': '4cc0d039-5b42-53e5-b0a9-2ef0d870a827',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC21553',
 'listing': 'auction',
 'location': 'DE, Landsberg am Lech',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 207486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2927926,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_2427ef043b052608ca1e3f95b142e974.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2954939,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_008a51341c85bfcde8cecd691ab30f57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2718561,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_0073509da3fee662306420edcac10fba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2710896,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_b2c705d2d4eb10f3fb8a0ffe0a395366.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2881426,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_9a39d5cebb596272b7d35e54d10abe2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2780136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_246271eaef140e6976d6ef650272b220.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_79c5c8c25e0e3e90e02bd497e4e6fc15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3088415,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_7eb2847627a86ba0747cc62738c2e22b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_f6213f3e0a62324c0a8d5c7e9476a70d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cc0d039-5b42-53e5-b0a9-2ef0d870a827/4cc0d039-5b42-53e5-b0a9-2ef0d870a827_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2800170,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/e5/f9e555f1747a5beb3f6b2070e16a146f/pa/FC21553_ced8024e14a9c09531be679e50d27c1b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Kinetic AWD',
 'transmission': 'automatic',
 'trim': 'Kinetic AWD',
 'year': 2016}
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC21553%27 HTTP/1.1" 200 None
2026-03-28 18:43:57 [auto1.de] INFO: Saving data for FC21553: {'created_time': 1774723437.028269, 'last_price_update_time': 1774723437.028281, 'auction_closing_time': 1774884428.0}
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC21553') HTTP/1.1" 204 0
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F66%252F4f66aaf126a26079300daa09eb7aa753%252Fpa%252FBT01554_a1db662f52f85e6d764d30da020daf55.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_a1db662f52f85e6d764d30da020daf55.jpg not downloaded yet
2026-03-28 18:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_3f69426057c5e18f6aeb723c399c2ca5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F66%252F4f66aaf126a26079300daa09eb7aa753%252Fpa%252FBT01554_fa173b938a372fba362633b314695c01.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_fa173b938a372fba362633b314695c01.jpg not downloaded yet
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245624bdd0>
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_c9f4423b38c67ec867cc39b65edfed25.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_c9f4423b38c67ec867cc39b65edfed25.jpg saved to cache
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 631fc12c-c425-58b2-920f-935a9c081e00
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F66%252F4f66aaf126a26079300daa09eb7aa753%252Fpa%252FBT01554_b177b46f45a25683443b827158f2eb57.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_b177b46f45a25683443b827158f2eb57.jpg not downloaded yet
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F66%252F4f66aaf126a26079300daa09eb7aa753%252Fpa%252FBT01554_4035b35e479be47c10e8c477a4c4d5d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_4035b35e479be47c10e8c477a4c4d5d7.jpg not downloaded yet
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456249050>
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_3f69426057c5e18f6aeb723c399c2ca5.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_3f69426057c5e18f6aeb723c399c2ca5.jpg saved to cache
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 631fc12c-c425-58b2-920f-935a9c081e00
2026-03-28 18:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_2448e4648ff836f3d21fcbb3aa5c7161.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_2bff00faed735dfc037aaa56d1abf4c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_733467c7cd4de16ab1998d15aa6037bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_9bb929c3d509d6d864adde242bc3322d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_addaade9196a47f933d95760b5ae8c11.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_ea25f2ada4fbf2a773d0a607a4e2d7b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_8f4803c4b3b9ac1baad99644a39b8ef0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_4f9479930fbcce1270100d92f77b5262.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_b177b46f45a25683443b827158f2eb57.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245841d490>
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65484d54-8a63-5ef0-9ec8-7299f1a362a1/65484d54-8a63-5ef0-9ec8-7299f1a362a1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F66%252F4f66aaf126a26079300daa09eb7aa753%252Fpa%252FBT01554_2448e4648ff836f3d21fcbb3aa5c7161.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_2448e4648ff836f3d21fcbb3aa5c7161.jpg saved to cache
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65484d54-8a63-5ef0-9ec8-7299f1a362a1
2026-03-28 18:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_ebd12688fc00c71be035232b01e6fb48.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454745090>
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_2bff00faed735dfc037aaa56d1abf4c5.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_2bff00faed735dfc037aaa56d1abf4c5.jpg saved to cache
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e7d2f42-760d-5aa5-ac65-062955d47841
2026-03-28 18:43:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456286ad0>
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F00%252F72005e5c69ca138954f5ea51b68d7c5b%252Fpa%252FFT90380_733467c7cd4de16ab1998d15aa6037bf.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_733467c7cd4de16ab1998d15aa6037bf.jpg saved to cache
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e7d2f42-760d-5aa5-ac65-062955d47841
2026-03-28 18:43:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e7d2f42-760d-5aa5-ac65-062955d47841, skipping ID generation
2026-03-28 18:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7d2f42-760d-5aa5-ac65-062955d47841 with scrape type 1
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e7d2f42-760d-5aa5-ac65-062955d47841 sending to next pipeline
2026-03-28 18:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e7d2f42-760d-5aa5-ac65-062955d47841, identifier: FT90380
2026-03-28 18:43:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456376250>
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_9bb929c3d509d6d864adde242bc3322d.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_9bb929c3d509d6d864adde242bc3322d.jpg saved to cache
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2b35c26-8b63-5a37-9c29-939b9ef43fba
2026-03-28 18:43:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456242510>
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_addaade9196a47f933d95760b5ae8c11.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_addaade9196a47f933d95760b5ae8c11.jpg saved to cache
2026-03-28 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db18e522-6670-54d3-a7d1-0ace20592ac6
2026-03-28 18:43:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618c810>
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_ea25f2ada4fbf2a773d0a607a4e2d7b7.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_ea25f2ada4fbf2a773d0a607a4e2d7b7.jpg saved to cache
2026-03-28 18:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2b35c26-8b63-5a37-9c29-939b9ef43fba
2026-03-28 18:43:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456286ad0>
2026-03-28 18:43:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F26%252F7b26fd89287fa8df9390ac3fda0d6bc7%252Fpa%252FWN98696_8f4803c4b3b9ac1baad99644a39b8ef0.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_8f4803c4b3b9ac1baad99644a39b8ef0.jpg saved to cache
2026-03-28 18:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db18e522-6670-54d3-a7d1-0ace20592ac6
2026-03-28 18:43:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db18e522-6670-54d3-a7d1-0ace20592ac6, skipping ID generation
2026-03-28 18:43:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db18e522-6670-54d3-a7d1-0ace20592ac6 with scrape type 1
2026-03-28 18:43:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db18e522-6670-54d3-a7d1-0ace20592ac6 sending to next pipeline
2026-03-28 18:43:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db18e522-6670-54d3-a7d1-0ace20592ac6, identifier: WN98696
2026-03-28 18:43:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458904390>
2026-03-28 18:43:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_4f9479930fbcce1270100d92f77b5262.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_4f9479930fbcce1270100d92f77b5262.jpg saved to cache
2026-03-28 18:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2b35c26-8b63-5a37-9c29-939b9ef43fba
2026-03-28 18:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e7d2f42-760d-5aa5-ac65-062955d47841 with identifier: FT90380
2026-03-28 18:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e7d2f42-760d-5aa5-ac65-062955d47841 with identifier: FT90380
2026-03-28 18:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e7d2f42-760d-5aa5-ac65-062955d47841 with identifier: FT90380 to the API
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_733467c7cd4de16ab1998d15aa6037bf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 208,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:46:13Z',
 'fuel_type': 'petrol',
 'id': '9e7d2f42-760d-5aa5-ac65-062955d47841',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT90380',
 'listing': 'auction',
 'location': 'DE, Kamen',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 86547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2632029,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_733467c7cd4de16ab1998d15aa6037bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2429697,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_2bff00faed735dfc037aaa56d1abf4c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_f139df98615601cd2a9e30135f1ebf61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_7ccb4859e25024f5a508103dd26139b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_46cdb89877cbd9ee202e3f62586a3aae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619649,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_4c4d41eb491d37e6bb18c75239601193.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2321252,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_4ed1ed699404ed3a0bbca296f3c4e5e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_2ea902420042024b873dc45a4f04fd49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3129725,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_227eab83b3186fcbbd5d5e04c4c78a88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d2f42-760d-5aa5-ac65-062955d47841/9e7d2f42-760d-5aa5-ac65-062955d47841_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2514097,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/00/72005e5c69ca138954f5ea51b68d7c5b/pa/FT90380_3e09e618085124328837b3bed51caf6a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2019}
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT90380%27 HTTP/1.1" 200 None
2026-03-28 18:43:58 [auto1.de] INFO: Saving data for FT90380: {'created_time': 1774723438.653174, 'last_price_update_time': 1774723438.653184, 'auction_closing_time': 1774885573.0}
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT90380') HTTP/1.1" 204 0
2026-03-28 18:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db18e522-6670-54d3-a7d1-0ace20592ac6 with identifier: WN98696
2026-03-28 18:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db18e522-6670-54d3-a7d1-0ace20592ac6 with identifier: WN98696
2026-03-28 18:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db18e522-6670-54d3-a7d1-0ace20592ac6 with identifier: WN98696 to the API
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_8f4803c4b3b9ac1baad99644a39b8ef0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:50:13Z',
 'fuel_type': 'petrol',
 'id': 'db18e522-6670-54d3-a7d1-0ace20592ac6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN98696',
 'listing': 'auction',
 'location': 'DE, Trier',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 215879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3198271,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_addaade9196a47f933d95760b5ae8c11.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3271311,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_8f4803c4b3b9ac1baad99644a39b8ef0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_ff9ac875417b5230587e726b89f4669a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_6848c72ea2883ead46eea4a340f05b3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_343cfac773b2a9af86ca90e239610bdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3067329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_69176cce0d14a75b043f93a2785c78fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2955992,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_4493470942653c0e1c0745a23d25dcc8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_049c72aedb747aacbc7d9f2f8c225408.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3278125,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_cd694bbedcbdb45a1d85dabd7a031265.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db18e522-6670-54d3-a7d1-0ace20592ac6/db18e522-6670-54d3-a7d1-0ace20592ac6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3241474,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/26/7b26fd89287fa8df9390ac3fda0d6bc7/pa/WN98696_ecc2ab63937cd29d7f913f6dedf11574.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI I-Tech',
 'transmission': 'manual',
 'trim': 'I-Tech',
 'year': 2015}
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN98696%27 HTTP/1.1" 200 None
2026-03-28 18:43:59 [auto1.de] INFO: Saving data for WN98696: {'created_time': 1774723439.027951, 'last_price_update_time': 1774723439.027963, 'auction_closing_time': 1774885813.0}
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN98696') HTTP/1.1" 204 0
2026-03-28 18:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_4035b35e479be47c10e8c477a4c4d5d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561911d0>
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65484d54-8a63-5ef0-9ec8-7299f1a362a1/65484d54-8a63-5ef0-9ec8-7299f1a362a1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F66%252F4f66aaf126a26079300daa09eb7aa753%252Fpa%252FBT01554_b177b46f45a25683443b827158f2eb57.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_b177b46f45a25683443b827158f2eb57.jpg saved to cache
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65484d54-8a63-5ef0-9ec8-7299f1a362a1
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456213e90>
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_ebd12688fc00c71be035232b01e6fb48.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_ebd12688fc00c71be035232b01e6fb48.jpg saved to cache
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 631fc12c-c425-58b2-920f-935a9c081e00
2026-03-28 18:43:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245640e350>
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65484d54-8a63-5ef0-9ec8-7299f1a362a1/65484d54-8a63-5ef0-9ec8-7299f1a362a1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F66%252F4f66aaf126a26079300daa09eb7aa753%252Fpa%252FBT01554_4035b35e479be47c10e8c477a4c4d5d7.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_4035b35e479be47c10e8c477a4c4d5d7.jpg saved to cache
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65484d54-8a63-5ef0-9ec8-7299f1a362a1
2026-03-28 18:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_a1db662f52f85e6d764d30da020daf55.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_8c302689e96f9284d803d25d4576a279.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_70014c2ee852ccad4836a84228635cb9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_d01757ca9070a1e8648734adaab9e5e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_afe7e938126daff28b4fbd1bed720225.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_fa173b938a372fba362633b314695c01.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_b5e5c5701abf7e6b3155d6bf8832103a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245476a690>
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65484d54-8a63-5ef0-9ec8-7299f1a362a1/65484d54-8a63-5ef0-9ec8-7299f1a362a1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F66%252F4f66aaf126a26079300daa09eb7aa753%252Fpa%252FBT01554_a1db662f52f85e6d764d30da020daf55.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_a1db662f52f85e6d764d30da020daf55.jpg saved to cache
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65484d54-8a63-5ef0-9ec8-7299f1a362a1
2026-03-28 18:43:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d8610>
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_8c302689e96f9284d803d25d4576a279.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_8c302689e96f9284d803d25d4576a279.jpg saved to cache
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 631fc12c-c425-58b2-920f-935a9c081e00
2026-03-28 18:43:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b2310>
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F14%252Fde1443032201caf6a7b48ebbfa52abce%252Fpa%252FUB44378_70014c2ee852ccad4836a84228635cb9.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_70014c2ee852ccad4836a84228635cb9.jpg saved to cache
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 631fc12c-c425-58b2-920f-935a9c081e00
2026-03-28 18:43:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 631fc12c-c425-58b2-920f-935a9c081e00, skipping ID generation
2026-03-28 18:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 631fc12c-c425-58b2-920f-935a9c081e00 with scrape type 1
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 631fc12c-c425-58b2-920f-935a9c081e00 sending to next pipeline
2026-03-28 18:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 631fc12c-c425-58b2-920f-935a9c081e00, identifier: UB44378
2026-03-28 18:43:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456493210>
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_d01757ca9070a1e8648734adaab9e5e4.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_d01757ca9070a1e8648734adaab9e5e4.jpg saved to cache
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2b35c26-8b63-5a37-9c29-939b9ef43fba
2026-03-28 18:43:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245614b750>
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_afe7e938126daff28b4fbd1bed720225.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_afe7e938126daff28b4fbd1bed720225.jpg saved to cache
2026-03-28 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2b35c26-8b63-5a37-9c29-939b9ef43fba
2026-03-28 18:43:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d3190>
2026-03-28 18:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65484d54-8a63-5ef0-9ec8-7299f1a362a1/65484d54-8a63-5ef0-9ec8-7299f1a362a1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F66%252F4f66aaf126a26079300daa09eb7aa753%252Fpa%252FBT01554_fa173b938a372fba362633b314695c01.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_fa173b938a372fba362633b314695c01.jpg saved to cache
2026-03-28 18:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65484d54-8a63-5ef0-9ec8-7299f1a362a1
2026-03-28 18:44:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65484d54-8a63-5ef0-9ec8-7299f1a362a1, skipping ID generation
2026-03-28 18:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65484d54-8a63-5ef0-9ec8-7299f1a362a1 with scrape type 1
2026-03-28 18:44:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65484d54-8a63-5ef0-9ec8-7299f1a362a1 sending to next pipeline
2026-03-28 18:44:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65484d54-8a63-5ef0-9ec8-7299f1a362a1, identifier: BT01554
2026-03-28 18:44:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d2bd0>
2026-03-28 18:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_b5e5c5701abf7e6b3155d6bf8832103a.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_b5e5c5701abf7e6b3155d6bf8832103a.jpg saved to cache
2026-03-28 18:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2b35c26-8b63-5a37-9c29-939b9ef43fba
2026-03-28 18:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_66be70866ce7eafc10d1dc7a36a85de6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR37501/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 631fc12c-c425-58b2-920f-935a9c081e00 with identifier: UB44378
2026-03-28 18:44:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 631fc12c-c425-58b2-920f-935a9c081e00 with identifier: UB44378
2026-03-28 18:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 631fc12c-c425-58b2-920f-935a9c081e00 with identifier: UB44378 to the API
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_70014c2ee852ccad4836a84228635cb9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:38Z',
 'fuel_type': 'petrol',
 'id': '631fc12c-c425-58b2-920f-935a9c081e00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB44378',
 'listing': 'auction',
 'location': 'DE, Kaiserslautern',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 120930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3014019,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_70014c2ee852ccad4836a84228635cb9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_cc45f9d2b9711016c00077fd4783e21c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_009f0de44d43e62898cf222d187867c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643301,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_8c302689e96f9284d803d25d4576a279.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_ebd12688fc00c71be035232b01e6fb48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_3f69426057c5e18f6aeb723c399c2ca5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_c9f4423b38c67ec867cc39b65edfed25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3232646,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_3ad691c20892905f5fc5e58ea415bbda.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_b0ba0b7ae9f1c526d2f7b5ffcbdaf786.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_631fc12c-c425-58b2-920f-935a9c081e00/631fc12c-c425-58b2-920f-935a9c081e00_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/14/de1443032201caf6a7b48ebbfa52abce/pa/UB44378_b16ac87ecd50e93179056dd52a902908.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Clever',
 'transmission': 'automatic',
 'trim': 'Clever',
 'year': 2019}
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB44378%27 HTTP/1.1" 200 None
2026-03-28 18:44:00 [auto1.de] INFO: Saving data for UB44378: {'created_time': 1774723440.75138, 'last_price_update_time': 1774723440.751391, 'auction_closing_time': 1774884638.0}
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB44378') HTTP/1.1" 204 0
2026-03-28 18:44:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65484d54-8a63-5ef0-9ec8-7299f1a362a1 with identifier: BT01554
2026-03-28 18:44:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65484d54-8a63-5ef0-9ec8-7299f1a362a1 with identifier: BT01554
2026-03-28 18:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65484d54-8a63-5ef0-9ec8-7299f1a362a1 with identifier: BT01554 to the API
2026-03-28 18:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_fa173b938a372fba362633b314695c01.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:34:09Z',
 'fuel_type': 'diesel',
 'id': '65484d54-8a63-5ef0-9ec8-7299f1a362a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT01554',
 'listing': 'auction',
 'location': 'DE, Hagen',
 'make': 'Fiat',
 'model': 'Qubo',
 'odometer': 148818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65484d54-8a63-5ef0-9ec8-7299f1a362a1/65484d54-8a63-5ef0-9ec8-7299f1a362a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_2448e4648ff836f3d21fcbb3aa5c7161.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65484d54-8a63-5ef0-9ec8-7299f1a362a1/65484d54-8a63-5ef0-9ec8-7299f1a362a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_a1db662f52f85e6d764d30da020daf55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65484d54-8a63-5ef0-9ec8-7299f1a362a1/65484d54-8a63-5ef0-9ec8-7299f1a362a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_fa173b938a372fba362633b314695c01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65484d54-8a63-5ef0-9ec8-7299f1a362a1/65484d54-8a63-5ef0-9ec8-7299f1a362a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_b177b46f45a25683443b827158f2eb57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65484d54-8a63-5ef0-9ec8-7299f1a362a1/65484d54-8a63-5ef0-9ec8-7299f1a362a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/66/4f66aaf126a26079300daa09eb7aa753/pa/BT01554_4035b35e479be47c10e8c477a4c4d5d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Qubo 1.3 JTD Trekking',
 'transmission': 'manual',
 'trim': 'Trekking',
 'year': 2010}
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT01554%27 HTTP/1.1" 200 None
2026-03-28 18:44:01 [auto1.de] INFO: Saving data for BT01554: {'created_time': 1774723441.147408, 'last_price_update_time': 1774723441.147423, 'auction_closing_time': 1774884849.0}
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT01554') HTTP/1.1" 204 0
2026-03-28 18:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH28612> (referer: https://www.auto1.com/v1/car-details-view/XH28612/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM32674/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456149e50>
2026-03-28 18:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_66be70866ce7eafc10d1dc7a36a85de6.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_66be70866ce7eafc10d1dc7a36a85de6.jpg saved to cache
2026-03-28 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81
2026-03-28 18:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_41895e868502209390df1b3cf5132e12.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_e2b0502323bc2f729413632ecdbe8456.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_77b4e0c5e45d42f868ef77535293319d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_c91274fb5d5a083176e68ffa01dddbff.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 915406a7-db45-5663-97f1-3654017a8211 with identifier: XH28612
2026-03-28 18:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915406a7-db45-5663-97f1-3654017a8211 with scrape type 1
2026-03-28 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 915406a7-db45-5663-97f1-3654017a8211
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_53201795724d14d509c42ca489a474d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_53201795724d14d509c42ca489a474d4.jpg not downloaded yet
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_bd488da64cdd98ccc7a08e2a47cbd218.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_bd488da64cdd98ccc7a08e2a47cbd218.jpg not downloaded yet
2026-03-28 18:44:01 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 6010 | hits on page: 40
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_f03ec2beabb252a6ee3ee712b6b2c30b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_f03ec2beabb252a6ee3ee712b6b2c30b.jpg not downloaded yet
2026-03-28 18:44:01 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-28 18:44:01 [auto1.de] INFO: Found listing with ID: TK68896
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK68896%27 HTTP/1.1" 200 None
2026-03-28 18:44:01 [auto1.de] INFO: Scrape type for TK68896: 1
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_bd8055472af6b4aa617c28875829996b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_bd8055472af6b4aa617c28875829996b.jpg not downloaded yet
2026-03-28 18:44:01 [auto1.de] INFO: Found listing with ID: TV85934
2026-03-28 18:44:01 [auto1.de] INFO: Found listing with ID: YN89436
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN89436%27 HTTP/1.1" 200 None
2026-03-28 18:44:01 [auto1.de] INFO: Scrape type for YN89436: 1
2026-03-28 18:44:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b7e10>
2026-03-28 18:44:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F8b%252Fcb8b348120dfd3f87bca292f30b25643%252Fpa%252FXD40949_41895e868502209390df1b3cf5132e12.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_41895e868502209390df1b3cf5132e12.jpg saved to cache
2026-03-28 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2b35c26-8b63-5a37-9c29-939b9ef43fba
2026-03-28 18:44:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2b35c26-8b63-5a37-9c29-939b9ef43fba, skipping ID generation
2026-03-28 18:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2b35c26-8b63-5a37-9c29-939b9ef43fba with scrape type 1
2026-03-28 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2b35c26-8b63-5a37-9c29-939b9ef43fba sending to next pipeline
2026-03-28 18:44:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2b35c26-8b63-5a37-9c29-939b9ef43fba, identifier: XD40949
2026-03-28 18:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_fca0abb01fa68a0d08e1b2206871158e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_be17d55b39f50ccca72224cc9c5b401c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_be17d55b39f50ccca72224cc9c5b401c.jpg not downloaded yet
2026-03-28 18:44:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2b35c26-8b63-5a37-9c29-939b9ef43fba with identifier: XD40949
2026-03-28 18:44:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2b35c26-8b63-5a37-9c29-939b9ef43fba with identifier: XD40949
2026-03-28 18:44:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2b35c26-8b63-5a37-9c29-939b9ef43fba with identifier: XD40949 to the API
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_41895e868502209390df1b3cf5132e12.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:04:30Z',
 'fuel_type': 'petrol',
 'id': 'b2b35c26-8b63-5a37-9c29-939b9ef43fba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD40949',
 'listing': 'auction',
 'location': 'DE, Düsseldorf',
 'make': 'Volvo',
 'model': 'C70',
 'odometer': 89015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3325051,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_41895e868502209390df1b3cf5132e12.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3396414,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_b5e5c5701abf7e6b3155d6bf8832103a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3285971,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_afe7e938126daff28b4fbd1bed720225.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3268790,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_d01757ca9070a1e8648734adaab9e5e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_4f9479930fbcce1270100d92f77b5262.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3423932,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_ea25f2ada4fbf2a773d0a607a4e2d7b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3298587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_9bb929c3d509d6d864adde242bc3322d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_aca268c1bcbb51397a156fb2097b4bc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_cae235463b2fc8bd8c363eab77931db9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b35c26-8b63-5a37-9c29-939b9ef43fba/b2b35c26-8b63-5a37-9c29-939b9ef43fba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/8b/cb8b348120dfd3f87bca292f30b25643/pa/XD40949_e5d66d4619691745cf43f0ba65b643af.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-04-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volvo C70 2.0 T',
 'transmission': 'automatic',
 'trim': '',
 'year': 2001}
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD40949%27 HTTP/1.1" 200 None
2026-03-28 18:44:02 [auto1.de] INFO: Saving data for XD40949: {'created_time': 1774723442.068429, 'last_price_update_time': 1774723442.068442, 'auction_closing_time': 1774883070.0}
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD40949') HTTP/1.1" 204 0
2026-03-28 18:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_5fc069f0ab88f387605d094814a144c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:02 [auto1.de] INFO: Found listing with ID: YN15081
2026-03-28 18:44:02 [auto1.de] INFO: Found listing with ID: PR24120
2026-03-28 18:44:02 [auto1.de] INFO: Found listing with ID: WB47522
2026-03-28 18:44:02 [auto1.de] INFO: Found listing with ID: PM63573
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM63573%27 HTTP/1.1" 200 None
2026-03-28 18:44:02 [auto1.de] INFO: Scrape type for PM63573: 1
2026-03-28 18:44:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618cc10>
2026-03-28 18:44:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_e2b0502323bc2f729413632ecdbe8456.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_e2b0502323bc2f729413632ecdbe8456.jpg saved to cache
2026-03-28 18:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 764982c2-d5a5-59a9-9565-62649ecb4113
2026-03-28 18:44:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454747e90>
2026-03-28 18:44:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_77b4e0c5e45d42f868ef77535293319d.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_77b4e0c5e45d42f868ef77535293319d.jpg saved to cache
2026-03-28 18:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81
2026-03-28 18:44:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456242bd0>
2026-03-28 18:44:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fec%252Fcdec551f3b56dddb1ce7bf620ffd3736%252Fpa%252FBP86172_c91274fb5d5a083176e68ffa01dddbff.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_c91274fb5d5a083176e68ffa01dddbff.jpg saved to cache
2026-03-28 18:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 764982c2-d5a5-59a9-9565-62649ecb4113
2026-03-28 18:44:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 764982c2-d5a5-59a9-9565-62649ecb4113, skipping ID generation
2026-03-28 18:44:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 764982c2-d5a5-59a9-9565-62649ecb4113 with scrape type 1
2026-03-28 18:44:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 764982c2-d5a5-59a9-9565-62649ecb4113 sending to next pipeline
2026-03-28 18:44:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 764982c2-d5a5-59a9-9565-62649ecb4113, identifier: BP86172
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_da02769a1732998b369a9cb8e2ed21c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_da02769a1732998b369a9cb8e2ed21c9.jpg not downloaded yet
2026-03-28 18:44:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 764982c2-d5a5-59a9-9565-62649ecb4113 with identifier: BP86172
2026-03-28 18:44:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 764982c2-d5a5-59a9-9565-62649ecb4113 with identifier: BP86172
2026-03-28 18:44:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 764982c2-d5a5-59a9-9565-62649ecb4113 with identifier: BP86172 to the API
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_c91274fb5d5a083176e68ffa01dddbff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:44:16Z',
 'fuel_type': 'diesel',
 'id': '764982c2-d5a5-59a9-9565-62649ecb4113',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP86172',
 'listing': 'auction',
 'location': 'DE, Braunschweig',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 58263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3035024,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_c91274fb5d5a083176e68ffa01dddbff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2393560,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_e2b0502323bc2f729413632ecdbe8456.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2261936,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_ac39f65753315c89e56c8ed207dd6fb5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2258053,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_c27f3a5a2cbf4a8a54c95a9edb9b3ba9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2296325,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_377aa468484cde74eb5bb5695a6f5d21.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_18ede77cbbc2a9bb4f34a26420829a89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2231953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_eabe8f5cc364b27dc0e0ba33a09dc107.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_c7af742ab6891f9c1455c5ee6c7e419b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2992146,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_0f2c4b75a292dcc95936fffce5a601ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764982c2-d5a5-59a9-9565-62649ecb4113/764982c2-d5a5-59a9-9565-62649ecb4113_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2372046,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/ec/cdec551f3b56dddb1ce7bf620ffd3736/pa/BP86172_884acff4f3036f7ce05ece59c5ff121d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2018}
2026-03-28 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP86172%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [auto1.de] INFO: Saving data for BP86172: {'created_time': 1774723443.001817, 'last_price_update_time': 1774723443.001828, 'auction_closing_time': 1774885456.0}
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP86172') HTTP/1.1" 204 0
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: JL46304
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: LL96634
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: HV52023
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: YT21216
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: YW86530
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW86530%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [auto1.de] INFO: Scrape type for YW86530: 1
2026-03-28 18:44:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456198590>
2026-03-28 18:44:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_fca0abb01fa68a0d08e1b2206871158e.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_fca0abb01fa68a0d08e1b2206871158e.jpg saved to cache
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_b0f7fd71596f250f0915273bd837b333.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_b0f7fd71596f250f0915273bd837b333.jpg not downloaded yet
2026-03-28 18:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ41571> (referer: https://www.auto1.com/v1/car-details-view/KJ41571/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: EH91304
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: WE57631
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE57631%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [auto1.de] INFO: Scrape type for WE57631: 2
2026-03-28 18:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40fa1fac-df1f-52c8-8442-6b4fc8af3c52 with identifier: WE57631
2026-03-28 18:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40fa1fac-df1f-52c8-8442-6b4fc8af3c52 with scrape type 2
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40fa1fac-df1f-52c8-8442-6b4fc8af3c52 with scrape type 2
2026-03-28 18:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40fa1fac-df1f-52c8-8442-6b4fc8af3c52, identifier: WE57631
2026-03-28 18:44:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR46217> (referer: https://www.auto1.com/v1/car-details-view/VR46217/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456199fd0>
2026-03-28 18:44:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_5fc069f0ab88f387605d094814a144c6.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_5fc069f0ab88f387605d094814a144c6.jpg saved to cache
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_4a5e056bef3cfb22e62f3b8aea0f0332.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_4a5e056bef3cfb22e62f3b8aea0f0332.jpg not downloaded yet
2026-03-28 18:44:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40fa1fac-df1f-52c8-8442-6b4fc8af3c52 with identifier: WE57631
2026-03-28 18:44:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40fa1fac-df1f-52c8-8442-6b4fc8af3c52 with identifier: WE57631
2026-03-28 18:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40fa1fac-df1f-52c8-8442-6b4fc8af3c52 with identifier: WE57631 to the API
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:44Z',
 'fuel_type': 'diesel',
 'id': '40fa1fac-df1f-52c8-8442-6b4fc8af3c52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE57631',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 169152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI IQ.DRIVE',
 'transmission': 'automatic',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE57631%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [auto1.de] INFO: Saving data for WE57631: {'auction_closing_time': 1774884284.0, 'created_time': 1773427478.670085, 'last_price_update_time': 1774723443.762527}
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE57631') HTTP/1.1" 204 0
2026-03-28 18:44:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN03303/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: RR27166
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: SJ72548
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: XR20146
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR20146%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [auto1.de] INFO: Scrape type for XR20146: 1
2026-03-28 18:44:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_bd8055472af6b4aa617c28875829996b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_03e2716be5e9b56e961e1509e793d417.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_03e2716be5e9b56e961e1509e793d417.jpg not downloaded yet
2026-03-28 18:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU03488> (referer: https://www.auto1.com/v1/car-details-view/XU03488/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ11888/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB43778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7722bd6c-f2c2-5e02-84b6-aa464062026e with identifier: KJ41571
2026-03-28 18:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7722bd6c-f2c2-5e02-84b6-aa464062026e with scrape type 1
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7722bd6c-f2c2-5e02-84b6-aa464062026e
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_f197f6a0573b369f452b65cf87764cd4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_f197f6a0573b369f452b65cf87764cd4.jpg not downloaded yet
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: RL75454
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL75454%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [auto1.de] INFO: Scrape type for RL75454: 1
2026-03-28 18:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR37501> (referer: https://www.auto1.com/v1/car-details-view/TR37501/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69de0b48-50d4-5864-928a-348cc3786330 with identifier: VR46217
2026-03-28 18:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69de0b48-50d4-5864-928a-348cc3786330 with scrape type 1
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69de0b48-50d4-5864-928a-348cc3786330
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_6858b4b936f3c0f47f85cd0e07248914.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_6858b4b936f3c0f47f85cd0e07248914.jpg not downloaded yet
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_868891579a84ba64f8a1c3b0ff8b4a1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_868891579a84ba64f8a1c3b0ff8b4a1a.jpg not downloaded yet
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_5bcaa6fd8cb963503793cae25fb2f023.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_5bcaa6fd8cb963503793cae25fb2f023.jpg not downloaded yet
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: RM21545
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: SY42721
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: UC78524
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: WG52031
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: RY75144
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: BX11542
2026-03-28 18:44:03 [auto1.de] INFO: Found listing with ID: FL40114
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL40114%27 HTTP/1.1" 200 None
2026-03-28 18:44:03 [auto1.de] INFO: Scrape type for FL40114: 2
2026-03-28 18:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4897e43-6225-5ee6-b82e-5ee2f1792de2 with identifier: FL40114
2026-03-28 18:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4897e43-6225-5ee6-b82e-5ee2f1792de2 with scrape type 2
2026-03-28 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4897e43-6225-5ee6-b82e-5ee2f1792de2 with scrape type 2
2026-03-28 18:44:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4897e43-6225-5ee6-b82e-5ee2f1792de2, identifier: FL40114
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_051d797efa2f2551f703abccfce54c46.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_051d797efa2f2551f703abccfce54c46.jpg not downloaded yet
2026-03-28 18:44:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4897e43-6225-5ee6-b82e-5ee2f1792de2 with identifier: FL40114
2026-03-28 18:44:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4897e43-6225-5ee6-b82e-5ee2f1792de2 with identifier: FL40114
2026-03-28 18:44:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4897e43-6225-5ee6-b82e-5ee2f1792de2 with identifier: FL40114 to the API
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:29:10Z',
 'fuel_type': 'petrol',
 'id': 'b4897e43-6225-5ee6-b82e-5ee2f1792de2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL40114',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 93318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-17',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL40114%27 HTTP/1.1" 200 None
2026-03-28 18:44:04 [auto1.de] INFO: Saving data for FL40114: {'auction_closing_time': 1774884550.0, 'created_time': 1774033181.863242, 'last_price_update_time': 1774723444.432979}
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL40114') HTTP/1.1" 204 0
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_1d4da84c6865829fecf07a8c0038c1ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_1d4da84c6865829fecf07a8c0038c1ee.jpg not downloaded yet
2026-03-28 18:44:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_b0f7fd71596f250f0915273bd837b333.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:04 [auto1.de] INFO: Found listing with ID: DN27813
2026-03-28 18:44:04 [auto1.de] INFO: Found listing with ID: HZ35402
2026-03-28 18:44:04 [auto1.de] INFO: Found listing with ID: WA51516
2026-03-28 18:44:04 [auto1.de] INFO: Found listing with ID: VY12832
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY12832%27 HTTP/1.1" 200 None
2026-03-28 18:44:04 [auto1.de] INFO: Scrape type for VY12832: 2
2026-03-28 18:44:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5375dfc-adc4-5284-b04f-bf1ee140cfb8 with identifier: VY12832
2026-03-28 18:44:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5375dfc-adc4-5284-b04f-bf1ee140cfb8 with scrape type 2
2026-03-28 18:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5375dfc-adc4-5284-b04f-bf1ee140cfb8 with scrape type 2
2026-03-28 18:44:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5375dfc-adc4-5284-b04f-bf1ee140cfb8, identifier: VY12832
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_b65a431612ebcc06cd0475abd2b73ede.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_b65a431612ebcc06cd0475abd2b73ede.jpg not downloaded yet
2026-03-28 18:44:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564b8750>
2026-03-28 18:44:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_bd8055472af6b4aa617c28875829996b.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_bd8055472af6b4aa617c28875829996b.jpg saved to cache
2026-03-28 18:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 915406a7-db45-5663-97f1-3654017a8211
2026-03-28 18:44:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_4a5e056bef3cfb22e62f3b8aea0f0332.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5375dfc-adc4-5284-b04f-bf1ee140cfb8 with identifier: VY12832
2026-03-28 18:44:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5375dfc-adc4-5284-b04f-bf1ee140cfb8 with identifier: VY12832
2026-03-28 18:44:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5375dfc-adc4-5284-b04f-bf1ee140cfb8 with identifier: VY12832 to the API
2026-03-28 18:44:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:53:43Z',
 'fuel_type': 'diesel',
 'id': 'f5375dfc-adc4-5284-b04f-bf1ee140cfb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY12832',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 157922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-21',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 d Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2014}
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY12832%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [auto1.de] INFO: Saving data for VY12832: {'auction_closing_time': 1774886023.0, 'created_time': 1773429707.428395, 'last_price_update_time': 1774723445.205667}
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY12832') HTTP/1.1" 204 0
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_291f043ba5fb0480a8d939acb7844f93.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_291f043ba5fb0480a8d939acb7844f93.jpg not downloaded yet
2026-03-28 18:44:05 [auto1.de] INFO: Found listing with ID: GA49917
2026-03-28 18:44:05 [auto1.de] INFO: Found listing with ID: CC10989
2026-03-28 18:44:05 [auto1.de] INFO: Found listing with ID: FW05091
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW05091%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [auto1.de] INFO: Scrape type for FW05091: 1
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_4ecc242bff79f621791748146a3e1bb4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_4ecc242bff79f621791748146a3e1bb4.jpg not downloaded yet
2026-03-28 18:44:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0027cc0c-a14c-52c7-b420-9eaff336f926 with identifier: XU03488
2026-03-28 18:44:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0027cc0c-a14c-52c7-b420-9eaff336f926 with scrape type 1
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0027cc0c-a14c-52c7-b420-9eaff336f926
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_7c97d40c9ed238b2f77d23c04c9bf07c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_7c97d40c9ed238b2f77d23c04c9bf07c.jpg not downloaded yet
2026-03-28 18:44:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc with identifier: TR37501
2026-03-28 18:44:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc with scrape type 1
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F87%252F6287052888b29eb62d23678a1f30cea1%252Fpa%252FTR37501_c60a7d9b6725d6aa16768c5c6e863e19.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_c60a7d9b6725d6aa16768c5c6e863e19.jpg already downloaded
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F87%252F6287052888b29eb62d23678a1f30cea1%252Fpa%252FTR37501_6d13a601b5d8885a7ed6123d271c5962.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_6d13a601b5d8885a7ed6123d271c5962.jpg already downloaded
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F87%252F6287052888b29eb62d23678a1f30cea1%252Fpa%252FTR37501_7b6175e4fc86b385681789b020e1ddd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_7b6175e4fc86b385681789b020e1ddd3.jpg already downloaded
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F87%252F6287052888b29eb62d23678a1f30cea1%252Fpa%252FTR37501_c927f591d4a620b2c4336ae36603c8cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_c927f591d4a620b2c4336ae36603c8cd.jpg already downloaded
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F87%252F6287052888b29eb62d23678a1f30cea1%252Fpa%252FTR37501_debad7a457b7ac154c0f5b562afd7103.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_debad7a457b7ac154c0f5b562afd7103.jpg already downloaded
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F87%252F6287052888b29eb62d23678a1f30cea1%252Fpa%252FTR37501_6d878f6ed47dae354f969751b9af84ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_6d878f6ed47dae354f969751b9af84ff.jpg already downloaded
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F87%252F6287052888b29eb62d23678a1f30cea1%252Fpa%252FTR37501_26ba0a24b690764d07b7bbaa1983391e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_26ba0a24b690764d07b7bbaa1983391e.jpg already downloaded
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F87%252F6287052888b29eb62d23678a1f30cea1%252Fpa%252FTR37501_95a2b833f47e96cc50183be4cc7e71b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_95a2b833f47e96cc50183be4cc7e71b7.jpg already downloaded
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F87%252F6287052888b29eb62d23678a1f30cea1%252Fpa%252FTR37501_37fb39e62fc40cc543da6225848aaf47.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_37fb39e62fc40cc543da6225848aaf47.jpg already downloaded
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F87%252F6287052888b29eb62d23678a1f30cea1%252Fpa%252FTR37501_f01fd3388ed8e597452ac7dfd1d6f849.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_f01fd3388ed8e597452ac7dfd1d6f849.jpg already downloaded
2026-03-28 18:44:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc, identifier: TR37501
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_ff3eb935472eb13e1116755685ec684e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_ff3eb935472eb13e1116755685ec684e.jpg not downloaded yet
2026-03-28 18:44:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc with identifier: TR37501
2026-03-28 18:44:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc with identifier: TR37501
2026-03-28 18:44:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc with identifier: TR37501 to the API
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TR37501>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:21:10Z',
 'fuel_type': 'petrol',
 'id': 'd9e1303d-5d7b-50ae-9ced-57a83b1ddbfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR37501',
 'listing': 'auction',
 'location': 'DE, Aurich',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 30023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_c60a7d9b6725d6aa16768c5c6e863e19.jpg',
                'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_6d13a601b5d8885a7ed6123d271c5962.jpg',
                'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_7b6175e4fc86b385681789b020e1ddd3.jpg',
                'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_c927f591d4a620b2c4336ae36603c8cd.jpg',
                'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_debad7a457b7ac154c0f5b562afd7103.jpg',
                'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_6d878f6ed47dae354f969751b9af84ff.jpg',
                'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_26ba0a24b690764d07b7bbaa1983391e.jpg',
                'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_95a2b833f47e96cc50183be4cc7e71b7.jpg',
                'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_37fb39e62fc40cc543da6225848aaf47.jpg',
                'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_f01fd3388ed8e597452ac7dfd1d6f849.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc/d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_c60a7d9b6725d6aa16768c5c6e863e19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc/d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2622610,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_6d13a601b5d8885a7ed6123d271c5962.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc/d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_7b6175e4fc86b385681789b020e1ddd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc/d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2534060,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_c927f591d4a620b2c4336ae36603c8cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc/d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_debad7a457b7ac154c0f5b562afd7103.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc/d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2530147,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_6d878f6ed47dae354f969751b9af84ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc/d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2393113,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_26ba0a24b690764d07b7bbaa1983391e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc/d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2681838,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_95a2b833f47e96cc50183be4cc7e71b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc/d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_37fb39e62fc40cc543da6225848aaf47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc/d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/87/6287052888b29eb62d23678a1f30cea1/pa/TR37501_f01fd3388ed8e597452ac7dfd1d6f849.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Trend 2WD',
 'transmission': 'manual',
 'trim': 'Trend 2WD',
 'year': 2019}
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR37501%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [auto1.de] INFO: Saving data for TR37501: {'created_time': 1774723445.909766, 'last_price_update_time': 1774723445.909778, 'auction_closing_time': 1774884070.0}
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR37501') HTTP/1.1" 204 0
2026-03-28 18:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_f03ec2beabb252a6ee3ee712b6b2c30b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:05 [auto1.de] INFO: Found listing with ID: AZ02782
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ02782%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [auto1.de] INFO: Scrape type for AZ02782: 1
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_99594a410fafc434e0dbd8e51851967b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_99594a410fafc434e0dbd8e51851967b.jpg not downloaded yet
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_b86da8b3b31f95e37bc5fe08e55a3d2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_b86da8b3b31f95e37bc5fe08e55a3d2d.jpg not downloaded yet
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_318597899999fa2dde7de2a24269749a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_318597899999fa2dde7de2a24269749a.jpg not downloaded yet
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a1b10>
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_b0f7fd71596f250f0915273bd837b333.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_b0f7fd71596f250f0915273bd837b333.jpg saved to cache
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 915406a7-db45-5663-97f1-3654017a8211
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a6810>
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_4a5e056bef3cfb22e62f3b8aea0f0332.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_4a5e056bef3cfb22e62f3b8aea0f0332.jpg saved to cache
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 915406a7-db45-5663-97f1-3654017a8211
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_6858b4b936f3c0f47f85cd0e07248914.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [auto1.de] INFO: Found listing with ID: MP53713
2026-03-28 18:44:06 [auto1.de] INFO: Found listing with ID: YA63127
2026-03-28 18:44:06 [auto1.de] INFO: Found listing with ID: YD24318
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD24318%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [auto1.de] INFO: Scrape type for YD24318: 1
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_889309174d4833db9560522461b92454.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_889309174d4833db9560522461b92454.jpg not downloaded yet
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_1e30ddd8baceccca7a1e9cb0e6c70e28.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_1e30ddd8baceccca7a1e9cb0e6c70e28.jpg not downloaded yet
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN89436/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM63573/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_ef76ca49e98402b7ded5d2aa3f834b6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_ef76ca49e98402b7ded5d2aa3f834b6a.jpg not downloaded yet
2026-03-28 18:44:06 [auto1.de] INFO: Found listing with ID: FZ76900
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ76900%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [auto1.de] INFO: Scrape type for FZ76900: 1
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_ca78dcaef92a1bff08c940e4ffb416bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_ca78dcaef92a1bff08c940e4ffb416bd.jpg not downloaded yet
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_f50d66afab43d7ce58168d82c78cb8d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_f50d66afab43d7ce58168d82c78cb8d6.jpg not downloaded yet
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a3d90>
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_f03ec2beabb252a6ee3ee712b6b2c30b.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_f03ec2beabb252a6ee3ee712b6b2c30b.jpg saved to cache
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 915406a7-db45-5663-97f1-3654017a8211
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_051d797efa2f2551f703abccfce54c46.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_3b4bc091d7ce3835076fa5979efbdd11.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_3b4bc091d7ce3835076fa5979efbdd11.jpg not downloaded yet
2026-03-28 18:44:06 [auto1.de] INFO: Found listing with ID: PS79135
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS79135%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [auto1.de] INFO: Scrape type for PS79135: 1
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_21225ef1f5c18b030d098af128f1902b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_21225ef1f5c18b030d098af128f1902b.jpg not downloaded yet
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_325e54bec83d1450b09e8a891b6baabc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_325e54bec83d1450b09e8a891b6baabc.jpg not downloaded yet
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_e9e5b0ee7bb3eb23650c524b6ae91a68.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_e9e5b0ee7bb3eb23650c524b6ae91a68.jpg not downloaded yet
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_ff3eb935472eb13e1116755685ec684e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [auto1.de] INFO: Found listing with ID: WK48382
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_e2d38016e397cfbc550745fd13ce2444.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_e2d38016e397cfbc550745fd13ce2444.jpg not downloaded yet
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_64891d8165a07609f10ec37d56aed844.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_64891d8165a07609f10ec37d56aed844.jpg not downloaded yet
2026-03-28 18:44:06 [scrapy.extensions.logstats] INFO: Crawled 287 pages (at 86 pages/min), scraped 587 items (at 66 items/min)
2026-03-28 18:44:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_83a153d9de014ae1876b8f2fdc451132.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_83a153d9de014ae1876b8f2fdc451132.jpg not downloaded yet
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW86530/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245476e5d0>
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_6858b4b936f3c0f47f85cd0e07248914.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_6858b4b936f3c0f47f85cd0e07248914.jpg saved to cache
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69de0b48-50d4-5864-928a-348cc3786330
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_2581b15740e37dc9c22f716120fe4e53.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_2581b15740e37dc9c22f716120fe4e53.jpg not downloaded yet
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_2bc9e6a027720a44af64ee789992cd14.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_2bc9e6a027720a44af64ee789992cd14.jpg not downloaded yet
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24592d4390>
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_051d797efa2f2551f703abccfce54c46.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_051d797efa2f2551f703abccfce54c46.jpg saved to cache
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69de0b48-50d4-5864-928a-348cc3786330
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_49269c8a20a289397a3c68e49abbf1dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_49269c8a20a289397a3c68e49abbf1dd.jpg not downloaded yet
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_b86da8b3b31f95e37bc5fe08e55a3d2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_6d7533989d293f294df2f9f29d06d538.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_6d7533989d293f294df2f9f29d06d538.jpg not downloaded yet
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245628ca90>
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_ff3eb935472eb13e1116755685ec684e.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_ff3eb935472eb13e1116755685ec684e.jpg saved to cache
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7722bd6c-f2c2-5e02-84b6-aa464062026e
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_018051199c37b0f920f46fb3c1fe149d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_018051199c37b0f920f46fb3c1fe149d.jpg not downloaded yet
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_cbf2350560910074cbe07c08bbeb25ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_fc083484088607ff0e8cabe16d102aec.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_99594a410fafc434e0dbd8e51851967b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_62a390da23dbe3139de652c8dfef6672.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_cb5b353a5f97cddef3ebf6903b922b83.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_be17d55b39f50ccca72224cc9c5b401c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_da02769a1732998b369a9cb8e2ed21c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_318597899999fa2dde7de2a24269749a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563211d0>
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_b86da8b3b31f95e37bc5fe08e55a3d2d.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_b86da8b3b31f95e37bc5fe08e55a3d2d.jpg saved to cache
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0027cc0c-a14c-52c7-b420-9eaff336f926
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_f50d66afab43d7ce58168d82c78cb8d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR20146/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK68896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245628df10>
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_cbf2350560910074cbe07c08bbeb25ce.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_cbf2350560910074cbe07c08bbeb25ce.jpg saved to cache
2026-03-28 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81
2026-03-28 18:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_64891d8165a07609f10ec37d56aed844.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245620cb50>
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_fc083484088607ff0e8cabe16d102aec.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_fc083484088607ff0e8cabe16d102aec.jpg saved to cache
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456243150>
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_99594a410fafc434e0dbd8e51851967b.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_99594a410fafc434e0dbd8e51851967b.jpg saved to cache
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69de0b48-50d4-5864-928a-348cc3786330
2026-03-28 18:44:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24586fd8d0>
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_62a390da23dbe3139de652c8dfef6672.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_62a390da23dbe3139de652c8dfef6672.jpg saved to cache
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81
2026-03-28 18:44:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245649b850>
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F3b%252F163b731412899a505603cbb396b3de20%252Fpa%252FTW63260_cb5b353a5f97cddef3ebf6903b922b83.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_cb5b353a5f97cddef3ebf6903b922b83.jpg saved to cache
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81
2026-03-28 18:44:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81, skipping ID generation
2026-03-28 18:44:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81 with scrape type 1
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81 sending to next pipeline
2026-03-28 18:44:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81, identifier: TW63260
2026-03-28 18:44:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562f4350>
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_be17d55b39f50ccca72224cc9c5b401c.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_be17d55b39f50ccca72224cc9c5b401c.jpg saved to cache
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 915406a7-db45-5663-97f1-3654017a8211
2026-03-28 18:44:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245611b710>
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_da02769a1732998b369a9cb8e2ed21c9.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_da02769a1732998b369a9cb8e2ed21c9.jpg saved to cache
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 915406a7-db45-5663-97f1-3654017a8211
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a05d0>
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_318597899999fa2dde7de2a24269749a.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_318597899999fa2dde7de2a24269749a.jpg saved to cache
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7722bd6c-f2c2-5e02-84b6-aa464062026e
2026-03-28 18:44:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456322c10>
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_f50d66afab43d7ce58168d82c78cb8d6.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_f50d66afab43d7ce58168d82c78cb8d6.jpg saved to cache
2026-03-28 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0027cc0c-a14c-52c7-b420-9eaff336f926
2026-03-28 18:44:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81 with identifier: TW63260
2026-03-28 18:44:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81 with identifier: TW63260
2026-03-28 18:44:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81 with identifier: TW63260 to the API
2026-03-28 18:44:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_cb5b353a5f97cddef3ebf6903b922b83.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:43:06Z',
 'fuel_type': 'diesel',
 'id': '7c4fd3b9-2428-5c30-9fb1-8bea8045ab81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW63260',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 181108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2801587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_fc083484088607ff0e8cabe16d102aec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2901942,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_62a390da23dbe3139de652c8dfef6672.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_fca0abb01fa68a0d08e1b2206871158e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2933911,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_cb5b353a5f97cddef3ebf6903b922b83.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_5fc069f0ab88f387605d094814a144c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2766340,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_cbf2350560910074cbe07c08bbeb25ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2867528,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_77b4e0c5e45d42f868ef77535293319d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_66be70866ce7eafc10d1dc7a36a85de6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2796061,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_1bff9f976267017de8cf17fd81c9d79c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4fd3b9-2428-5c30-9fb1-8bea8045ab81/7c4fd3b9-2428-5c30-9fb1-8bea8045ab81_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/3b/163b731412899a505603cbb396b3de20/pa/TW63260_493678ba7d1a9d132fa6d9eba8d0eb98.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2013}
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW63260%27 HTTP/1.1" 200 None
2026-03-28 18:44:08 [auto1.de] INFO: Saving data for TW63260: {'created_time': 1774723448.243374, 'last_price_update_time': 1774723448.243386, 'auction_closing_time': 1774885386.0}
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW63260') HTTP/1.1" 204 0
2026-03-28 18:44:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN03303> (referer: https://www.auto1.com/v1/car-details-view/NN03303/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245828b1d0>
2026-03-28 18:44:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_64891d8165a07609f10ec37d56aed844.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_64891d8165a07609f10ec37d56aed844.jpg saved to cache
2026-03-28 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0027cc0c-a14c-52c7-b420-9eaff336f926
2026-03-28 18:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_e9e5b0ee7bb3eb23650c524b6ae91a68.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_018051199c37b0f920f46fb3c1fe149d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_e2d38016e397cfbc550745fd13ce2444.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_49269c8a20a289397a3c68e49abbf1dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_2581b15740e37dc9c22f716120fe4e53.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306 with identifier: NN03303
2026-03-28 18:44:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306 with scrape type 1
2026-03-28 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F65%252F1365ce99ffaad2e63f53296bfce3b319%252Fpa%252FNN03303_81cfe2247a9f804e523156fa5f7462e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_81cfe2247a9f804e523156fa5f7462e8.jpg already downloaded
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F65%252F1365ce99ffaad2e63f53296bfce3b319%252Fpa%252FNN03303_fd3add569ca2655da895aeadce94d136.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_fd3add569ca2655da895aeadce94d136.jpg already downloaded
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F65%252F1365ce99ffaad2e63f53296bfce3b319%252Fpa%252FNN03303_a8abb1904bdca193b960d12b172001fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_a8abb1904bdca193b960d12b172001fd.jpg already downloaded
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F65%252F1365ce99ffaad2e63f53296bfce3b319%252Fpa%252FNN03303_fa6cc36b0b52d13eea3d1dd196335bbe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_fa6cc36b0b52d13eea3d1dd196335bbe.jpg already downloaded
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F65%252F1365ce99ffaad2e63f53296bfce3b319%252Fpa%252FNN03303_06a693a82e5d60978b053bc65da4d7f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_06a693a82e5d60978b053bc65da4d7f5.jpg already downloaded
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F65%252F1365ce99ffaad2e63f53296bfce3b319%252Fpa%252FNN03303_39507fc5a6bc177ad2b697dcbba07976.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_39507fc5a6bc177ad2b697dcbba07976.jpg already downloaded
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F65%252F1365ce99ffaad2e63f53296bfce3b319%252Fpa%252FNN03303_3706890cfabfa09d28fd3e48a061fd08.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_3706890cfabfa09d28fd3e48a061fd08.jpg already downloaded
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F65%252F1365ce99ffaad2e63f53296bfce3b319%252Fpa%252FNN03303_a6ded7ecf78b1172b8b53e185eca0c7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_a6ded7ecf78b1172b8b53e185eca0c7f.jpg already downloaded
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F65%252F1365ce99ffaad2e63f53296bfce3b319%252Fpa%252FNN03303_81a07a845ac856a75716dde464a8e126.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_81a07a845ac856a75716dde464a8e126.jpg already downloaded
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F65%252F1365ce99ffaad2e63f53296bfce3b319%252Fpa%252FNN03303_1bac790c60093db6d020dbf516d3c465.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_1bac790c60093db6d020dbf516d3c465.jpg already downloaded
2026-03-28 18:44:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306, identifier: NN03303
2026-03-28 18:44:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306 with identifier: NN03303
2026-03-28 18:44:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306 with identifier: NN03303
2026-03-28 18:44:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306 with identifier: NN03303 to the API
2026-03-28 18:44:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NN03303>
{'auction_title': '',
 'c_o_2_emission_value': 226,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 3',
 'engine': '2.2L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:20:15Z',
 'fuel_type': 'petrol',
 'id': 'ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN03303',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'BMW',
 'model': '3er',
 'odometer': 156631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_81cfe2247a9f804e523156fa5f7462e8.jpg',
                'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_fd3add569ca2655da895aeadce94d136.jpg',
                'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_a8abb1904bdca193b960d12b172001fd.jpg',
                'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_fa6cc36b0b52d13eea3d1dd196335bbe.jpg',
                'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_06a693a82e5d60978b053bc65da4d7f5.jpg',
                'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_39507fc5a6bc177ad2b697dcbba07976.jpg',
                'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_3706890cfabfa09d28fd3e48a061fd08.jpg',
                'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_a6ded7ecf78b1172b8b53e185eca0c7f.jpg',
                'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_81a07a845ac856a75716dde464a8e126.jpg',
                'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_1bac790c60093db6d020dbf516d3c465.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306/ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_81cfe2247a9f804e523156fa5f7462e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306/ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_fd3add569ca2655da895aeadce94d136.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306/ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_a8abb1904bdca193b960d12b172001fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306/ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_fa6cc36b0b52d13eea3d1dd196335bbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306/ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_06a693a82e5d60978b053bc65da4d7f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306/ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_39507fc5a6bc177ad2b697dcbba07976.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306/ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_3706890cfabfa09d28fd3e48a061fd08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306/ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_a6ded7ecf78b1172b8b53e185eca0c7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306/ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_81a07a845ac856a75716dde464a8e126.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306/ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/65/1365ce99ffaad2e63f53296bfce3b319/pa/NN03303_1bac790c60093db6d020dbf516d3c465.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320Ci',
 'transmission': 'automatic',
 'trim': '',
 'year': 2000}
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN03303%27 HTTP/1.1" 200 None
2026-03-28 18:44:09 [auto1.de] INFO: Saving data for NN03303: {'created_time': 1774723449.12, 'last_price_update_time': 1774723449.120011, 'auction_closing_time': 1774884015.0}
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN03303') HTTP/1.1" 204 0
2026-03-28 18:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_6d7533989d293f294df2f9f29d06d538.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560aaf10>
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_e9e5b0ee7bb3eb23650c524b6ae91a68.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_e9e5b0ee7bb3eb23650c524b6ae91a68.jpg saved to cache
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7722bd6c-f2c2-5e02-84b6-aa464062026e
2026-03-28 18:44:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245648c190>
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_018051199c37b0f920f46fb3c1fe149d.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_018051199c37b0f920f46fb3c1fe149d.jpg saved to cache
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0027cc0c-a14c-52c7-b420-9eaff336f926
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456149f90>
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_e2d38016e397cfbc550745fd13ce2444.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_e2d38016e397cfbc550745fd13ce2444.jpg saved to cache
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69de0b48-50d4-5864-928a-348cc3786330
2026-03-28 18:44:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561e6e90>
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_49269c8a20a289397a3c68e49abbf1dd.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_49269c8a20a289397a3c68e49abbf1dd.jpg saved to cache
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0027cc0c-a14c-52c7-b420-9eaff336f926
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561e1a50>
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_2581b15740e37dc9c22f716120fe4e53.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_2581b15740e37dc9c22f716120fe4e53.jpg saved to cache
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69de0b48-50d4-5864-928a-348cc3786330
2026-03-28 18:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_325e54bec83d1450b09e8a891b6baabc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_2bc9e6a027720a44af64ee789992cd14.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563ea490>
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_6d7533989d293f294df2f9f29d06d538.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_6d7533989d293f294df2f9f29d06d538.jpg saved to cache
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0027cc0c-a14c-52c7-b420-9eaff336f926
2026-03-28 18:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_83a153d9de014ae1876b8f2fdc451132.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_21225ef1f5c18b030d098af128f1902b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a6490>
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_325e54bec83d1450b09e8a891b6baabc.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_325e54bec83d1450b09e8a891b6baabc.jpg saved to cache
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0027cc0c-a14c-52c7-b420-9eaff336f926
2026-03-28 18:44:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456119050>
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_2bc9e6a027720a44af64ee789992cd14.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_2bc9e6a027720a44af64ee789992cd14.jpg saved to cache
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0027cc0c-a14c-52c7-b420-9eaff336f926
2026-03-28 18:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_ef76ca49e98402b7ded5d2aa3f834b6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_3b4bc091d7ce3835076fa5979efbdd11.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245603ed10>
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_83a153d9de014ae1876b8f2fdc451132.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_83a153d9de014ae1876b8f2fdc451132.jpg saved to cache
2026-03-28 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7722bd6c-f2c2-5e02-84b6-aa464062026e
2026-03-28 18:44:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a4050>
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_21225ef1f5c18b030d098af128f1902b.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_21225ef1f5c18b030d098af128f1902b.jpg saved to cache
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69de0b48-50d4-5864-928a-348cc3786330
2026-03-28 18:44:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_1e30ddd8baceccca7a1e9cb0e6c70e28.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b74d0>
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_ef76ca49e98402b7ded5d2aa3f834b6a.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_ef76ca49e98402b7ded5d2aa3f834b6a.jpg saved to cache
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7722bd6c-f2c2-5e02-84b6-aa464062026e
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245611b490>
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_3b4bc091d7ce3835076fa5979efbdd11.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_3b4bc091d7ce3835076fa5979efbdd11.jpg saved to cache
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7722bd6c-f2c2-5e02-84b6-aa464062026e
2026-03-28 18:44:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_889309174d4833db9560522461b92454.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_ca78dcaef92a1bff08c940e4ffb416bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456158090>
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_1e30ddd8baceccca7a1e9cb0e6c70e28.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_1e30ddd8baceccca7a1e9cb0e6c70e28.jpg saved to cache
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0027cc0c-a14c-52c7-b420-9eaff336f926
2026-03-28 18:44:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456401950>
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_889309174d4833db9560522461b92454.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_889309174d4833db9560522461b92454.jpg saved to cache
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69de0b48-50d4-5864-928a-348cc3786330
2026-03-28 18:44:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_7c97d40c9ed238b2f77d23c04c9bf07c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN89436> (referer: https://www.auto1.com/v1/car-details-view/YN89436/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW86530> (referer: https://www.auto1.com/v1/car-details-view/YW86530/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS79135/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK68896> (referer: https://www.auto1.com/v1/car-details-view/TK68896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456154650>
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_ca78dcaef92a1bff08c940e4ffb416bd.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_ca78dcaef92a1bff08c940e4ffb416bd.jpg saved to cache
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69de0b48-50d4-5864-928a-348cc3786330
2026-03-28 18:44:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM63573> (referer: https://www.auto1.com/v1/car-details-view/PM63573/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ76900/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456402550>
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F6c%252F286c74445e75de1c8c4c16ce95dd0a06%252Fpa%252FXU03488_7c97d40c9ed238b2f77d23c04c9bf07c.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_7c97d40c9ed238b2f77d23c04c9bf07c.jpg saved to cache
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0027cc0c-a14c-52c7-b420-9eaff336f926
2026-03-28 18:44:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0027cc0c-a14c-52c7-b420-9eaff336f926, skipping ID generation
2026-03-28 18:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0027cc0c-a14c-52c7-b420-9eaff336f926 with scrape type 1
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0027cc0c-a14c-52c7-b420-9eaff336f926 sending to next pipeline
2026-03-28 18:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0027cc0c-a14c-52c7-b420-9eaff336f926, identifier: XU03488
2026-03-28 18:44:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9327b681-153a-562d-8df0-ab745809eac3 with identifier: YN89436
2026-03-28 18:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9327b681-153a-562d-8df0-ab745809eac3 with scrape type 1
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9327b681-153a-562d-8df0-ab745809eac3
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F6d%252Fa16d26b86fd56321fdff4dd9e63e4500%252Fpa%252FYN89436_44362d7ece38cd7a5be0158d5ea615ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_44362d7ece38cd7a5be0158d5ea615ed.jpg not downloaded yet
2026-03-28 18:44:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c67b7d7-20b7-5df0-994d-362db3f12f42 with identifier: YW86530
2026-03-28 18:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c67b7d7-20b7-5df0-994d-362db3f12f42 with scrape type 1
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c67b7d7-20b7-5df0-994d-362db3f12f42
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_525f0a58de5a8ca33cf2d4b4c96df19e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_525f0a58de5a8ca33cf2d4b4c96df19e.jpg not downloaded yet
2026-03-28 18:44:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2 with identifier: TK68896
2026-03-28 18:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2 with scrape type 1
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_96b468794a6dc672748f5bbc6770546d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_96b468794a6dc672748f5bbc6770546d.jpg not downloaded yet
2026-03-28 18:44:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0027cc0c-a14c-52c7-b420-9eaff336f926 with identifier: XU03488
2026-03-28 18:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0027cc0c-a14c-52c7-b420-9eaff336f926 with identifier: XU03488
2026-03-28 18:44:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0027cc0c-a14c-52c7-b420-9eaff336f926 with identifier: XU03488 to the API
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_7c97d40c9ed238b2f77d23c04c9bf07c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:09:38Z',
 'fuel_type': 'petrol',
 'id': '0027cc0c-a14c-52c7-b420-9eaff336f926',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU03488',
 'listing': 'auction',
 'location': 'DE, Mülheim\xad-Kärlich',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 69321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342175,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_7c97d40c9ed238b2f77d23c04c9bf07c.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61497,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_b86da8b3b31f95e37bc5fe08e55a3d2d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342044,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_1e30ddd8baceccca7a1e9cb0e6c70e28.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310742,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_f50d66afab43d7ce58168d82c78cb8d6.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289266,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_325e54bec83d1450b09e8a891b6baabc.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59340,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_64891d8165a07609f10ec37d56aed844.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306621,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_2bc9e6a027720a44af64ee789992cd14.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2636372,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_49269c8a20a289397a3c68e49abbf1dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304864,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_6d7533989d293f294df2f9f29d06d538.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0027cc0c-a14c-52c7-b420-9eaff336f926/0027cc0c-a14c-52c7-b420-9eaff336f926_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2438504,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/6c/286c74445e75de1c8c4c16ce95dd0a06/pa/XU03488_018051199c37b0f920f46fb3c1fe149d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.2 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2016}
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU03488%27 HTTP/1.1" 200 None
2026-03-28 18:44:11 [auto1.de] INFO: Saving data for XU03488: {'created_time': 1774723451.377776, 'last_price_update_time': 1774723451.377787, 'auction_closing_time': 1774883378.0}
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU03488') HTTP/1.1" 204 0
2026-03-28 18:44:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_1d4da84c6865829fecf07a8c0038c1ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F6d%252Fa16d26b86fd56321fdff4dd9e63e4500%252Fpa%252FYN89436_187421e3997c12a7e650e0ced983f1fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_187421e3997c12a7e650e0ced983f1fd.jpg not downloaded yet
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_2bf2c1ff597b3c1e0ce423c26fad9194.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_2bf2c1ff597b3c1e0ce423c26fad9194.jpg not downloaded yet
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_80148ef47f263df230319d4d3bc7d84d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_80148ef47f263df230319d4d3bc7d84d.jpg not downloaded yet
2026-03-28 18:44:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_b65a431612ebcc06cd0475abd2b73ede.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR20146> (referer: https://www.auto1.com/v1/car-details-view/XR20146/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F6d%252Fa16d26b86fd56321fdff4dd9e63e4500%252Fpa%252FYN89436_0317c8c8a09568b41d9ccb7b92729a21.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_0317c8c8a09568b41d9ccb7b92729a21.jpg not downloaded yet
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_31322484495c18f8a9c5409b8d69d854.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_31322484495c18f8a9c5409b8d69d854.jpg not downloaded yet
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_1c84afb21d54e2bb8f9e4bef7437b6c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_1c84afb21d54e2bb8f9e4bef7437b6c5.jpg not downloaded yet
2026-03-28 18:44:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b578d8e-fc2f-5134-bd13-7f1b9616de33 with identifier: PM63573
2026-03-28 18:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b578d8e-fc2f-5134-bd13-7f1b9616de33 with scrape type 1
2026-03-28 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3b578d8e-fc2f-5134-bd13-7f1b9616de33
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d01dd1fde2aa0c93a8b5a4b8f2e45%252Fpa%252FPM63573_160c877d31640f9be2ee3e736bf381db.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_160c877d31640f9be2ee3e736bf381db.jpg already downloaded
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d01dd1fde2aa0c93a8b5a4b8f2e45%252Fpa%252FPM63573_abc986cda50362fc5b389f774dd16f68.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_abc986cda50362fc5b389f774dd16f68.jpg already downloaded
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d01dd1fde2aa0c93a8b5a4b8f2e45%252Fpa%252FPM63573_c125f519e5125c8e6c249d1d535e75de.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_c125f519e5125c8e6c249d1d535e75de.jpg already downloaded
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d01dd1fde2aa0c93a8b5a4b8f2e45%252Fpa%252FPM63573_6506eaa6a65b4090b3861852f3e95870.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_6506eaa6a65b4090b3861852f3e95870.jpg already downloaded
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F8d%252F5b8d01dd1fde2aa0c93a8b5a4b8f2e45%252Fpa%252FPM63573_d2e56b07dab6b07535aef00580fe0497.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_d2e56b07dab6b07535aef00580fe0497.jpg already downloaded
2026-03-28 18:44:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b578d8e-fc2f-5134-bd13-7f1b9616de33, identifier: PM63573
2026-03-28 18:44:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b578d8e-fc2f-5134-bd13-7f1b9616de33 with identifier: PM63573
2026-03-28 18:44:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b578d8e-fc2f-5134-bd13-7f1b9616de33 with identifier: PM63573
2026-03-28 18:44:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b578d8e-fc2f-5134-bd13-7f1b9616de33 with identifier: PM63573 to the API
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PM63573>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:21:43Z',
 'fuel_type': 'petrol',
 'id': '3b578d8e-fc2f-5134-bd13-7f1b9616de33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM63573',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 247318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_160c877d31640f9be2ee3e736bf381db.jpg',
                'https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_abc986cda50362fc5b389f774dd16f68.jpg',
                'https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_c125f519e5125c8e6c249d1d535e75de.jpg',
                'https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_6506eaa6a65b4090b3861852f3e95870.jpg',
                'https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_d2e56b07dab6b07535aef00580fe0497.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b578d8e-fc2f-5134-bd13-7f1b9616de33/3b578d8e-fc2f-5134-bd13-7f1b9616de33_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_160c877d31640f9be2ee3e736bf381db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b578d8e-fc2f-5134-bd13-7f1b9616de33/3b578d8e-fc2f-5134-bd13-7f1b9616de33_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_abc986cda50362fc5b389f774dd16f68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b578d8e-fc2f-5134-bd13-7f1b9616de33/3b578d8e-fc2f-5134-bd13-7f1b9616de33_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_c125f519e5125c8e6c249d1d535e75de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b578d8e-fc2f-5134-bd13-7f1b9616de33/3b578d8e-fc2f-5134-bd13-7f1b9616de33_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_6506eaa6a65b4090b3861852f3e95870.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b578d8e-fc2f-5134-bd13-7f1b9616de33/3b578d8e-fc2f-5134-bd13-7f1b9616de33_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/8d/5b8d01dd1fde2aa0c93a8b5a4b8f2e45/pa/PM63573_d2e56b07dab6b07535aef00580fe0497.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V50 1.8 F Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2009}
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM63573%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [auto1.de] INFO: Saving data for PM63573: {'created_time': 1774723452.054569, 'last_price_update_time': 1774723452.054579, 'auction_closing_time': 1774884103.0}
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM63573') HTTP/1.1" 204 0
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F6d%252Fa16d26b86fd56321fdff4dd9e63e4500%252Fpa%252FYN89436_f6e5ba1f9e6b621e110dcfbeb472a2db.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_f6e5ba1f9e6b621e110dcfbeb472a2db.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_2a8d68a054a02d4003aaab86cb573784.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_2a8d68a054a02d4003aaab86cb573784.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_cad6c166d6987c4aead95a2c1850b104.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_cad6c166d6987c4aead95a2c1850b104.jpg not downloaded yet
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562be6d0>
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_1d4da84c6865829fecf07a8c0038c1ee.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_1d4da84c6865829fecf07a8c0038c1ee.jpg saved to cache
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7722bd6c-f2c2-5e02-84b6-aa464062026e
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456529e10>
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_b65a431612ebcc06cd0475abd2b73ede.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_b65a431612ebcc06cd0475abd2b73ede.jpg saved to cache
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69de0b48-50d4-5864-928a-348cc3786330
2026-03-28 18:44:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11d8dc04-8894-58ec-99cd-30b3ffab662e with identifier: XR20146
2026-03-28 18:44:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11d8dc04-8894-58ec-99cd-30b3ffab662e with scrape type 1
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11d8dc04-8894-58ec-99cd-30b3ffab662e
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_1bcacf37066613881adb29baaddfcda5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_1bcacf37066613881adb29baaddfcda5.jpg not downloaded yet
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_44362d7ece38cd7a5be0158d5ea615ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F6d%252Fa16d26b86fd56321fdff4dd9e63e4500%252Fpa%252FYN89436_5ca10c69a5bfdedf1efe0a7d2083129d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_5ca10c69a5bfdedf1efe0a7d2083129d.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_6ac665f52472332cc7caceb6e8679a9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_6ac665f52472332cc7caceb6e8679a9c.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_e2f8637f875dccd99782ff0880fccd49.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_e2f8637f875dccd99782ff0880fccd49.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_e4fa263e038181f6d7d48844938471ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_e4fa263e038181f6d7d48844938471ad.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F6d%252Fa16d26b86fd56321fdff4dd9e63e4500%252Fpa%252FYN89436_c0165ddec546ea23c5b00a2179f87295.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_c0165ddec546ea23c5b00a2179f87295.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_b8a5812fab31cbcaa542b58bfebbd7aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_b8a5812fab31cbcaa542b58bfebbd7aa.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_4555d55c17f778bc45a0f42bc76e185f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_4555d55c17f778bc45a0f42bc76e185f.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_e3818715c1b0b0a6ba80a376259cdf08.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_e3818715c1b0b0a6ba80a376259cdf08.jpg not downloaded yet
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_80148ef47f263df230319d4d3bc7d84d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_a700701676c665c1b6d6b072808cfa4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_a700701676c665c1b6d6b072808cfa4f.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_d3535863451ae26afd2d66a6703004ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_d3535863451ae26afd2d66a6703004ce.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_c7be126426bef8070f32e49eb2797430.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_c7be126426bef8070f32e49eb2797430.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_1b22dbc7597465746645a53eef2904d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_1b22dbc7597465746645a53eef2904d7.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_040c0c50c630c1cdb2c67108759a85cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_040c0c50c630c1cdb2c67108759a85cc.jpg not downloaded yet
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_1bcacf37066613881adb29baaddfcda5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_4ececb0a30257030356b069b4a65d4bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_4ececb0a30257030356b069b4a65d4bb.jpg not downloaded yet
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563f78d0>
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9327b681-153a-562d-8df0-ab745809eac3/9327b681-153a-562d-8df0-ab745809eac3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F6d%252Fa16d26b86fd56321fdff4dd9e63e4500%252Fpa%252FYN89436_44362d7ece38cd7a5be0158d5ea615ed.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_44362d7ece38cd7a5be0158d5ea615ed.jpg saved to cache
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9327b681-153a-562d-8df0-ab745809eac3
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_eb8630524b6e4eb4aa58e175a3e098fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_eb8630524b6e4eb4aa58e175a3e098fa.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_c98e49e01874682aa904fa7d3a655517.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_c98e49e01874682aa904fa7d3a655517.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_d404e5db10cb4b6e3c95abea56272d12.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_d404e5db10cb4b6e3c95abea56272d12.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_5ed9786a54519f5fa4cf11103ea51ec3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_5ed9786a54519f5fa4cf11103ea51ec3.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_aba4d5a19c53780f748c49926502133d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_aba4d5a19c53780f748c49926502133d.jpg not downloaded yet
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563f5110>
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_80148ef47f263df230319d4d3bc7d84d.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_80148ef47f263df230319d4d3bc7d84d.jpg saved to cache
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_0fcafc460b0919c6580d2b0b16a91210.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_0fcafc460b0919c6580d2b0b16a91210.jpg not downloaded yet
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_4555d55c17f778bc45a0f42bc76e185f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_a98e00a4bf8e76aed8521f01f58a71b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_a98e00a4bf8e76aed8521f01f58a71b0.jpg not downloaded yet
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL75454/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454774290>
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_1bcacf37066613881adb29baaddfcda5.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_1bcacf37066613881adb29baaddfcda5.jpg saved to cache
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11d8dc04-8894-58ec-99cd-30b3ffab662e
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_ad9f57c57bf0e3a2d2778909d7dc03c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_ad9f57c57bf0e3a2d2778909d7dc03c2.jpg not downloaded yet
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_b2412c6027d74327fafd026f01753496.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_b2412c6027d74327fafd026f01753496.jpg not downloaded yet
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563606d0>
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_4555d55c17f778bc45a0f42bc76e185f.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_4555d55c17f778bc45a0f42bc76e185f.jpg saved to cache
2026-03-28 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_4ecc242bff79f621791748146a3e1bb4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_c7be126426bef8070f32e49eb2797430.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ11888> (referer: https://www.auto1.com/v1/car-details-view/AJ11888/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_291f043ba5fb0480a8d939acb7844f93.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_5bcaa6fd8cb963503793cae25fb2f023.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_868891579a84ba64f8a1c3b0ff8b4a1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_525f0a58de5a8ca33cf2d4b4c96df19e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_96b468794a6dc672748f5bbc6770546d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB43778> (referer: https://www.auto1.com/v1/car-details-view/LB43778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW05091/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564982d0>
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc7%252F31c7588795bfdbd2f908df2b90f54834%252Fpa%252FVR46217_4ecc242bff79f621791748146a3e1bb4.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_4ecc242bff79f621791748146a3e1bb4.jpg saved to cache
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69de0b48-50d4-5864-928a-348cc3786330
2026-03-28 18:44:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69de0b48-50d4-5864-928a-348cc3786330, skipping ID generation
2026-03-28 18:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69de0b48-50d4-5864-928a-348cc3786330 with scrape type 1
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69de0b48-50d4-5864-928a-348cc3786330 sending to next pipeline
2026-03-28 18:44:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69de0b48-50d4-5864-928a-348cc3786330, identifier: VR46217
2026-03-28 18:44:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69de0b48-50d4-5864-928a-348cc3786330 with identifier: VR46217
2026-03-28 18:44:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69de0b48-50d4-5864-928a-348cc3786330 with identifier: VR46217
2026-03-28 18:44:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69de0b48-50d4-5864-928a-348cc3786330 with identifier: VR46217 to the API
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_4ecc242bff79f621791748146a3e1bb4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 290,
 'expiration_date': '2026-03-30T15:28:52Z',
 'fuel_type': 'petrol',
 'id': '69de0b48-50d4-5864-928a-348cc3786330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR46217',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 81067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_6858b4b936f3c0f47f85cd0e07248914.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_051d797efa2f2551f703abccfce54c46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_b65a431612ebcc06cd0475abd2b73ede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3018811,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_4ecc242bff79f621791748146a3e1bb4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_99594a410fafc434e0dbd8e51851967b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3006077,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_889309174d4833db9560522461b92454.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3073088,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_ca78dcaef92a1bff08c940e4ffb416bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3003184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_21225ef1f5c18b030d098af128f1902b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_e2d38016e397cfbc550745fd13ce2444.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69de0b48-50d4-5864-928a-348cc3786330/69de0b48-50d4-5864-928a-348cc3786330_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c7/31c7588795bfdbd2f908df2b90f54834/pa/VR46217_2581b15740e37dc9c22f716120fe4e53.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
 'transmission': 'automatic',
 'trim': 'GTI TCR',
 'year': 2019}
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR46217%27 HTTP/1.1" 200 None
2026-03-28 18:44:13 [auto1.de] INFO: Saving data for VR46217: {'created_time': 1774723453.509149, 'last_price_update_time': 1774723453.509161, 'auction_closing_time': 1774884532.0}
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR46217') HTTP/1.1" 204 0
2026-03-28 18:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_0fcafc460b0919c6580d2b0b16a91210.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_b2412c6027d74327fafd026f01753496.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AZ02782/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563114d0>
2026-03-28 18:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_c7be126426bef8070f32e49eb2797430.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_c7be126426bef8070f32e49eb2797430.jpg saved to cache
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11d8dc04-8894-58ec-99cd-30b3ffab662e
2026-03-28 18:44:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61869c94-284d-5da7-844d-223e3a8b1c3f with identifier: AJ11888
2026-03-28 18:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61869c94-284d-5da7-844d-223e3a8b1c3f with scrape type 1
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 61869c94-284d-5da7-844d-223e3a8b1c3f
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fea%252F39ea54dfdc7a91c83ec67e73764edfc6%252Fpa%252FAJ11888_1b9e72296edec9faf1bae09ec1473f87.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_1b9e72296edec9faf1bae09ec1473f87.jpg already downloaded
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fea%252F39ea54dfdc7a91c83ec67e73764edfc6%252Fpa%252FAJ11888_498d0257166f700199c46eee09d09aac.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_498d0257166f700199c46eee09d09aac.jpg already downloaded
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fea%252F39ea54dfdc7a91c83ec67e73764edfc6%252Fpa%252FAJ11888_1cd092893fb3eed8e45f6a4ad7047084.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_1cd092893fb3eed8e45f6a4ad7047084.jpg already downloaded
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fea%252F39ea54dfdc7a91c83ec67e73764edfc6%252Fpa%252FAJ11888_69afdd3caba1806f6a6a081fb7fc2f3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_69afdd3caba1806f6a6a081fb7fc2f3c.jpg already downloaded
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fea%252F39ea54dfdc7a91c83ec67e73764edfc6%252Fpa%252FAJ11888_9774954d5862bad480984db8990fc8cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_9774954d5862bad480984db8990fc8cb.jpg already downloaded
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fea%252F39ea54dfdc7a91c83ec67e73764edfc6%252Fpa%252FAJ11888_35e2d67e883a508a9421bbb6ea39af30.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_35e2d67e883a508a9421bbb6ea39af30.jpg already downloaded
2026-03-28 18:44:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61869c94-284d-5da7-844d-223e3a8b1c3f, identifier: AJ11888
2026-03-28 18:44:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245840aad0>
2026-03-28 18:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_291f043ba5fb0480a8d939acb7844f93.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_291f043ba5fb0480a8d939acb7844f93.jpg saved to cache
2026-03-28 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7722bd6c-f2c2-5e02-84b6-aa464062026e
2026-03-28 18:44:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458558950>
2026-03-28 18:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_5bcaa6fd8cb963503793cae25fb2f023.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_5bcaa6fd8cb963503793cae25fb2f023.jpg saved to cache
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7722bd6c-f2c2-5e02-84b6-aa464062026e
2026-03-28 18:44:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b0b90>
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_868891579a84ba64f8a1c3b0ff8b4a1a.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_868891579a84ba64f8a1c3b0ff8b4a1a.jpg saved to cache
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 915406a7-db45-5663-97f1-3654017a8211
2026-03-28 18:44:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bd850>
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_525f0a58de5a8ca33cf2d4b4c96df19e.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_525f0a58de5a8ca33cf2d4b4c96df19e.jpg saved to cache
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c67b7d7-20b7-5df0-994d-362db3f12f42
2026-03-28 18:44:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855a890>
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_96b468794a6dc672748f5bbc6770546d.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_96b468794a6dc672748f5bbc6770546d.jpg saved to cache
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2
2026-03-28 18:44:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7a85423-5686-5bb9-840e-6941a61afb95 with identifier: LB43778
2026-03-28 18:44:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7a85423-5686-5bb9-840e-6941a61afb95 with scrape type 1
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a7a85423-5686-5bb9-840e-6941a61afb95
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F7d%252F9c7d3a362b1fc77e426f589396d19a19%252Fpa%252FLB43778_5a81fe0e3183e8e2e2831383a5baf59d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_5a81fe0e3183e8e2e2831383a5baf59d.jpg not downloaded yet
2026-03-28 18:44:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61869c94-284d-5da7-844d-223e3a8b1c3f with identifier: AJ11888
2026-03-28 18:44:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61869c94-284d-5da7-844d-223e3a8b1c3f with identifier: AJ11888
2026-03-28 18:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61869c94-284d-5da7-844d-223e3a8b1c3f with identifier: AJ11888 to the API
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AJ11888>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:07:07Z',
 'fuel_type': 'petrol',
 'id': '61869c94-284d-5da7-844d-223e3a8b1c3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ11888',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 56865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_1b9e72296edec9faf1bae09ec1473f87.jpg',
                'https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_498d0257166f700199c46eee09d09aac.jpg',
                'https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_1cd092893fb3eed8e45f6a4ad7047084.jpg',
                'https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_69afdd3caba1806f6a6a081fb7fc2f3c.jpg',
                'https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_9774954d5862bad480984db8990fc8cb.jpg',
                'https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_35e2d67e883a508a9421bbb6ea39af30.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61869c94-284d-5da7-844d-223e3a8b1c3f/61869c94-284d-5da7-844d-223e3a8b1c3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_1b9e72296edec9faf1bae09ec1473f87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61869c94-284d-5da7-844d-223e3a8b1c3f/61869c94-284d-5da7-844d-223e3a8b1c3f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_498d0257166f700199c46eee09d09aac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61869c94-284d-5da7-844d-223e3a8b1c3f/61869c94-284d-5da7-844d-223e3a8b1c3f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_1cd092893fb3eed8e45f6a4ad7047084.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61869c94-284d-5da7-844d-223e3a8b1c3f/61869c94-284d-5da7-844d-223e3a8b1c3f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_69afdd3caba1806f6a6a081fb7fc2f3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61869c94-284d-5da7-844d-223e3a8b1c3f/61869c94-284d-5da7-844d-223e3a8b1c3f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_9774954d5862bad480984db8990fc8cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61869c94-284d-5da7-844d-223e3a8b1c3f/61869c94-284d-5da7-844d-223e3a8b1c3f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ea/39ea54dfdc7a91c83ec67e73764edfc6/pa/AJ11888_35e2d67e883a508a9421bbb6ea39af30.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.1 ClearTec 35 Jahre',
 'transmission': 'manual',
 'trim': 'ClearTec 35 Jahre',
 'year': 2012}
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ11888%27 HTTP/1.1" 200 None
2026-03-28 18:44:14 [auto1.de] INFO: Saving data for AJ11888: {'created_time': 1774723454.73322, 'last_price_update_time': 1774723454.733233, 'auction_closing_time': 1774883227.0}
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ11888') HTTP/1.1" 204 0
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F7d%252F9c7d3a362b1fc77e426f589396d19a19%252Fpa%252FLB43778_5a1b3cacaa59939086e0efa410ac9da2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_5a1b3cacaa59939086e0efa410ac9da2.jpg not downloaded yet
2026-03-28 18:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD24318/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM32674> (referer: https://www.auto1.com/v1/car-details-view/TM32674/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245609c110>
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_0fcafc460b0919c6580d2b0b16a91210.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_0fcafc460b0919c6580d2b0b16a91210.jpg saved to cache
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11d8dc04-8894-58ec-99cd-30b3ffab662e
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456149c50>
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_b2412c6027d74327fafd026f01753496.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_b2412c6027d74327fafd026f01753496.jpg saved to cache
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11d8dc04-8894-58ec-99cd-30b3ffab662e
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F7d%252F9c7d3a362b1fc77e426f589396d19a19%252Fpa%252FLB43778_56165bee18ca6307ec2ebf45d323c7a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_56165bee18ca6307ec2ebf45d323c7a2.jpg not downloaded yet
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F7d%252F9c7d3a362b1fc77e426f589396d19a19%252Fpa%252FLB43778_263718d8ed4d6e8aa6c311f388ccfc63.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_263718d8ed4d6e8aa6c311f388ccfc63.jpg not downloaded yet
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F7d%252F9c7d3a362b1fc77e426f589396d19a19%252Fpa%252FLB43778_a5ffa07ac9105699c48784472a1554e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_a5ffa07ac9105699c48784472a1554e7.jpg not downloaded yet
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F7d%252F9c7d3a362b1fc77e426f589396d19a19%252Fpa%252FLB43778_54bbec90bd6684342435dce504326edd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_54bbec90bd6684342435dce504326edd.jpg not downloaded yet
2026-03-28 18:44:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef1c5a0f-867a-5769-8467-ae2e2a4e0487 with identifier: TM32674
2026-03-28 18:44:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef1c5a0f-867a-5769-8467-ae2e2a4e0487 with scrape type 1
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef1c5a0f-867a-5769-8467-ae2e2a4e0487
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ff8%252F52f815c1ff67fec51937f9c485bf2b8f%252Fpa%252FTM32674_04ae08fec8cda34b2c098918763cf153.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_04ae08fec8cda34b2c098918763cf153.jpg already downloaded
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ff8%252F52f815c1ff67fec51937f9c485bf2b8f%252Fpa%252FTM32674_0d3ed6d0644c9c1bd4abcb9f94e7eecd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_0d3ed6d0644c9c1bd4abcb9f94e7eecd.jpg already downloaded
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ff8%252F52f815c1ff67fec51937f9c485bf2b8f%252Fpa%252FTM32674_ac3a942be05e1ea779a31dfcb1994881.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_ac3a942be05e1ea779a31dfcb1994881.jpg already downloaded
2026-03-28 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ff8%252F52f815c1ff67fec51937f9c485bf2b8f%252Fpa%252FTM32674_bbd6e9d69e4e7316aa814ef45e039abc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_bbd6e9d69e4e7316aa814ef45e039abc.jpg already downloaded
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ff8%252F52f815c1ff67fec51937f9c485bf2b8f%252Fpa%252FTM32674_9bda1e2e9d43bc7f4e125ac18ecbab84.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_9bda1e2e9d43bc7f4e125ac18ecbab84.jpg already downloaded
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ff8%252F52f815c1ff67fec51937f9c485bf2b8f%252Fpa%252FTM32674_24f06d995081940fa5205ef2fbc1d03d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_24f06d995081940fa5205ef2fbc1d03d.jpg already downloaded
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ff8%252F52f815c1ff67fec51937f9c485bf2b8f%252Fpa%252FTM32674_64e36ea1d471bb34b31c5d8d0cbf6093.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_64e36ea1d471bb34b31c5d8d0cbf6093.jpg already downloaded
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ff8%252F52f815c1ff67fec51937f9c485bf2b8f%252Fpa%252FTM32674_1720343549700b2176ef1a1f8cb0bcf2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_1720343549700b2176ef1a1f8cb0bcf2.jpg already downloaded
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ff8%252F52f815c1ff67fec51937f9c485bf2b8f%252Fpa%252FTM32674_2f95655e8047523cf5108b29b9c52b38.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_2f95655e8047523cf5108b29b9c52b38.jpg already downloaded
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Ff8%252F52f815c1ff67fec51937f9c485bf2b8f%252Fpa%252FTM32674_b2322a832199b0e01034a1f25576e520.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_b2322a832199b0e01034a1f25576e520.jpg already downloaded
2026-03-28 18:44:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef1c5a0f-867a-5769-8467-ae2e2a4e0487, identifier: TM32674
2026-03-28 18:44:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef1c5a0f-867a-5769-8467-ae2e2a4e0487 with identifier: TM32674
2026-03-28 18:44:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef1c5a0f-867a-5769-8467-ae2e2a4e0487 with identifier: TM32674
2026-03-28 18:44:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef1c5a0f-867a-5769-8467-ae2e2a4e0487 with identifier: TM32674 to the API
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TM32674>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:31:45Z',
 'fuel_type': 'petrol',
 'id': 'ef1c5a0f-867a-5769-8467-ae2e2a4e0487',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM32674',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 45050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_04ae08fec8cda34b2c098918763cf153.jpg',
                'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_0d3ed6d0644c9c1bd4abcb9f94e7eecd.jpg',
                'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_ac3a942be05e1ea779a31dfcb1994881.jpg',
                'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_bbd6e9d69e4e7316aa814ef45e039abc.jpg',
                'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_9bda1e2e9d43bc7f4e125ac18ecbab84.jpg',
                'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_24f06d995081940fa5205ef2fbc1d03d.jpg',
                'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_64e36ea1d471bb34b31c5d8d0cbf6093.jpg',
                'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_1720343549700b2176ef1a1f8cb0bcf2.jpg',
                'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_2f95655e8047523cf5108b29b9c52b38.jpg',
                'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_b2322a832199b0e01034a1f25576e520.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1c5a0f-867a-5769-8467-ae2e2a4e0487/ef1c5a0f-867a-5769-8467-ae2e2a4e0487_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_04ae08fec8cda34b2c098918763cf153.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1c5a0f-867a-5769-8467-ae2e2a4e0487/ef1c5a0f-867a-5769-8467-ae2e2a4e0487_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_0d3ed6d0644c9c1bd4abcb9f94e7eecd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1c5a0f-867a-5769-8467-ae2e2a4e0487/ef1c5a0f-867a-5769-8467-ae2e2a4e0487_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_ac3a942be05e1ea779a31dfcb1994881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1c5a0f-867a-5769-8467-ae2e2a4e0487/ef1c5a0f-867a-5769-8467-ae2e2a4e0487_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_bbd6e9d69e4e7316aa814ef45e039abc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1c5a0f-867a-5769-8467-ae2e2a4e0487/ef1c5a0f-867a-5769-8467-ae2e2a4e0487_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_9bda1e2e9d43bc7f4e125ac18ecbab84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1c5a0f-867a-5769-8467-ae2e2a4e0487/ef1c5a0f-867a-5769-8467-ae2e2a4e0487_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_24f06d995081940fa5205ef2fbc1d03d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1c5a0f-867a-5769-8467-ae2e2a4e0487/ef1c5a0f-867a-5769-8467-ae2e2a4e0487_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_64e36ea1d471bb34b31c5d8d0cbf6093.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1c5a0f-867a-5769-8467-ae2e2a4e0487/ef1c5a0f-867a-5769-8467-ae2e2a4e0487_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_1720343549700b2176ef1a1f8cb0bcf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1c5a0f-867a-5769-8467-ae2e2a4e0487/ef1c5a0f-867a-5769-8467-ae2e2a4e0487_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_2f95655e8047523cf5108b29b9c52b38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1c5a0f-867a-5769-8467-ae2e2a4e0487/ef1c5a0f-867a-5769-8467-ae2e2a4e0487_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/f8/52f815c1ff67fec51937f9c485bf2b8f/pa/TM32674_b2322a832199b0e01034a1f25576e520.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Turbo HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2018}
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM32674%27 HTTP/1.1" 200 None
2026-03-28 18:44:15 [auto1.de] INFO: Saving data for TM32674: {'created_time': 1774723455.571746, 'last_price_update_time': 1774723455.571757, 'auction_closing_time': 1774884705.0}
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM32674') HTTP/1.1" 204 0
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_5a81fe0e3183e8e2e2831383a5baf59d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_eb8630524b6e4eb4aa58e175a3e098fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_c98e49e01874682aa904fa7d3a655517.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_ad9f57c57bf0e3a2d2778909d7dc03c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_aba4d5a19c53780f748c49926502133d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_5ed9786a54519f5fa4cf11103ea51ec3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_a98e00a4bf8e76aed8521f01f58a71b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_d404e5db10cb4b6e3c95abea56272d12.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_54bbec90bd6684342435dce504326edd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_a5ffa07ac9105699c48784472a1554e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_d3535863451ae26afd2d66a6703004ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456262e90>
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a85423-5686-5bb9-840e-6941a61afb95/a7a85423-5686-5bb9-840e-6941a61afb95_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F7d%252F9c7d3a362b1fc77e426f589396d19a19%252Fpa%252FLB43778_5a81fe0e3183e8e2e2831383a5baf59d.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_5a81fe0e3183e8e2e2831383a5baf59d.jpg saved to cache
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7a85423-5686-5bb9-840e-6941a61afb95
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_5a1b3cacaa59939086e0efa410ac9da2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458f74190>
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_eb8630524b6e4eb4aa58e175a3e098fa.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_eb8630524b6e4eb4aa58e175a3e098fa.jpg saved to cache
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c67b7d7-20b7-5df0-994d-362db3f12f42
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456176390>
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_c98e49e01874682aa904fa7d3a655517.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_c98e49e01874682aa904fa7d3a655517.jpg saved to cache
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_263718d8ed4d6e8aa6c311f388ccfc63.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_040c0c50c630c1cdb2c67108759a85cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245624c390>
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_ad9f57c57bf0e3a2d2778909d7dc03c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_ad9f57c57bf0e3a2d2778909d7dc03c2.jpg saved to cache
2026-03-28 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11d8dc04-8894-58ec-99cd-30b3ffab662e
2026-03-28 18:44:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563f77d0>
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_aba4d5a19c53780f748c49926502133d.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_aba4d5a19c53780f748c49926502133d.jpg saved to cache
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2
2026-03-28 18:44:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475f3d0>
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_5ed9786a54519f5fa4cf11103ea51ec3.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_5ed9786a54519f5fa4cf11103ea51ec3.jpg saved to cache
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c67b7d7-20b7-5df0-994d-362db3f12f42
2026-03-28 18:44:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245620c990>
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_a98e00a4bf8e76aed8521f01f58a71b0.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_a98e00a4bf8e76aed8521f01f58a71b0.jpg saved to cache
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11d8dc04-8894-58ec-99cd-30b3ffab662e
2026-03-28 18:44:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456131d10>
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_d404e5db10cb4b6e3c95abea56272d12.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_d404e5db10cb4b6e3c95abea56272d12.jpg saved to cache
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11d8dc04-8894-58ec-99cd-30b3ffab662e
2026-03-28 18:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_1b22dbc7597465746645a53eef2904d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245606bb10>
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a85423-5686-5bb9-840e-6941a61afb95/a7a85423-5686-5bb9-840e-6941a61afb95_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F7d%252F9c7d3a362b1fc77e426f589396d19a19%252Fpa%252FLB43778_54bbec90bd6684342435dce504326edd.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_54bbec90bd6684342435dce504326edd.jpg saved to cache
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7a85423-5686-5bb9-840e-6941a61afb95
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456343650>
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a85423-5686-5bb9-840e-6941a61afb95/a7a85423-5686-5bb9-840e-6941a61afb95_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F7d%252F9c7d3a362b1fc77e426f589396d19a19%252Fpa%252FLB43778_a5ffa07ac9105699c48784472a1554e7.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_a5ffa07ac9105699c48784472a1554e7.jpg saved to cache
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7a85423-5686-5bb9-840e-6941a61afb95
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564d2310>
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_d3535863451ae26afd2d66a6703004ce.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_d3535863451ae26afd2d66a6703004ce.jpg saved to cache
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547f8fd0>
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a85423-5686-5bb9-840e-6941a61afb95/a7a85423-5686-5bb9-840e-6941a61afb95_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F7d%252F9c7d3a362b1fc77e426f589396d19a19%252Fpa%252FLB43778_5a1b3cacaa59939086e0efa410ac9da2.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_5a1b3cacaa59939086e0efa410ac9da2.jpg saved to cache
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7a85423-5686-5bb9-840e-6941a61afb95
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638cf10>
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a85423-5686-5bb9-840e-6941a61afb95/a7a85423-5686-5bb9-840e-6941a61afb95_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F7d%252F9c7d3a362b1fc77e426f589396d19a19%252Fpa%252FLB43778_263718d8ed4d6e8aa6c311f388ccfc63.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_263718d8ed4d6e8aa6c311f388ccfc63.jpg saved to cache
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7a85423-5686-5bb9-840e-6941a61afb95
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245630cd90>
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_040c0c50c630c1cdb2c67108759a85cc.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_040c0c50c630c1cdb2c67108759a85cc.jpg saved to cache
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2
2026-03-28 18:44:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bf310>
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_1b22dbc7597465746645a53eef2904d7.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_1b22dbc7597465746645a53eef2904d7.jpg saved to cache
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c67b7d7-20b7-5df0-994d-362db3f12f42
2026-03-28 18:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_4ececb0a30257030356b069b4a65d4bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_56165bee18ca6307ec2ebf45d323c7a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_c0165ddec546ea23c5b00a2179f87295.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_5ca10c69a5bfdedf1efe0a7d2083129d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW05091> (referer: https://www.auto1.com/v1/car-details-view/FW05091/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_a700701676c665c1b6d6b072808cfa4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_e3818715c1b0b0a6ba80a376259cdf08.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bd390>
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_4ececb0a30257030356b069b4a65d4bb.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_4ececb0a30257030356b069b4a65d4bb.jpg saved to cache
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11d8dc04-8894-58ec-99cd-30b3ffab662e
2026-03-28 18:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_e2f8637f875dccd99782ff0880fccd49.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_e4fa263e038181f6d7d48844938471ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_f6e5ba1f9e6b621e110dcfbeb472a2db.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245605a390>
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a85423-5686-5bb9-840e-6941a61afb95/a7a85423-5686-5bb9-840e-6941a61afb95_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F7d%252F9c7d3a362b1fc77e426f589396d19a19%252Fpa%252FLB43778_56165bee18ca6307ec2ebf45d323c7a2.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_56165bee18ca6307ec2ebf45d323c7a2.jpg saved to cache
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7a85423-5686-5bb9-840e-6941a61afb95
2026-03-28 18:44:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7a85423-5686-5bb9-840e-6941a61afb95, skipping ID generation
2026-03-28 18:44:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7a85423-5686-5bb9-840e-6941a61afb95 with scrape type 1
2026-03-28 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7a85423-5686-5bb9-840e-6941a61afb95 sending to next pipeline
2026-03-28 18:44:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7a85423-5686-5bb9-840e-6941a61afb95, identifier: LB43778
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458636ed0>
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9327b681-153a-562d-8df0-ab745809eac3/9327b681-153a-562d-8df0-ab745809eac3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F6d%252Fa16d26b86fd56321fdff4dd9e63e4500%252Fpa%252FYN89436_c0165ddec546ea23c5b00a2179f87295.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_c0165ddec546ea23c5b00a2179f87295.jpg saved to cache
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9327b681-153a-562d-8df0-ab745809eac3
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245627e210>
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9327b681-153a-562d-8df0-ab745809eac3/9327b681-153a-562d-8df0-ab745809eac3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F6d%252Fa16d26b86fd56321fdff4dd9e63e4500%252Fpa%252FYN89436_5ca10c69a5bfdedf1efe0a7d2083129d.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_5ca10c69a5bfdedf1efe0a7d2083129d.jpg saved to cache
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9327b681-153a-562d-8df0-ab745809eac3
2026-03-28 18:44:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93057221-a1d6-5f44-bca6-b1199f4280d7 with identifier: FW05091
2026-03-28 18:44:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93057221-a1d6-5f44-bca6-b1199f4280d7 with scrape type 1
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93057221-a1d6-5f44-bca6-b1199f4280d7
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F19%252Fe2195a9146c38351eabff8b218dd08c3%252Fpa%252FFW05091_ce94c60c0b34850a94c4459288eddeda.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_ce94c60c0b34850a94c4459288eddeda.jpg already downloaded
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F19%252Fe2195a9146c38351eabff8b218dd08c3%252Fpa%252FFW05091_1269da3f9ccd547dae3d455af2d593d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_1269da3f9ccd547dae3d455af2d593d3.jpg already downloaded
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F19%252Fe2195a9146c38351eabff8b218dd08c3%252Fpa%252FFW05091_9b0936a0c6e9a18cdcdc0b1eb6bc7dcd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_9b0936a0c6e9a18cdcdc0b1eb6bc7dcd.jpg already downloaded
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F19%252Fe2195a9146c38351eabff8b218dd08c3%252Fpa%252FFW05091_3c83061f2b7e9f4cfc0b8ab48cda2c53.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_3c83061f2b7e9f4cfc0b8ab48cda2c53.jpg already downloaded
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F19%252Fe2195a9146c38351eabff8b218dd08c3%252Fpa%252FFW05091_1a249288c29a7bb68be85812999747eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_1a249288c29a7bb68be85812999747eb.jpg already downloaded
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F19%252Fe2195a9146c38351eabff8b218dd08c3%252Fpa%252FFW05091_0e2ccc22ceeea170232a682a644003fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_0e2ccc22ceeea170232a682a644003fd.jpg already downloaded
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F19%252Fe2195a9146c38351eabff8b218dd08c3%252Fpa%252FFW05091_de85f70897f343516f948977050109d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_de85f70897f343516f948977050109d4.jpg already downloaded
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F19%252Fe2195a9146c38351eabff8b218dd08c3%252Fpa%252FFW05091_acfa3cd867dc53e7ebe25495dcf55db0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_acfa3cd867dc53e7ebe25495dcf55db0.jpg already downloaded
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F19%252Fe2195a9146c38351eabff8b218dd08c3%252Fpa%252FFW05091_7765b322992f2b973fb34e1c7535644f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_7765b322992f2b973fb34e1c7535644f.jpg already downloaded
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F19%252Fe2195a9146c38351eabff8b218dd08c3%252Fpa%252FFW05091_3f650b6392bd0273654f15ead150e93e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_3f650b6392bd0273654f15ead150e93e.jpg already downloaded
2026-03-28 18:44:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93057221-a1d6-5f44-bca6-b1199f4280d7, identifier: FW05091
2026-03-28 18:44:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456243290>
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_a700701676c665c1b6d6b072808cfa4f.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_a700701676c665c1b6d6b072808cfa4f.jpg saved to cache
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c67b7d7-20b7-5df0-994d-362db3f12f42
2026-03-28 18:44:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b2f50>
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_e3818715c1b0b0a6ba80a376259cdf08.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_e3818715c1b0b0a6ba80a376259cdf08.jpg saved to cache
2026-03-28 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11d8dc04-8894-58ec-99cd-30b3ffab662e
2026-03-28 18:44:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7a85423-5686-5bb9-840e-6941a61afb95 with identifier: LB43778
2026-03-28 18:44:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7a85423-5686-5bb9-840e-6941a61afb95 with identifier: LB43778
2026-03-28 18:44:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7a85423-5686-5bb9-840e-6941a61afb95 with identifier: LB43778 to the API
2026-03-28 18:44:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_56165bee18ca6307ec2ebf45d323c7a2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:02:39Z',
 'fuel_type': 'petrol',
 'id': 'a7a85423-5686-5bb9-840e-6941a61afb95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB43778',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 212667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a85423-5686-5bb9-840e-6941a61afb95/a7a85423-5686-5bb9-840e-6941a61afb95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_5a81fe0e3183e8e2e2831383a5baf59d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a85423-5686-5bb9-840e-6941a61afb95/a7a85423-5686-5bb9-840e-6941a61afb95_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_5a1b3cacaa59939086e0efa410ac9da2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a85423-5686-5bb9-840e-6941a61afb95/a7a85423-5686-5bb9-840e-6941a61afb95_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_56165bee18ca6307ec2ebf45d323c7a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a85423-5686-5bb9-840e-6941a61afb95/a7a85423-5686-5bb9-840e-6941a61afb95_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_263718d8ed4d6e8aa6c311f388ccfc63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a85423-5686-5bb9-840e-6941a61afb95/a7a85423-5686-5bb9-840e-6941a61afb95_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_a5ffa07ac9105699c48784472a1554e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a85423-5686-5bb9-840e-6941a61afb95/a7a85423-5686-5bb9-840e-6941a61afb95_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/7d/9c7d3a362b1fc77e426f589396d19a19/pa/LB43778_54bbec90bd6684342435dce504326edd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB43778%27 HTTP/1.1" 200 None
2026-03-28 18:44:18 [auto1.de] INFO: Saving data for LB43778: {'created_time': 1774723458.205091, 'last_price_update_time': 1774723458.205102, 'auction_closing_time': 1774882959.0}
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB43778') HTTP/1.1" 204 0
2026-03-28 18:44:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93057221-a1d6-5f44-bca6-b1199f4280d7 with identifier: FW05091
2026-03-28 18:44:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93057221-a1d6-5f44-bca6-b1199f4280d7 with identifier: FW05091
2026-03-28 18:44:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93057221-a1d6-5f44-bca6-b1199f4280d7 with identifier: FW05091 to the API
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FW05091>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:02:35Z',
 'fuel_type': 'petrol',
 'id': '93057221-a1d6-5f44-bca6-b1199f4280d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW05091',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 35008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_ce94c60c0b34850a94c4459288eddeda.jpg',
                'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_1269da3f9ccd547dae3d455af2d593d3.jpg',
                'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_9b0936a0c6e9a18cdcdc0b1eb6bc7dcd.jpg',
                'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_3c83061f2b7e9f4cfc0b8ab48cda2c53.jpg',
                'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_1a249288c29a7bb68be85812999747eb.jpg',
                'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_0e2ccc22ceeea170232a682a644003fd.jpg',
                'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_de85f70897f343516f948977050109d4.jpg',
                'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_acfa3cd867dc53e7ebe25495dcf55db0.jpg',
                'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_7765b322992f2b973fb34e1c7535644f.jpg',
                'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_3f650b6392bd0273654f15ead150e93e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93057221-a1d6-5f44-bca6-b1199f4280d7/93057221-a1d6-5f44-bca6-b1199f4280d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_ce94c60c0b34850a94c4459288eddeda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93057221-a1d6-5f44-bca6-b1199f4280d7/93057221-a1d6-5f44-bca6-b1199f4280d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_1269da3f9ccd547dae3d455af2d593d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93057221-a1d6-5f44-bca6-b1199f4280d7/93057221-a1d6-5f44-bca6-b1199f4280d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_9b0936a0c6e9a18cdcdc0b1eb6bc7dcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93057221-a1d6-5f44-bca6-b1199f4280d7/93057221-a1d6-5f44-bca6-b1199f4280d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_3c83061f2b7e9f4cfc0b8ab48cda2c53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93057221-a1d6-5f44-bca6-b1199f4280d7/93057221-a1d6-5f44-bca6-b1199f4280d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_1a249288c29a7bb68be85812999747eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93057221-a1d6-5f44-bca6-b1199f4280d7/93057221-a1d6-5f44-bca6-b1199f4280d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_0e2ccc22ceeea170232a682a644003fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93057221-a1d6-5f44-bca6-b1199f4280d7/93057221-a1d6-5f44-bca6-b1199f4280d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_de85f70897f343516f948977050109d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93057221-a1d6-5f44-bca6-b1199f4280d7/93057221-a1d6-5f44-bca6-b1199f4280d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_acfa3cd867dc53e7ebe25495dcf55db0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93057221-a1d6-5f44-bca6-b1199f4280d7/93057221-a1d6-5f44-bca6-b1199f4280d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_7765b322992f2b973fb34e1c7535644f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93057221-a1d6-5f44-bca6-b1199f4280d7/93057221-a1d6-5f44-bca6-b1199f4280d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/19/e2195a9146c38351eabff8b218dd08c3/pa/FW05091_3f650b6392bd0273654f15ead150e93e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.8 TSI GTI BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'GTI BlueMotion Tech',
 'year': 2016}
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW05091%27 HTTP/1.1" 200 None
2026-03-28 18:44:18 [auto1.de] INFO: Saving data for FW05091: {'created_time': 1774723458.582194, 'last_price_update_time': 1774723458.582207, 'auction_closing_time': 1774882955.0}
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW05091') HTTP/1.1" 204 0
2026-03-28 18:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_31322484495c18f8a9c5409b8d69d854.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD24318> (referer: https://www.auto1.com/v1/car-details-view/YD24318/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AZ02782> (referer: https://www.auto1.com/v1/car-details-view/AZ02782/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456189950>
2026-03-28 18:44:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_e2f8637f875dccd99782ff0880fccd49.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_e2f8637f875dccd99782ff0880fccd49.jpg saved to cache
2026-03-28 18:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2
2026-03-28 18:44:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456112dd0>
2026-03-28 18:44:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F68%252F8d68b23f34c1e3519a6f9b63b5e153e1%252Fpa%252FXR20146_e4fa263e038181f6d7d48844938471ad.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_e4fa263e038181f6d7d48844938471ad.jpg saved to cache
2026-03-28 18:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11d8dc04-8894-58ec-99cd-30b3ffab662e
2026-03-28 18:44:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11d8dc04-8894-58ec-99cd-30b3ffab662e, skipping ID generation
2026-03-28 18:44:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11d8dc04-8894-58ec-99cd-30b3ffab662e with scrape type 1
2026-03-28 18:44:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11d8dc04-8894-58ec-99cd-30b3ffab662e sending to next pipeline
2026-03-28 18:44:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11d8dc04-8894-58ec-99cd-30b3ffab662e, identifier: XR20146
2026-03-28 18:44:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618a710>
2026-03-28 18:44:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9327b681-153a-562d-8df0-ab745809eac3/9327b681-153a-562d-8df0-ab745809eac3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F6d%252Fa16d26b86fd56321fdff4dd9e63e4500%252Fpa%252FYN89436_f6e5ba1f9e6b621e110dcfbeb472a2db.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_f6e5ba1f9e6b621e110dcfbeb472a2db.jpg saved to cache
2026-03-28 18:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9327b681-153a-562d-8df0-ab745809eac3
2026-03-28 18:44:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11d8dc04-8894-58ec-99cd-30b3ffab662e with identifier: XR20146
2026-03-28 18:44:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11d8dc04-8894-58ec-99cd-30b3ffab662e with identifier: XR20146
2026-03-28 18:44:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11d8dc04-8894-58ec-99cd-30b3ffab662e with identifier: XR20146 to the API
2026-03-28 18:44:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_e4fa263e038181f6d7d48844938471ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:29:39Z',
 'fuel_type': 'diesel',
 'id': '11d8dc04-8894-58ec-99cd-30b3ffab662e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR20146',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 203146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_1bcacf37066613881adb29baaddfcda5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_e4fa263e038181f6d7d48844938471ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3426580,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_e3818715c1b0b0a6ba80a376259cdf08.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_c7be126426bef8070f32e49eb2797430.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3430879,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_4ececb0a30257030356b069b4a65d4bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3499241,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_d404e5db10cb4b6e3c95abea56272d12.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_0fcafc460b0919c6580d2b0b16a91210.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3462865,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_a98e00a4bf8e76aed8521f01f58a71b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1652754,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_ad9f57c57bf0e3a2d2778909d7dc03c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11d8dc04-8894-58ec-99cd-30b3ffab662e/11d8dc04-8894-58ec-99cd-30b3ffab662e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/68/8d68b23f34c1e3519a6f9b63b5e153e1/pa/XR20146_b2412c6027d74327fafd026f01753496.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium S',
 'transmission': 'automatic',
 'trim': 'Titanium S',
 'year': 2013}
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR20146%27 HTTP/1.1" 200 None
2026-03-28 18:44:19 [auto1.de] INFO: Saving data for XR20146: {'created_time': 1774723459.337788, 'last_price_update_time': 1774723459.3378, 'auction_closing_time': 1774884579.0}
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR20146') HTTP/1.1" 204 0
2026-03-28 18:44:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ76900> (referer: https://www.auto1.com/v1/car-details-view/FZ76900/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_187421e3997c12a7e650e0ced983f1fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_0317c8c8a09568b41d9ccb7b92729a21.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456189c10>
2026-03-28 18:44:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_31322484495c18f8a9c5409b8d69d854.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_31322484495c18f8a9c5409b8d69d854.jpg saved to cache
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c67b7d7-20b7-5df0-994d-362db3f12f42
2026-03-28 18:44:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ed97780-76bd-5aed-92fe-9ef5de9494f1 with identifier: YD24318
2026-03-28 18:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1 with scrape type 1
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_c698349e93279570c5c0b54b0511be35.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_c698349e93279570c5c0b54b0511be35.jpg not downloaded yet
2026-03-28 18:44:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83b96697-f0d5-51a2-99bd-a75d924e95ad with identifier: AZ02782
2026-03-28 18:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83b96697-f0d5-51a2-99bd-a75d924e95ad with scrape type 1
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 83b96697-f0d5-51a2-99bd-a75d924e95ad
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4d%252F104d56e36cab306fd164fb85d99a34f9%252Fpa%252FAZ02782_482e975ed6d402a07244e7668b9ddc82.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_482e975ed6d402a07244e7668b9ddc82.jpg not downloaded yet
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_68876756c05e32dcbcf1cb7980b9dee8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_68876756c05e32dcbcf1cb7980b9dee8.jpg not downloaded yet
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4d%252F104d56e36cab306fd164fb85d99a34f9%252Fpa%252FAZ02782_3d770284e59eac4ea27887425aff36c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_3d770284e59eac4ea27887425aff36c8.jpg not downloaded yet
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_bef4ffd2be923bf31997b7fc693a9e2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_bef4ffd2be923bf31997b7fc693a9e2a.jpg not downloaded yet
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4d%252F104d56e36cab306fd164fb85d99a34f9%252Fpa%252FAZ02782_71e8a1b576b560daf1b65670a5bbaf8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_71e8a1b576b560daf1b65670a5bbaf8a.jpg not downloaded yet
2026-03-28 18:44:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc with identifier: FZ76900
2026-03-28 18:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc with scrape type 1
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_26d0337459732f3993bbcf7b3325690a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_26d0337459732f3993bbcf7b3325690a.jpg not downloaded yet
2026-03-28 18:44:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b77d0>
2026-03-28 18:44:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9327b681-153a-562d-8df0-ab745809eac3/9327b681-153a-562d-8df0-ab745809eac3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F6d%252Fa16d26b86fd56321fdff4dd9e63e4500%252Fpa%252FYN89436_187421e3997c12a7e650e0ced983f1fd.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_187421e3997c12a7e650e0ced983f1fd.jpg saved to cache
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9327b681-153a-562d-8df0-ab745809eac3
2026-03-28 18:44:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458557ad0>
2026-03-28 18:44:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9327b681-153a-562d-8df0-ab745809eac3/9327b681-153a-562d-8df0-ab745809eac3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F6d%252Fa16d26b86fd56321fdff4dd9e63e4500%252Fpa%252FYN89436_0317c8c8a09568b41d9ccb7b92729a21.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_0317c8c8a09568b41d9ccb7b92729a21.jpg saved to cache
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9327b681-153a-562d-8df0-ab745809eac3
2026-03-28 18:44:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9327b681-153a-562d-8df0-ab745809eac3, skipping ID generation
2026-03-28 18:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9327b681-153a-562d-8df0-ab745809eac3 with scrape type 1
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9327b681-153a-562d-8df0-ab745809eac3 sending to next pipeline
2026-03-28 18:44:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9327b681-153a-562d-8df0-ab745809eac3, identifier: YN89436
2026-03-28 18:44:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_f197f6a0573b369f452b65cf87764cd4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_5f5aa3afca809c1ca83b526f48ce367a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_5f5aa3afca809c1ca83b526f48ce367a.jpg not downloaded yet
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4d%252F104d56e36cab306fd164fb85d99a34f9%252Fpa%252FAZ02782_7915d07ee15ee0d64af1f02153942747.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_7915d07ee15ee0d64af1f02153942747.jpg not downloaded yet
2026-03-28 18:44:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9327b681-153a-562d-8df0-ab745809eac3 with identifier: YN89436
2026-03-28 18:44:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9327b681-153a-562d-8df0-ab745809eac3 with identifier: YN89436
2026-03-28 18:44:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9327b681-153a-562d-8df0-ab745809eac3 with identifier: YN89436 to the API
2026-03-28 18:44:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_0317c8c8a09568b41d9ccb7b92729a21.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:32:00Z',
 'fuel_type': 'diesel',
 'id': '9327b681-153a-562d-8df0-ab745809eac3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN89436',
 'listing': 'auction',
 'location': 'DE, Dresden',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 118663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9327b681-153a-562d-8df0-ab745809eac3/9327b681-153a-562d-8df0-ab745809eac3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_44362d7ece38cd7a5be0158d5ea615ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9327b681-153a-562d-8df0-ab745809eac3/9327b681-153a-562d-8df0-ab745809eac3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_187421e3997c12a7e650e0ced983f1fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9327b681-153a-562d-8df0-ab745809eac3/9327b681-153a-562d-8df0-ab745809eac3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_0317c8c8a09568b41d9ccb7b92729a21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9327b681-153a-562d-8df0-ab745809eac3/9327b681-153a-562d-8df0-ab745809eac3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_f6e5ba1f9e6b621e110dcfbeb472a2db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9327b681-153a-562d-8df0-ab745809eac3/9327b681-153a-562d-8df0-ab745809eac3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_5ca10c69a5bfdedf1efe0a7d2083129d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9327b681-153a-562d-8df0-ab745809eac3/9327b681-153a-562d-8df0-ab745809eac3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/6d/a16d26b86fd56321fdff4dd9e63e4500/pa/YN89436_c0165ddec546ea23c5b00a2179f87295.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2008}
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN89436%27 HTTP/1.1" 200 None
2026-03-28 18:44:20 [auto1.de] INFO: Saving data for YN89436: {'created_time': 1774723460.21043, 'last_price_update_time': 1774723460.210441, 'auction_closing_time': 1774884720.0}
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN89436') HTTP/1.1" 204 0
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_3957eb03ce59d41695ab7041e88fb78d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_3957eb03ce59d41695ab7041e88fb78d.jpg not downloaded yet
2026-03-28 18:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_03e2716be5e9b56e961e1509e793d417.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_08e613b87f84a1bc7588a88c9e1ddfa8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_08e613b87f84a1bc7588a88c9e1ddfa8.jpg not downloaded yet
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4d%252F104d56e36cab306fd164fb85d99a34f9%252Fpa%252FAZ02782_3d23e65a14da504e431f315bb702adab.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_3d23e65a14da504e431f315bb702adab.jpg not downloaded yet
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_69e24a016fc4274917e663dd530798c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_69e24a016fc4274917e663dd530798c5.jpg not downloaded yet
2026-03-28 18:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_dbefca3df527fd8ae7515ca5e99fb3c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_dbefca3df527fd8ae7515ca5e99fb3c3.jpg not downloaded yet
2026-03-28 18:44:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458556e90>
2026-03-28 18:44:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F73%252F9573204e1b601d9357b64d851fc5d2e4%252Fpa%252FKJ41571_f197f6a0573b369f452b65cf87764cd4.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_f197f6a0573b369f452b65cf87764cd4.jpg saved to cache
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7722bd6c-f2c2-5e02-84b6-aa464062026e
2026-03-28 18:44:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7722bd6c-f2c2-5e02-84b6-aa464062026e, skipping ID generation
2026-03-28 18:44:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7722bd6c-f2c2-5e02-84b6-aa464062026e with scrape type 1
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7722bd6c-f2c2-5e02-84b6-aa464062026e sending to next pipeline
2026-03-28 18:44:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7722bd6c-f2c2-5e02-84b6-aa464062026e, identifier: KJ41571
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_48a4047357f72e0679c95b535bafdab9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_48a4047357f72e0679c95b535bafdab9.jpg not downloaded yet
2026-03-28 18:44:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7722bd6c-f2c2-5e02-84b6-aa464062026e with identifier: KJ41571
2026-03-28 18:44:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7722bd6c-f2c2-5e02-84b6-aa464062026e with identifier: KJ41571
2026-03-28 18:44:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7722bd6c-f2c2-5e02-84b6-aa464062026e with identifier: KJ41571 to the API
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_f197f6a0573b369f452b65cf87764cd4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': 'Rental',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:35:46Z',
 'fuel_type': 'diesel',
 'id': '7722bd6c-f2c2-5e02-84b6-aa464062026e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ41571',
 'listing': 'auction',
 'location': 'DE, Hof',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 236829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_f197f6a0573b369f452b65cf87764cd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2424615,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_5bcaa6fd8cb963503793cae25fb2f023.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_1d4da84c6865829fecf07a8c0038c1ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2363875,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_291f043ba5fb0480a8d939acb7844f93.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_ff3eb935472eb13e1116755685ec684e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_318597899999fa2dde7de2a24269749a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_ef76ca49e98402b7ded5d2aa3f834b6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_3b4bc091d7ce3835076fa5979efbdd11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491632,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_e9e5b0ee7bb3eb23650c524b6ae91a68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7722bd6c-f2c2-5e02-84b6-aa464062026e/7722bd6c-f2c2-5e02-84b6-aa464062026e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2227239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/73/9573204e1b601d9357b64d851fc5d2e4/pa/KJ41571_83a153d9de014ae1876b8f2fdc451132.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2013}
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ41571%27 HTTP/1.1" 200 None
2026-03-28 18:44:20 [auto1.de] INFO: Saving data for KJ41571: {'created_time': 1774723460.865846, 'last_price_update_time': 1774723460.865856, 'auction_closing_time': 1774884946.0}
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ41571') HTTP/1.1" 204 0
2026-03-28 18:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_bd488da64cdd98ccc7a08e2a47cbd218.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_534a3de68ef363409d4c9cd29ca6f9f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_534a3de68ef363409d4c9cd29ca6f9f6.jpg not downloaded yet
2026-03-28 18:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_53201795724d14d509c42ca489a474d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_93c7c73a2a7a6129c12b0ae310ea4204.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_93c7c73a2a7a6129c12b0ae310ea4204.jpg not downloaded yet
2026-03-28 18:44:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456274ed0>
2026-03-28 18:44:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_03e2716be5e9b56e961e1509e793d417.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_03e2716be5e9b56e961e1509e793d417.jpg saved to cache
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 915406a7-db45-5663-97f1-3654017a8211
2026-03-28 18:44:20 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 6010 | hits on page: 40
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_96acdd7ede441c8d9063b2de25ae3672.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_96acdd7ede441c8d9063b2de25ae3672.jpg not downloaded yet
2026-03-28 18:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_b8a5812fab31cbcaa542b58bfebbd7aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_2a023d2c1a01b70ceca700fdb8ed3ac5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_2a023d2c1a01b70ceca700fdb8ed3ac5.jpg not downloaded yet
2026-03-28 18:44:21 [auto1.de] INFO: Found listing with ID: AN23805
2026-03-28 18:44:21 [auto1.de] INFO: Found listing with ID: VL97674
2026-03-28 18:44:21 [auto1.de] INFO: Found listing with ID: UT78656
2026-03-28 18:44:21 [auto1.de] INFO: Found listing with ID: JE05181
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE05181%27 HTTP/1.1" 200 None
2026-03-28 18:44:21 [auto1.de] INFO: Scrape type for JE05181: 2
2026-03-28 18:44:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab669a74-303c-5a85-a8f6-f791c72f666d with identifier: JE05181
2026-03-28 18:44:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab669a74-303c-5a85-a8f6-f791c72f666d with scrape type 2
2026-03-28 18:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab669a74-303c-5a85-a8f6-f791c72f666d with scrape type 2
2026-03-28 18:44:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab669a74-303c-5a85-a8f6-f791c72f666d, identifier: JE05181
2026-03-28 18:44:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_78d23719d43a3d0febcb3a981c8dfa47.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_78d23719d43a3d0febcb3a981c8dfa47.jpg not downloaded yet
2026-03-28 18:44:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab669a74-303c-5a85-a8f6-f791c72f666d with identifier: JE05181
2026-03-28 18:44:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab669a74-303c-5a85-a8f6-f791c72f666d with identifier: JE05181
2026-03-28 18:44:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab669a74-303c-5a85-a8f6-f791c72f666d with identifier: JE05181 to the API
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:11:56Z',
 'fuel_type': 'diesel',
 'id': 'ab669a74-303c-5a85-a8f6-f791c72f666d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE05181',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 166995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-11',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE05181%27 HTTP/1.1" 200 None
2026-03-28 18:44:21 [auto1.de] INFO: Saving data for JE05181: {'auction_closing_time': 1774883516.0, 'created_time': 1773380136.14717, 'last_price_update_time': 1774723461.534102}
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE05181') HTTP/1.1" 204 0
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_4c90b6fecd00e22da2efecfc31d3d2c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_4c90b6fecd00e22da2efecfc31d3d2c1.jpg not downloaded yet
2026-03-28 18:44:21 [auto1.de] INFO: Found listing with ID: LZ68363
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ68363%27 HTTP/1.1" 200 None
2026-03-28 18:44:21 [auto1.de] INFO: Scrape type for LZ68363: 2
2026-03-28 18:44:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80c69c94-1789-5f50-abc3-8db0ad0290e2 with identifier: LZ68363
2026-03-28 18:44:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80c69c94-1789-5f50-abc3-8db0ad0290e2 with scrape type 2
2026-03-28 18:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80c69c94-1789-5f50-abc3-8db0ad0290e2 with scrape type 2
2026-03-28 18:44:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80c69c94-1789-5f50-abc3-8db0ad0290e2, identifier: LZ68363
2026-03-28 18:44:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_26d0337459732f3993bbcf7b3325690a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_7915d07ee15ee0d64af1f02153942747.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_816530c5efcba62e723a18e7b86b2706.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_816530c5efcba62e723a18e7b86b2706.jpg not downloaded yet
2026-03-28 18:44:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80c69c94-1789-5f50-abc3-8db0ad0290e2 with identifier: LZ68363
2026-03-28 18:44:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80c69c94-1789-5f50-abc3-8db0ad0290e2 with identifier: LZ68363
2026-03-28 18:44:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80c69c94-1789-5f50-abc3-8db0ad0290e2 with identifier: LZ68363 to the API
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:05:07Z',
 'fuel_type': 'petrol',
 'id': '80c69c94-1789-5f50-abc3-8db0ad0290e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ68363',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 65951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seller_name': None,
 'title': 'MINI Clubman John Cooper Works ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2021}
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ68363%27 HTTP/1.1" 200 None
2026-03-28 18:44:22 [auto1.de] INFO: Saving data for LZ68363: {'auction_closing_time': 1774883107.0, 'created_time': 1773400625.874955, 'last_price_update_time': 1774723462.029268}
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ68363') HTTP/1.1" 204 0
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456058c90>
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_bd488da64cdd98ccc7a08e2a47cbd218.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_bd488da64cdd98ccc7a08e2a47cbd218.jpg saved to cache
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 915406a7-db45-5663-97f1-3654017a8211
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477ca50>
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F14%252F29140cab033144841ac0e52e2a717bae%252Fpa%252FXH28612_53201795724d14d509c42ca489a474d4.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_53201795724d14d509c42ca489a474d4.jpg saved to cache
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 915406a7-db45-5663-97f1-3654017a8211
2026-03-28 18:44:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 915406a7-db45-5663-97f1-3654017a8211, skipping ID generation
2026-03-28 18:44:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915406a7-db45-5663-97f1-3654017a8211 with scrape type 1
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 915406a7-db45-5663-97f1-3654017a8211 sending to next pipeline
2026-03-28 18:44:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 915406a7-db45-5663-97f1-3654017a8211, identifier: XH28612
2026-03-28 18:44:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456306c90>
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_b8a5812fab31cbcaa542b58bfebbd7aa.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_b8a5812fab31cbcaa542b58bfebbd7aa.jpg saved to cache
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c67b7d7-20b7-5df0-994d-362db3f12f42
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_90e1e9c622b3f6d038068388ca07d3cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_90e1e9c622b3f6d038068388ca07d3cd.jpg not downloaded yet
2026-03-28 18:44:22 [auto1.de] INFO: Found listing with ID: RT81127
2026-03-28 18:44:22 [auto1.de] INFO: Found listing with ID: XL66615
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL66615%27 HTTP/1.1" 200 None
2026-03-28 18:44:22 [auto1.de] INFO: Scrape type for XL66615: 1
2026-03-28 18:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK31693> (referer: https://www.auto1.com/v1/car-details-view/WK31693/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 915406a7-db45-5663-97f1-3654017a8211 with identifier: XH28612
2026-03-28 18:44:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 915406a7-db45-5663-97f1-3654017a8211 with identifier: XH28612
2026-03-28 18:44:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 915406a7-db45-5663-97f1-3654017a8211 with identifier: XH28612 to the API
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_53201795724d14d509c42ca489a474d4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 356,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '4.4L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:29:45Z',
 'fuel_type': 'petrol',
 'id': '915406a7-db45-5663-97f1-3654017a8211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH28612',
 'listing': 'auction',
 'location': 'DE, Rosenheim',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 240037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_53201795724d14d509c42ca489a474d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_bd488da64cdd98ccc7a08e2a47cbd218.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_f03ec2beabb252a6ee3ee712b6b2c30b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_bd8055472af6b4aa617c28875829996b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2733699,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_be17d55b39f50ccca72224cc9c5b401c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2870135,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_da02769a1732998b369a9cb8e2ed21c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_b0f7fd71596f250f0915273bd837b333.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_4a5e056bef3cfb22e62f3b8aea0f0332.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_03e2716be5e9b56e961e1509e793d417.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915406a7-db45-5663-97f1-3654017a8211/915406a7-db45-5663-97f1-3654017a8211_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2873985,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/14/29140cab033144841ac0e52e2a717bae/pa/XH28612_868891579a84ba64f8a1c3b0ff8b4a1a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 4.4 V8 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2005}
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH28612%27 HTTP/1.1" 200 None
2026-03-28 18:44:22 [auto1.de] INFO: Saving data for XH28612: {'created_time': 1774723462.804829, 'last_price_update_time': 1774723462.80484, 'auction_closing_time': 1774884585.0}
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH28612') HTTP/1.1" 204 0
2026-03-28 18:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_3d23e65a14da504e431f315bb702adab.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_ae3a5e979f8d0f71095b3122c6478784.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_ae3a5e979f8d0f71095b3122c6478784.jpg not downloaded yet
2026-03-28 18:44:22 [auto1.de] INFO: Found listing with ID: KK21790
2026-03-28 18:44:22 [auto1.de] INFO: Found listing with ID: TV45930
2026-03-28 18:44:22 [auto1.de] INFO: Found listing with ID: DZ20117
2026-03-28 18:44:22 [auto1.de] INFO: Found listing with ID: BR60141
2026-03-28 18:44:22 [auto1.de] INFO: Found listing with ID: UA53111
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53111%27 HTTP/1.1" 200 None
2026-03-28 18:44:22 [auto1.de] INFO: Scrape type for UA53111: 1
2026-03-28 18:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZY32657> (referer: https://www.auto1.com/v1/car-details-view/ZY32657/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456337a90>
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_26d0337459732f3993bbcf7b3325690a.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_26d0337459732f3993bbcf7b3325690a.jpg saved to cache
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b71d0>
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b96697-f0d5-51a2-99bd-a75d924e95ad/83b96697-f0d5-51a2-99bd-a75d924e95ad_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4d%252F104d56e36cab306fd164fb85d99a34f9%252Fpa%252FAZ02782_7915d07ee15ee0d64af1f02153942747.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_7915d07ee15ee0d64af1f02153942747.jpg saved to cache
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83b96697-f0d5-51a2-99bd-a75d924e95ad
2026-03-28 18:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_dbefca3df527fd8ae7515ca5e99fb3c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_48a4047357f72e0679c95b535bafdab9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU80535> (referer: https://www.auto1.com/v1/car-details-view/PU80535/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_883299ad3b9772ea96d50c4c17b2b37d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_883299ad3b9772ea96d50c4c17b2b37d.jpg not downloaded yet
2026-03-28 18:44:22 [auto1.de] INFO: Found listing with ID: YA36470
2026-03-28 18:44:22 [auto1.de] INFO: Found listing with ID: VR29597
2026-03-28 18:44:22 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-28 18:44:22 [auto1.de] INFO: Found listing with ID: ZX19467
2026-03-28 18:44:22 [auto1.de] INFO: Found listing with ID: PL33602
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL33602%27 HTTP/1.1" 200 None
2026-03-28 18:44:22 [auto1.de] INFO: Scrape type for PL33602: 1
2026-03-28 18:44:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f47b5984-7d4f-554a-b492-9773e9944a4c with identifier: WK31693
2026-03-28 18:44:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f47b5984-7d4f-554a-b492-9773e9944a4c with scrape type 1
2026-03-28 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-03-28 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_5529af265835508bae7a663eac37ad04.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_5529af265835508bae7a663eac37ad04.jpg not downloaded yet
2026-03-28 18:44:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563f4590>
2026-03-28 18:44:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b96697-f0d5-51a2-99bd-a75d924e95ad/83b96697-f0d5-51a2-99bd-a75d924e95ad_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4d%252F104d56e36cab306fd164fb85d99a34f9%252Fpa%252FAZ02782_3d23e65a14da504e431f315bb702adab.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_3d23e65a14da504e431f315bb702adab.jpg saved to cache
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83b96697-f0d5-51a2-99bd-a75d924e95ad
2026-03-28 18:44:23 [auto1.de] INFO: Found listing with ID: BC54503
2026-03-28 18:44:23 [auto1.de] INFO: Found listing with ID: SN24216
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN24216%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [auto1.de] INFO: Scrape type for SN24216: 2
2026-03-28 18:44:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 083f99fc-1d09-523b-b4c0-2841d2eb805d with identifier: SN24216
2026-03-28 18:44:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 083f99fc-1d09-523b-b4c0-2841d2eb805d with scrape type 2
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 083f99fc-1d09-523b-b4c0-2841d2eb805d with scrape type 2
2026-03-28 18:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 083f99fc-1d09-523b-b4c0-2841d2eb805d, identifier: SN24216
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_d5ddcc7bdeb7e0f1b800465c56236838.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_d5ddcc7bdeb7e0f1b800465c56236838.jpg not downloaded yet
2026-03-28 18:44:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 083f99fc-1d09-523b-b4c0-2841d2eb805d with identifier: SN24216
2026-03-28 18:44:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 083f99fc-1d09-523b-b4c0-2841d2eb805d with identifier: SN24216
2026-03-28 18:44:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 083f99fc-1d09-523b-b4c0-2841d2eb805d with identifier: SN24216 to the API
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 285,
 'expiration_date': '2026-03-30T15:58:40Z',
 'fuel_type': 'diesel',
 'id': '083f99fc-1d09-523b-b4c0-2841d2eb805d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN24216',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 358594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-05',
 'seller_name': None,
 'title': 'BMW 5er 535d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN24216%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [auto1.de] INFO: Saving data for SN24216: {'auction_closing_time': 1774886320.0, 'created_time': 1774034533.735024, 'last_price_update_time': 1774723463.559833}
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN24216') HTTP/1.1" 204 0
2026-03-28 18:44:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9567e7f1-df59-575f-b013-ae275086f652 with identifier: ZY32657
2026-03-28 18:44:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9567e7f1-df59-575f-b013-ae275086f652 with scrape type 1
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9567e7f1-df59-575f-b013-ae275086f652
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F13%252F1a13338c4ec1fdfcc0354022df46b066%252Fpa%252FZY32657_eacce75203af249c2b407fb0b944faac.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_eacce75203af249c2b407fb0b944faac.jpg not downloaded yet
2026-03-28 18:44:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_6ac665f52472332cc7caceb6e8679a9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:23 [auto1.de] INFO: Found listing with ID: PR44802
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR44802%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [auto1.de] INFO: Scrape type for PR44802: 1
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_2196f3a5bc8f79a4f0842a96a1b72401.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2196f3a5bc8f79a4f0842a96a1b72401.jpg not downloaded yet
2026-03-28 18:44:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_90e1e9c622b3f6d038068388ca07d3cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_2a023d2c1a01b70ceca700fdb8ed3ac5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F13%252F1a13338c4ec1fdfcc0354022df46b066%252Fpa%252FZY32657_79372545c897b8b0800fe3c1a3fd35b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_79372545c897b8b0800fe3c1a3fd35b7.jpg not downloaded yet
2026-03-28 18:44:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245620c710>
2026-03-28 18:44:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_dbefca3df527fd8ae7515ca5e99fb3c3.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_dbefca3df527fd8ae7515ca5e99fb3c3.jpg saved to cache
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1
2026-03-28 18:44:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563c1c90>
2026-03-28 18:44:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_48a4047357f72e0679c95b535bafdab9.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_48a4047357f72e0679c95b535bafdab9.jpg saved to cache
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc
2026-03-28 18:44:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f16dab28-6f90-57a5-aab9-cb6e0853871b with identifier: PU80535
2026-03-28 18:44:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f16dab28-6f90-57a5-aab9-cb6e0853871b with scrape type 1
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f16dab28-6f90-57a5-aab9-cb6e0853871b
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Faa%252Fdfaa7ddc472afefd7e092d12b01824f7%252Fpa%252FPU80535_b90819d56729070cd3c6602f7f966b8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_b90819d56729070cd3c6602f7f966b8b.jpg already downloaded
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Faa%252Fdfaa7ddc472afefd7e092d12b01824f7%252Fpa%252FPU80535_ef5910c05dd8378183b8f52d97723f02.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_ef5910c05dd8378183b8f52d97723f02.jpg already downloaded
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Faa%252Fdfaa7ddc472afefd7e092d12b01824f7%252Fpa%252FPU80535_a42ada98f65e8664f2c735b3dd2195f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_a42ada98f65e8664f2c735b3dd2195f9.jpg already downloaded
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Faa%252Fdfaa7ddc472afefd7e092d12b01824f7%252Fpa%252FPU80535_f69b1bbf1e6aae952aa157ac10d476a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_f69b1bbf1e6aae952aa157ac10d476a6.jpg already downloaded
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Faa%252Fdfaa7ddc472afefd7e092d12b01824f7%252Fpa%252FPU80535_43e9c1fe99141791a95991b6871061eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_43e9c1fe99141791a95991b6871061eb.jpg already downloaded
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Faa%252Fdfaa7ddc472afefd7e092d12b01824f7%252Fpa%252FPU80535_13d76c4e713d8a2963840be0b810beee.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_13d76c4e713d8a2963840be0b810beee.jpg already downloaded
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Faa%252Fdfaa7ddc472afefd7e092d12b01824f7%252Fpa%252FPU80535_cfb1ecc90fafcccc859439d0a67414fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_cfb1ecc90fafcccc859439d0a67414fb.jpg already downloaded
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Faa%252Fdfaa7ddc472afefd7e092d12b01824f7%252Fpa%252FPU80535_75798f3bcb442ec24d09f5971ec261b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_75798f3bcb442ec24d09f5971ec261b7.jpg already downloaded
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Faa%252Fdfaa7ddc472afefd7e092d12b01824f7%252Fpa%252FPU80535_b865defd24c40499664b76c4bd5ad45f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_b865defd24c40499664b76c4bd5ad45f.jpg already downloaded
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Faa%252Fdfaa7ddc472afefd7e092d12b01824f7%252Fpa%252FPU80535_5e0dd550fa04bf419954fa5752621bf1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_5e0dd550fa04bf419954fa5752621bf1.jpg already downloaded
2026-03-28 18:44:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f16dab28-6f90-57a5-aab9-cb6e0853871b, identifier: PU80535
2026-03-28 18:44:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_1c84afb21d54e2bb8f9e4bef7437b6c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:24 [auto1.de] INFO: Found listing with ID: YR75150
2026-03-28 18:44:24 [auto1.de] INFO: Found listing with ID: TP97389
2026-03-28 18:44:24 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-28 18:44:24 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-28 18:44:24 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ49270%27 HTTP/1.1" 200 None
2026-03-28 18:44:24 [auto1.de] INFO: Scrape type for KJ49270: 1
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_001dd3efd52ad70136d95ff3f99cc240.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_001dd3efd52ad70136d95ff3f99cc240.jpg not downloaded yet
2026-03-28 18:44:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f16dab28-6f90-57a5-aab9-cb6e0853871b with identifier: PU80535
2026-03-28 18:44:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f16dab28-6f90-57a5-aab9-cb6e0853871b with identifier: PU80535
2026-03-28 18:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f16dab28-6f90-57a5-aab9-cb6e0853871b with identifier: PU80535 to the API
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PU80535>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:15:13Z',
 'fuel_type': 'gas',
 'id': 'f16dab28-6f90-57a5-aab9-cb6e0853871b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU80535',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 118896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_b90819d56729070cd3c6602f7f966b8b.jpg',
                'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_ef5910c05dd8378183b8f52d97723f02.jpg',
                'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_a42ada98f65e8664f2c735b3dd2195f9.jpg',
                'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_f69b1bbf1e6aae952aa157ac10d476a6.jpg',
                'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_43e9c1fe99141791a95991b6871061eb.jpg',
                'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_13d76c4e713d8a2963840be0b810beee.jpg',
                'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_cfb1ecc90fafcccc859439d0a67414fb.jpg',
                'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_75798f3bcb442ec24d09f5971ec261b7.jpg',
                'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_b865defd24c40499664b76c4bd5ad45f.jpg',
                'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_5e0dd550fa04bf419954fa5752621bf1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f16dab28-6f90-57a5-aab9-cb6e0853871b/f16dab28-6f90-57a5-aab9-cb6e0853871b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_b90819d56729070cd3c6602f7f966b8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f16dab28-6f90-57a5-aab9-cb6e0853871b/f16dab28-6f90-57a5-aab9-cb6e0853871b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2725172,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_ef5910c05dd8378183b8f52d97723f02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f16dab28-6f90-57a5-aab9-cb6e0853871b/f16dab28-6f90-57a5-aab9-cb6e0853871b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2602918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_a42ada98f65e8664f2c735b3dd2195f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f16dab28-6f90-57a5-aab9-cb6e0853871b/f16dab28-6f90-57a5-aab9-cb6e0853871b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2610084,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_f69b1bbf1e6aae952aa157ac10d476a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f16dab28-6f90-57a5-aab9-cb6e0853871b/f16dab28-6f90-57a5-aab9-cb6e0853871b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_43e9c1fe99141791a95991b6871061eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f16dab28-6f90-57a5-aab9-cb6e0853871b/f16dab28-6f90-57a5-aab9-cb6e0853871b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2658669,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_13d76c4e713d8a2963840be0b810beee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f16dab28-6f90-57a5-aab9-cb6e0853871b/f16dab28-6f90-57a5-aab9-cb6e0853871b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2551290,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_cfb1ecc90fafcccc859439d0a67414fb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f16dab28-6f90-57a5-aab9-cb6e0853871b/f16dab28-6f90-57a5-aab9-cb6e0853871b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_75798f3bcb442ec24d09f5971ec261b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f16dab28-6f90-57a5-aab9-cb6e0853871b/f16dab28-6f90-57a5-aab9-cb6e0853871b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2870763,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_b865defd24c40499664b76c4bd5ad45f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f16dab28-6f90-57a5-aab9-cb6e0853871b/f16dab28-6f90-57a5-aab9-cb6e0853871b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2771237,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/aa/dfaa7ddc472afefd7e092d12b01824f7/pa/PU80535_5e0dd550fa04bf419954fa5752621bf1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.5 TGI Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2019}
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU80535%27 HTTP/1.1" 200 None
2026-03-28 18:44:24 [auto1.de] INFO: Saving data for PU80535: {'created_time': 1774723464.44285, 'last_price_update_time': 1774723464.442861, 'auction_closing_time': 1774883713.0}
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU80535') HTTP/1.1" 204 0
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F13%252F1a13338c4ec1fdfcc0354022df46b066%252Fpa%252FZY32657_fca6934f8087b118ffd0e73957e77b27.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_fca6934f8087b118ffd0e73957e77b27.jpg not downloaded yet
2026-03-28 18:44:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_96acdd7ede441c8d9063b2de25ae3672.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:24 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD15058%27 HTTP/1.1" 200 None
2026-03-28 18:44:24 [auto1.de] INFO: Scrape type for ZD15058: 2
2026-03-28 18:44:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd2f9cbb-223f-5f8b-8ee5-2863563118b2 with identifier: ZD15058
2026-03-28 18:44:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd2f9cbb-223f-5f8b-8ee5-2863563118b2 with scrape type 2
2026-03-28 18:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd2f9cbb-223f-5f8b-8ee5-2863563118b2 with scrape type 2
2026-03-28 18:44:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd2f9cbb-223f-5f8b-8ee5-2863563118b2, identifier: ZD15058
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_9d6c9377d74dd80ff373b4f5d9a9ca5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_9d6c9377d74dd80ff373b4f5d9a9ca5b.jpg not downloaded yet
2026-03-28 18:44:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_2a8d68a054a02d4003aaab86cb573784.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_4c90b6fecd00e22da2efecfc31d3d2c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd2f9cbb-223f-5f8b-8ee5-2863563118b2 with identifier: ZD15058
2026-03-28 18:44:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd2f9cbb-223f-5f8b-8ee5-2863563118b2 with identifier: ZD15058
2026-03-28 18:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd2f9cbb-223f-5f8b-8ee5-2863563118b2 with identifier: ZD15058 to the API
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:16:13Z',
 'fuel_type': 'diesel',
 'id': 'cd2f9cbb-223f-5f8b-8ee5-2863563118b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD15058',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 57454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-18',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L3H1 3,5t',
 'transmission': 'manual',
 'trim': 'L3H1 3,5t',
 'year': 2017}
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD15058%27 HTTP/1.1" 200 None
2026-03-28 18:44:24 [auto1.de] INFO: Saving data for ZD15058: {'auction_closing_time': 1774883773.0, 'created_time': 1774350136.132089, 'last_price_update_time': 1774723464.969499}
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD15058') HTTP/1.1" 204 0
2026-03-28 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F13%252F1a13338c4ec1fdfcc0354022df46b066%252Fpa%252FZY32657_cc53463b98474b1af53baae47328f993.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_cc53463b98474b1af53baae47328f993.jpg not downloaded yet
2026-03-28 18:44:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_cad6c166d6987c4aead95a2c1850b104.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:25 [auto1.de] INFO: Found listing with ID: PH13735
2026-03-28 18:44:25 [auto1.de] INFO: Found listing with ID: NR79425
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR79425%27 HTTP/1.1" 200 None
2026-03-28 18:44:25 [auto1.de] INFO: Scrape type for NR79425: 1
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_6d954ea87f25d6a05efac9e766b2b208.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6d954ea87f25d6a05efac9e766b2b208.jpg not downloaded yet
2026-03-28 18:44:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b3850>
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_6ac665f52472332cc7caceb6e8679a9c.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_6ac665f52472332cc7caceb6e8679a9c.jpg saved to cache
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c67b7d7-20b7-5df0-994d-362db3f12f42
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458558850>
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_90e1e9c622b3f6d038068388ca07d3cd.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_90e1e9c622b3f6d038068388ca07d3cd.jpg saved to cache
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563f6f10>
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_2a023d2c1a01b70ceca700fdb8ed3ac5.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_2a023d2c1a01b70ceca700fdb8ed3ac5.jpg saved to cache
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc
2026-03-28 18:44:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855bd10>
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_1c84afb21d54e2bb8f9e4bef7437b6c5.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_1c84afb21d54e2bb8f9e4bef7437b6c5.jpg saved to cache
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F13%252F1a13338c4ec1fdfcc0354022df46b066%252Fpa%252FZY32657_0cc64c84233daed39fe9d9d73ff719a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_0cc64c84233daed39fe9d9d73ff719a7.jpg not downloaded yet
2026-03-28 18:44:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_eacce75203af249c2b407fb0b944faac.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:25 [auto1.de] INFO: Found listing with ID: CY46145
2026-03-28 18:44:25 [auto1.de] INFO: Found listing with ID: NC58057
2026-03-28 18:44:25 [auto1.de] INFO: Found listing with ID: UF03546
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF03546%27 HTTP/1.1" 200 None
2026-03-28 18:44:25 [auto1.de] INFO: Scrape type for UF03546: 1
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_6723bdd675148afd2a830196bfc76895.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6723bdd675148afd2a830196bfc76895.jpg not downloaded yet
2026-03-28 18:44:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL75454> (referer: https://www.auto1.com/v1/car-details-view/RL75454/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL66615/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA53111/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561bd4d0>
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_96acdd7ede441c8d9063b2de25ae3672.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_96acdd7ede441c8d9063b2de25ae3672.jpg saved to cache
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1
2026-03-28 18:44:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456412790>
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_2a8d68a054a02d4003aaab86cb573784.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_2a8d68a054a02d4003aaab86cb573784.jpg saved to cache
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c67b7d7-20b7-5df0-994d-362db3f12f42
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245611aad0>
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_4c90b6fecd00e22da2efecfc31d3d2c1.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_4c90b6fecd00e22da2efecfc31d3d2c1.jpg saved to cache
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc
2026-03-28 18:44:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456296ad0>
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F31%252F98313f0c2a6ed06f913414f49041a16e%252Fpa%252FTK68896_cad6c166d6987c4aead95a2c1850b104.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_cad6c166d6987c4aead95a2c1850b104.jpg saved to cache
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2
2026-03-28 18:44:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2, skipping ID generation
2026-03-28 18:44:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2 with scrape type 1
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2 sending to next pipeline
2026-03-28 18:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2, identifier: TK68896
2026-03-28 18:44:25 [auto1.de] INFO: Found listing with ID: TF03370
2026-03-28 18:44:25 [auto1.de] INFO: Found listing with ID: WU29396
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU29396%27 HTTP/1.1" 200 None
2026-03-28 18:44:25 [auto1.de] INFO: Scrape type for WU29396: 1
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_74f5a606a97e7e9f9f98b562562be4ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_74f5a606a97e7e9f9f98b562562be4ce.jpg not downloaded yet
2026-03-28 18:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2 with identifier: TK68896
2026-03-28 18:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2 with identifier: TK68896
2026-03-28 18:44:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2 with identifier: TK68896 to the API
2026-03-28 18:44:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_cad6c166d6987c4aead95a2c1850b104.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:56:41Z',
 'fuel_type': 'diesel',
 'id': '7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK68896',
 'listing': 'auction',
 'location': 'DE, Pforzheim',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 114581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2687815,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_96b468794a6dc672748f5bbc6770546d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_80148ef47f263df230319d4d3bc7d84d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2657581,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_1c84afb21d54e2bb8f9e4bef7437b6c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2904648,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_cad6c166d6987c4aead95a2c1850b104.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_e2f8637f875dccd99782ff0880fccd49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_4555d55c17f778bc45a0f42bc76e185f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_d3535863451ae26afd2d66a6703004ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_040c0c50c630c1cdb2c67108759a85cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_c98e49e01874682aa904fa7d3a655517.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2/7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3125407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/31/98313f0c2a6ed06f913414f49041a16e/pa/TK68896_aba4d5a19c53780f748c49926502133d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK68896%27 HTTP/1.1" 200 None
2026-03-28 18:44:26 [auto1.de] INFO: Saving data for TK68896: {'created_time': 1774723466.250471, 'last_price_update_time': 1774723466.250483, 'auction_closing_time': 1774886201.0}
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK68896') HTTP/1.1" 204 0
2026-03-28 18:44:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_2bf2c1ff597b3c1e0ce423c26fad9194.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:26 [auto1.de] INFO: Found listing with ID: FF37262
2026-03-28 18:44:26 [auto1.de] INFO: Found listing with ID: UL28707
2026-03-28 18:44:26 [auto1.de] INFO: Found listing with ID: LM47126
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM47126%27 HTTP/1.1" 200 None
2026-03-28 18:44:26 [auto1.de] INFO: Scrape type for LM47126: 1
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_2be1cf2204621f75525f828a6d5b94e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2be1cf2204621f75525f828a6d5b94e2.jpg not downloaded yet
2026-03-28 18:44:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547a3e50>
2026-03-28 18:44:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9567e7f1-df59-575f-b013-ae275086f652/9567e7f1-df59-575f-b013-ae275086f652_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F13%252F1a13338c4ec1fdfcc0354022df46b066%252Fpa%252FZY32657_eacce75203af249c2b407fb0b944faac.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_eacce75203af249c2b407fb0b944faac.jpg saved to cache
2026-03-28 18:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9567e7f1-df59-575f-b013-ae275086f652
2026-03-28 18:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e17c68c-c8d9-5f6f-a16e-b92948f10512 with identifier: RL75454
2026-03-28 18:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512 with scrape type 1
2026-03-28 18:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_a93a9f2a3a62aab1d6bee03d473f5a19.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_a93a9f2a3a62aab1d6bee03d473f5a19.jpg not downloaded yet
2026-03-28 18:44:26 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 6011 | hits on page: 40
2026-03-28 18:44:26 [auto1.de] INFO: Found listing with ID: FR17679
2026-03-28 18:44:26 [auto1.de] INFO: Found listing with ID: XG50299
2026-03-28 18:44:26 [auto1.de] INFO: Found listing with ID: MU09493
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU09493%27 HTTP/1.1" 200 None
2026-03-28 18:44:26 [auto1.de] INFO: Scrape type for MU09493: 1
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_f2acc4c1e382e515519e8b19c104ebc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_f2acc4c1e382e515519e8b19c104ebc5.jpg not downloaded yet
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_78bb9fa8497e8c794898a41b250e6e51.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_78bb9fa8497e8c794898a41b250e6e51.jpg not downloaded yet
2026-03-28 18:44:26 [auto1.de] INFO: Found listing with ID: VR85555
2026-03-28 18:44:26 [auto1.de] INFO: Found listing with ID: VB32886
2026-03-28 18:44:26 [auto1.de] INFO: Found listing with ID: EF60589
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF60589%27 HTTP/1.1" 200 None
2026-03-28 18:44:26 [auto1.de] INFO: Scrape type for EF60589: 2
2026-03-28 18:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0fb22f0-b1ef-5d14-8cd8-5209b62b7871 with identifier: EF60589
2026-03-28 18:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0fb22f0-b1ef-5d14-8cd8-5209b62b7871 with scrape type 2
2026-03-28 18:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0fb22f0-b1ef-5d14-8cd8-5209b62b7871 with scrape type 2
2026-03-28 18:44:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0fb22f0-b1ef-5d14-8cd8-5209b62b7871, identifier: EF60589
2026-03-28 18:44:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0fb22f0-b1ef-5d14-8cd8-5209b62b7871 with identifier: EF60589
2026-03-28 18:44:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0fb22f0-b1ef-5d14-8cd8-5209b62b7871 with identifier: EF60589
2026-03-28 18:44:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0fb22f0-b1ef-5d14-8cd8-5209b62b7871 with identifier: EF60589 to the API
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:46:11Z',
 'fuel_type': 'diesel',
 'id': 'e0fb22f0-b1ef-5d14-8cd8-5209b62b7871',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF60589',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 176074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-05',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Dynamic Start/Stop',
 'transmission': 'manual',
 'trim': 'Dynamic Start/Stop',
 'year': 2017}
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF60589%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [auto1.de] INFO: Saving data for EF60589: {'auction_closing_time': 1774885571.0, 'created_time': 1774350291.629463, 'last_price_update_time': 1774723467.054041}
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF60589') HTTP/1.1" 204 0
2026-03-28 18:44:27 [auto1.de] INFO: Found listing with ID: VR85555
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_9b201b216b36c75b6637c6ef9f3e2a38.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_9b201b216b36c75b6637c6ef9f3e2a38.jpg not downloaded yet
2026-03-28 18:44:27 [auto1.de] INFO: Found listing with ID: MR72428
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72428%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [auto1.de] INFO: Scrape type for MR72428: 1
2026-03-28 18:44:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245610d790>
2026-03-28 18:44:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252Fa4%252F25a41ad1b664948cca5fe700750e7873%252Fpa%252FYW86530_2bf2c1ff597b3c1e0ce423c26fad9194.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_2bf2c1ff597b3c1e0ce423c26fad9194.jpg saved to cache
2026-03-28 18:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c67b7d7-20b7-5df0-994d-362db3f12f42
2026-03-28 18:44:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c67b7d7-20b7-5df0-994d-362db3f12f42, skipping ID generation
2026-03-28 18:44:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c67b7d7-20b7-5df0-994d-362db3f12f42 with scrape type 1
2026-03-28 18:44:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c67b7d7-20b7-5df0-994d-362db3f12f42 sending to next pipeline
2026-03-28 18:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c67b7d7-20b7-5df0-994d-362db3f12f42, identifier: YW86530
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_6f83cc7785f26a1a22afddbc99391ca1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_6f83cc7785f26a1a22afddbc99391ca1.jpg not downloaded yet
2026-03-28 18:44:27 [auto1.de] INFO: Found listing with ID: UT14776
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT14776%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [auto1.de] INFO: Scrape type for UT14776: 1
2026-03-28 18:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c67b7d7-20b7-5df0-994d-362db3f12f42 with identifier: YW86530
2026-03-28 18:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c67b7d7-20b7-5df0-994d-362db3f12f42 with identifier: YW86530
2026-03-28 18:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c67b7d7-20b7-5df0-994d-362db3f12f42 with identifier: YW86530 to the API
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_2bf2c1ff597b3c1e0ce423c26fad9194.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:17:10Z',
 'fuel_type': 'diesel',
 'id': '4c67b7d7-20b7-5df0-994d-362db3f12f42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW86530',
 'listing': 'auction',
 'location': 'DE, Gelsenkirchen',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 293583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2641238,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_525f0a58de5a8ca33cf2d4b4c96df19e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2734551,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_2bf2c1ff597b3c1e0ce423c26fad9194.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_31322484495c18f8a9c5409b8d69d854.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857725,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_2a8d68a054a02d4003aaab86cb573784.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2623229,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_6ac665f52472332cc7caceb6e8679a9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2545838,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_b8a5812fab31cbcaa542b58bfebbd7aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2720055,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_a700701676c665c1b6d6b072808cfa4f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_1b22dbc7597465746645a53eef2904d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_eb8630524b6e4eb4aa58e175a3e098fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c67b7d7-20b7-5df0-994d-362db3f12f42/4c67b7d7-20b7-5df0-994d-362db3f12f42_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2825967,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/a4/25a41ad1b664948cca5fe700750e7873/pa/YW86530_5ed9786a54519f5fa4cf11103ea51ec3.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW86530%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [auto1.de] INFO: Saving data for YW86530: {'created_time': 1774723467.682235, 'last_price_update_time': 1774723467.682245, 'auction_closing_time': 1774883830.0}
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW86530') HTTP/1.1" 204 0
2026-03-28 18:44:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_a93a9f2a3a62aab1d6bee03d473f5a19.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_74f5a606a97e7e9f9f98b562562be4ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_5a62d3782a5dbf49aafc9a1028f08a3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_5a62d3782a5dbf49aafc9a1028f08a3a.jpg not downloaded yet
2026-03-28 18:44:27 [auto1.de] INFO: Found listing with ID: DC55349
2026-03-28 18:44:27 [auto1.de] INFO: Found listing with ID: LR58414
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR58414%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [auto1.de] INFO: Scrape type for LR58414: 1
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_a7b811a2e6bfa704a9da1c8e97f3667c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_a7b811a2e6bfa704a9da1c8e97f3667c.jpg not downloaded yet
2026-03-28 18:44:27 [auto1.de] INFO: Found listing with ID: HM04559
2026-03-28 18:44:27 [auto1.de] INFO: Found listing with ID: EN17555
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN17555%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [auto1.de] INFO: Scrape type for EN17555: 1
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_12f0db4e83950dac10d1627662fd9603.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_12f0db4e83950dac10d1627662fd9603.jpg not downloaded yet
2026-03-28 18:44:27 [auto1.de] INFO: Found listing with ID: HN29475
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN29475%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [auto1.de] INFO: Scrape type for HN29475: 1
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_e8eab9b86bae44ad0f9396522c4f3ce9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_e8eab9b86bae44ad0f9396522c4f3ce9.jpg not downloaded yet
2026-03-28 18:44:27 [auto1.de] INFO: Found listing with ID: UY60901
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY60901%27 HTTP/1.1" 200 None
2026-03-28 18:44:27 [auto1.de] INFO: Scrape type for UY60901: 1
2026-03-28 18:44:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475ae90>
2026-03-28 18:44:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_a93a9f2a3a62aab1d6bee03d473f5a19.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_a93a9f2a3a62aab1d6bee03d473f5a19.jpg saved to cache
2026-03-28 18:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_25e22a8adcea53dbc411ba3f0fb6cf02.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_25e22a8adcea53dbc411ba3f0fb6cf02.jpg not downloaded yet
2026-03-28 18:44:28 [auto1.de] INFO: Found listing with ID: BE81625
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE81625%27 HTTP/1.1" 200 None
2026-03-28 18:44:28 [auto1.de] INFO: Scrape type for BE81625: 1
2026-03-28 18:44:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456060650>
2026-03-28 18:44:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_74f5a606a97e7e9f9f98b562562be4ce.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_74f5a606a97e7e9f9f98b562562be4ce.jpg saved to cache
2026-03-28 18:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-03-28 18:44:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_0cc64c84233daed39fe9d9d73ff719a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_47f8acb6b254a83c0d60dba94d5e11ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_47f8acb6b254a83c0d60dba94d5e11ca.jpg not downloaded yet
2026-03-28 18:44:28 [auto1.de] INFO: Found listing with ID: CE21106
2026-03-28 18:44:28 [auto1.de] INFO: Found listing with ID: GY94515
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY94515%27 HTTP/1.1" 200 None
2026-03-28 18:44:28 [auto1.de] INFO: Scrape type for GY94515: 1
2026-03-28 18:44:28 [auto1.de] INFO: Found listing with ID: LM12575
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM12575%27 HTTP/1.1" 200 None
2026-03-28 18:44:28 [auto1.de] INFO: Scrape type for LM12575: 1
2026-03-28 18:44:28 [auto1.de] INFO: Found listing with ID: CV44457
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV44457%27 HTTP/1.1" 200 None
2026-03-28 18:44:28 [auto1.de] INFO: Scrape type for CV44457: 1
2026-03-28 18:44:28 [auto1.de] INFO: Found listing with ID: BN42758
2026-03-28 18:44:28 [auto1.de] INFO: Found listing with ID: ZH67756
2026-03-28 18:44:28 [auto1.de] INFO: Found listing with ID: PN96283
2026-03-28 18:44:28 [auto1.de] INFO: Found listing with ID: AZ23133
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23133%27 HTTP/1.1" 200 None
2026-03-28 18:44:28 [auto1.de] INFO: Scrape type for AZ23133: 1
2026-03-28 18:44:28 [auto1.de] INFO: Found listing with ID: XV62286
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62286%27 HTTP/1.1" 200 None
2026-03-28 18:44:28 [auto1.de] INFO: Scrape type for XV62286: 2
2026-03-28 18:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03845dec-74cb-59b5-8e78-c2da3985b3db with identifier: XV62286
2026-03-28 18:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03845dec-74cb-59b5-8e78-c2da3985b3db with scrape type 2
2026-03-28 18:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03845dec-74cb-59b5-8e78-c2da3985b3db with scrape type 2
2026-03-28 18:44:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03845dec-74cb-59b5-8e78-c2da3985b3db, identifier: XV62286
2026-03-28 18:44:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03845dec-74cb-59b5-8e78-c2da3985b3db with identifier: XV62286
2026-03-28 18:44:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03845dec-74cb-59b5-8e78-c2da3985b3db with identifier: XV62286
2026-03-28 18:44:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03845dec-74cb-59b5-8e78-c2da3985b3db with identifier: XV62286 to the API
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:46Z',
 'fuel_type': 'petrol',
 'id': '03845dec-74cb-59b5-8e78-c2da3985b3db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV62286',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 170454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-20',
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2016}
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62286%27 HTTP/1.1" 200 None
2026-03-28 18:44:28 [auto1.de] INFO: Saving data for XV62286: {'auction_closing_time': 1774885006.0, 'created_time': 1774034791.776865, 'last_price_update_time': 1774723468.673421}
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV62286') HTTP/1.1" 204 0
2026-03-28 18:44:28 [auto1.de] INFO: Found listing with ID: KZ38664
2026-03-28 18:44:28 [auto1.de] INFO: Found listing with ID: ZS47010
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47010%27 HTTP/1.1" 200 None
2026-03-28 18:44:28 [auto1.de] INFO: Scrape type for ZS47010: 2
2026-03-28 18:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9d9cc51-fd6a-5005-8364-84446c8238f7 with identifier: ZS47010
2026-03-28 18:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9d9cc51-fd6a-5005-8364-84446c8238f7 with scrape type 2
2026-03-28 18:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9d9cc51-fd6a-5005-8364-84446c8238f7 with scrape type 2
2026-03-28 18:44:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9d9cc51-fd6a-5005-8364-84446c8238f7, identifier: ZS47010
2026-03-28 18:44:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9d9cc51-fd6a-5005-8364-84446c8238f7 with identifier: ZS47010
2026-03-28 18:44:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9d9cc51-fd6a-5005-8364-84446c8238f7 with identifier: ZS47010
2026-03-28 18:44:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9d9cc51-fd6a-5005-8364-84446c8238f7 with identifier: ZS47010 to the API
2026-03-28 18:44:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:22:35Z',
 'fuel_type': 'petrol',
 'id': 'e9d9cc51-fd6a-5005-8364-84446c8238f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS47010',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 21315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R 20 Years 4Motion',
 'transmission': 'automatic',
 'trim': 'R 20 Years 4Motion',
 'year': 2023}
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47010%27 HTTP/1.1" 200 None
2026-03-28 18:44:29 [auto1.de] INFO: Saving data for ZS47010: {'auction_closing_time': 1774884155.0, 'created_time': 1774350360.68977, 'last_price_update_time': 1774723469.212959}
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS47010') HTTP/1.1" 204 0
2026-03-28 18:44:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456148650>
2026-03-28 18:44:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9567e7f1-df59-575f-b013-ae275086f652/9567e7f1-df59-575f-b013-ae275086f652_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F13%252F1a13338c4ec1fdfcc0354022df46b066%252Fpa%252FZY32657_0cc64c84233daed39fe9d9d73ff719a7.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_0cc64c84233daed39fe9d9d73ff719a7.jpg saved to cache
2026-03-28 18:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9567e7f1-df59-575f-b013-ae275086f652
2026-03-28 18:44:29 [auto1.de] INFO: Found listing with ID: MF03624
2026-03-28 18:44:29 [auto1.de] INFO: Found listing with ID: FX61417
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX61417%27 HTTP/1.1" 200 None
2026-03-28 18:44:29 [auto1.de] INFO: Scrape type for FX61417: 1
2026-03-28 18:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF03546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA53111> (referer: https://www.auto1.com/v1/car-details-view/UA53111/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU29396/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL66615> (referer: https://www.auto1.com/v1/car-details-view/XL66615/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM47126/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_78d23719d43a3d0febcb3a981c8dfa47.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:29 [auto1.de] INFO: Found listing with ID: EK32140
2026-03-28 18:44:29 [auto1.de] INFO: Found listing with ID: ZG89267
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG89267%27 HTTP/1.1" 200 None
2026-03-28 18:44:29 [auto1.de] INFO: Scrape type for ZG89267: 2
2026-03-28 18:44:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 009fc4ab-bac0-5afd-be37-5b5b42a431d4 with identifier: ZG89267
2026-03-28 18:44:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 009fc4ab-bac0-5afd-be37-5b5b42a431d4 with scrape type 2
2026-03-28 18:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 009fc4ab-bac0-5afd-be37-5b5b42a431d4 with scrape type 2
2026-03-28 18:44:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 009fc4ab-bac0-5afd-be37-5b5b42a431d4, identifier: ZG89267
2026-03-28 18:44:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 009fc4ab-bac0-5afd-be37-5b5b42a431d4 with identifier: ZG89267
2026-03-28 18:44:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 009fc4ab-bac0-5afd-be37-5b5b42a431d4 with identifier: ZG89267
2026-03-28 18:44:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 009fc4ab-bac0-5afd-be37-5b5b42a431d4 with identifier: ZG89267 to the API
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-30T15:02:30Z',
 'fuel_type': 'petrol',
 'id': '009fc4ab-bac0-5afd-be37-5b5b42a431d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG89267',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 20496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-19',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2021}
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG89267%27 HTTP/1.1" 200 None
2026-03-28 18:44:29 [auto1.de] INFO: Saving data for ZG89267: {'auction_closing_time': 1774882950.0, 'created_time': 1774035765.917704, 'last_price_update_time': 1774723469.790055}
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG89267') HTTP/1.1" 204 0
2026-03-28 18:44:29 [auto1.de] INFO: Found listing with ID: WW30345
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW30345%27 HTTP/1.1" 200 None
2026-03-28 18:44:29 [auto1.de] INFO: Scrape type for WW30345: 1
2026-03-28 18:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_d5ddcc7bdeb7e0f1b800465c56236838.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_47f8acb6b254a83c0d60dba94d5e11ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_25e22a8adcea53dbc411ba3f0fb6cf02.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:29 [auto1.de] INFO: Found listing with ID: GE75594
2026-03-28 18:44:29 [auto1.de] INFO: Found listing with ID: BH61935
2026-03-28 18:44:29 [auto1.de] INFO: Found listing with ID: TH50247
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50247%27 HTTP/1.1" 200 None
2026-03-28 18:44:29 [auto1.de] INFO: Scrape type for TH50247: 2
2026-03-28 18:44:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 592cbc29-5289-5a4c-a101-d4b11e0f14c7 with identifier: TH50247
2026-03-28 18:44:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 592cbc29-5289-5a4c-a101-d4b11e0f14c7 with scrape type 2
2026-03-28 18:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 592cbc29-5289-5a4c-a101-d4b11e0f14c7 with scrape type 2
2026-03-28 18:44:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 592cbc29-5289-5a4c-a101-d4b11e0f14c7, identifier: TH50247
2026-03-28 18:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_816530c5efcba62e723a18e7b86b2706.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 592cbc29-5289-5a4c-a101-d4b11e0f14c7 with identifier: TH50247
2026-03-28 18:44:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 592cbc29-5289-5a4c-a101-d4b11e0f14c7 with identifier: TH50247
2026-03-28 18:44:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 592cbc29-5289-5a4c-a101-d4b11e0f14c7 with identifier: TH50247 to the API
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:11:30Z',
 'fuel_type': 'petrol',
 'id': '592cbc29-5289-5a4c-a101-d4b11e0f14c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH50247',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 66762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-05',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2020}
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50247%27 HTTP/1.1" 200 None
2026-03-28 18:44:30 [auto1.de] INFO: Saving data for TH50247: {'auction_closing_time': 1774883490.0, 'created_time': 1774035523.143112, 'last_price_update_time': 1774723470.407728}
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH50247') HTTP/1.1" 204 0
2026-03-28 18:44:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67fe3d5d-bcec-5da0-967d-974bce60c94a with identifier: UA53111
2026-03-28 18:44:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67fe3d5d-bcec-5da0-967d-974bce60c94a with scrape type 1
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67fe3d5d-bcec-5da0-967d-974bce60c94a
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_0925acdc788b5d2782a5215b7554c39a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_0925acdc788b5d2782a5215b7554c39a.jpg not downloaded yet
2026-03-28 18:44:30 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 6012 | hits on page: 40
2026-03-28 18:44:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a with identifier: XL66615
2026-03-28 18:44:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a with scrape type 1
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919ce4d2039634506ae129b29f1c5a90%252Fpa%252FXL66615_b22cc15639193ad35c05a9955a7f88f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_b22cc15639193ad35c05a9955a7f88f6.jpg already downloaded
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919ce4d2039634506ae129b29f1c5a90%252Fpa%252FXL66615_8daaa2989ac972738cc6f0fad34dc27c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_8daaa2989ac972738cc6f0fad34dc27c.jpg already downloaded
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919ce4d2039634506ae129b29f1c5a90%252Fpa%252FXL66615_69879b3037689433fcbdb24002729a17.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_69879b3037689433fcbdb24002729a17.jpg already downloaded
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919ce4d2039634506ae129b29f1c5a90%252Fpa%252FXL66615_f6288b3bd0654adc9f55b495db5e56d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_f6288b3bd0654adc9f55b495db5e56d7.jpg already downloaded
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919ce4d2039634506ae129b29f1c5a90%252Fpa%252FXL66615_20e9bd782804666a3e6c2de8190aae4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_20e9bd782804666a3e6c2de8190aae4f.jpg already downloaded
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919ce4d2039634506ae129b29f1c5a90%252Fpa%252FXL66615_1c9ea98de5c571f9362102966f641f6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_1c9ea98de5c571f9362102966f641f6a.jpg already downloaded
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919ce4d2039634506ae129b29f1c5a90%252Fpa%252FXL66615_8cb5df3b1371c83b6518b80f1cd622fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_8cb5df3b1371c83b6518b80f1cd622fb.jpg already downloaded
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919ce4d2039634506ae129b29f1c5a90%252Fpa%252FXL66615_adcd364e612196fb7f3e78b841ecf91e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_adcd364e612196fb7f3e78b841ecf91e.jpg already downloaded
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919ce4d2039634506ae129b29f1c5a90%252Fpa%252FXL66615_b444a36e408fa693e3eb3a9e317f8147.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_b444a36e408fa693e3eb3a9e317f8147.jpg already downloaded
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9c%252F919ce4d2039634506ae129b29f1c5a90%252Fpa%252FXL66615_55262a61424ede8ee0fd0c1516d83c88.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_55262a61424ede8ee0fd0c1516d83c88.jpg already downloaded
2026-03-28 18:44:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a, identifier: XL66615
2026-03-28 18:44:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a6010>
2026-03-28 18:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_78d23719d43a3d0febcb3a981c8dfa47.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_78d23719d43a3d0febcb3a981c8dfa47.jpg saved to cache
2026-03-28 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1
2026-03-28 18:44:30 [auto1.de] INFO: Found listing with ID: CV13370
2026-03-28 18:44:30 [auto1.de] INFO: Found listing with ID: GF54025
2026-03-28 18:44:30 [auto1.de] INFO: Found listing with ID: KK05104
2026-03-28 18:44:30 [auto1.de] INFO: Found listing with ID: DT00553
2026-03-28 18:44:30 [auto1.de] INFO: Found listing with ID: LR61927
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR61927%27 HTTP/1.1" 200 None
2026-03-28 18:44:30 [auto1.de] INFO: Scrape type for LR61927: 1
2026-03-28 18:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR72428/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a with identifier: XL66615
2026-03-28 18:44:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a with identifier: XL66615
2026-03-28 18:44:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a with identifier: XL66615 to the API
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XL66615>
{'auction_title': '',
 'c_o_2_emission_value': 261,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.9L',
 'engine_horse_power': 510,
 'expiration_date': '2026-03-30T15:24:18Z',
 'fuel_type': 'petrol',
 'id': '82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL66615',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 104360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_b22cc15639193ad35c05a9955a7f88f6.jpg',
                'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_8daaa2989ac972738cc6f0fad34dc27c.jpg',
                'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_69879b3037689433fcbdb24002729a17.jpg',
                'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_f6288b3bd0654adc9f55b495db5e56d7.jpg',
                'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_20e9bd782804666a3e6c2de8190aae4f.jpg',
                'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_1c9ea98de5c571f9362102966f641f6a.jpg',
                'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_8cb5df3b1371c83b6518b80f1cd622fb.jpg',
                'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_adcd364e612196fb7f3e78b841ecf91e.jpg',
                'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_b444a36e408fa693e3eb3a9e317f8147.jpg',
                'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_55262a61424ede8ee0fd0c1516d83c88.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a/82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_b22cc15639193ad35c05a9955a7f88f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a/82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_8daaa2989ac972738cc6f0fad34dc27c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a/82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_69879b3037689433fcbdb24002729a17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a/82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_f6288b3bd0654adc9f55b495db5e56d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a/82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_20e9bd782804666a3e6c2de8190aae4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a/82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_1c9ea98de5c571f9362102966f641f6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a/82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_8cb5df3b1371c83b6518b80f1cd622fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a/82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2416641,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_adcd364e612196fb7f3e78b841ecf91e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a/82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_b444a36e408fa693e3eb3a9e317f8147.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a/82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/9c/919ce4d2039634506ae129b29f1c5a90/pa/XL66615_55262a61424ede8ee0fd0c1516d83c88.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.9 V6 Quadrifoglio Q4',
 'transmission': 'automatic',
 'trim': 'Quadrifoglio Q4',
 'year': 2019}
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL66615%27 HTTP/1.1" 200 None
2026-03-28 18:44:31 [auto1.de] INFO: Saving data for XL66615: {'created_time': 1774723471.405357, 'last_price_update_time': 1774723471.405369, 'auction_closing_time': 1774884258.0}
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL66615') HTTP/1.1" 204 0
2026-03-28 18:44:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_0f21d8d29352ba111ac6ba356843bab0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_0f21d8d29352ba111ac6ba356843bab0.jpg not downloaded yet
2026-03-28 18:44:31 [auto1.de] INFO: Found listing with ID: KC33777
2026-03-28 18:44:31 [auto1.de] INFO: Found listing with ID: JD18961
2026-03-28 18:44:31 [auto1.de] INFO: Found listing with ID: EU91257
2026-03-28 18:44:31 [auto1.de] INFO: Found listing with ID: YV19830
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV19830%27 HTTP/1.1" 200 None
2026-03-28 18:44:31 [auto1.de] INFO: Scrape type for YV19830: 2
2026-03-28 18:44:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03f0d89d-3e3c-5056-ae76-419bb3f40c74 with identifier: YV19830
2026-03-28 18:44:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03f0d89d-3e3c-5056-ae76-419bb3f40c74 with scrape type 2
2026-03-28 18:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03f0d89d-3e3c-5056-ae76-419bb3f40c74 with scrape type 2
2026-03-28 18:44:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03f0d89d-3e3c-5056-ae76-419bb3f40c74, identifier: YV19830
2026-03-28 18:44:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454769710>
2026-03-28 18:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_d5ddcc7bdeb7e0f1b800465c56236838.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_d5ddcc7bdeb7e0f1b800465c56236838.jpg saved to cache
2026-03-28 18:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-03-28 18:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562d4490>
2026-03-28 18:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_47f8acb6b254a83c0d60dba94d5e11ca.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_47f8acb6b254a83c0d60dba94d5e11ca.jpg saved to cache
2026-03-28 18:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512
2026-03-28 18:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561fdf50>
2026-03-28 18:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_25e22a8adcea53dbc411ba3f0fb6cf02.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_25e22a8adcea53dbc411ba3f0fb6cf02.jpg saved to cache
2026-03-28 18:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512
2026-03-28 18:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_5529af265835508bae7a663eac37ad04.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:31 [auto1.de] INFO: Found listing with ID: PR38296
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR38296%27 HTTP/1.1" 200 None
2026-03-28 18:44:31 [auto1.de] INFO: Scrape type for PR38296: 2
2026-03-28 18:44:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17068962-4b9a-5ab1-ac87-ee65fae2ba30 with identifier: PR38296
2026-03-28 18:44:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17068962-4b9a-5ab1-ac87-ee65fae2ba30 with scrape type 2
2026-03-28 18:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17068962-4b9a-5ab1-ac87-ee65fae2ba30 with scrape type 2
2026-03-28 18:44:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17068962-4b9a-5ab1-ac87-ee65fae2ba30, identifier: PR38296
2026-03-28 18:44:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03f0d89d-3e3c-5056-ae76-419bb3f40c74 with identifier: YV19830
2026-03-28 18:44:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03f0d89d-3e3c-5056-ae76-419bb3f40c74 with identifier: YV19830
2026-03-28 18:44:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03f0d89d-3e3c-5056-ae76-419bb3f40c74 with identifier: YV19830 to the API
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:49:31Z',
 'fuel_type': 'petrol',
 'id': '03f0d89d-3e3c-5056-ae76-419bb3f40c74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV19830',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 101442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-28',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2020}
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV19830%27 HTTP/1.1" 200 None
2026-03-28 18:44:32 [auto1.de] INFO: Saving data for YV19830: {'auction_closing_time': 1774885771.0, 'created_time': 1774032064.803309, 'last_price_update_time': 1774723472.28101}
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV19830') HTTP/1.1" 204 0
2026-03-28 18:44:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17068962-4b9a-5ab1-ac87-ee65fae2ba30 with identifier: PR38296
2026-03-28 18:44:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17068962-4b9a-5ab1-ac87-ee65fae2ba30 with identifier: PR38296
2026-03-28 18:44:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17068962-4b9a-5ab1-ac87-ee65fae2ba30 with identifier: PR38296 to the API
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:36:32Z',
 'fuel_type': 'petrol',
 'id': '17068962-4b9a-5ab1-ac87-ee65fae2ba30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR38296',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 10995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-10',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.5 TSI Maxi',
 'transmission': 'automatic',
 'trim': 'Maxi',
 'year': 2024}
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR38296%27 HTTP/1.1" 200 None
2026-03-28 18:44:32 [auto1.de] INFO: Saving data for PR38296: {'auction_closing_time': 1774884992.0, 'created_time': 1774034771.381207, 'last_price_update_time': 1774723472.6557}
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR38296') HTTP/1.1" 204 0
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_f8bec1bcc4ca5240fe82351091bf92fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_f8bec1bcc4ca5240fe82351091bf92fd.jpg not downloaded yet
2026-03-28 18:44:32 [auto1.de] INFO: Found listing with ID: TF95367
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF95367%27 HTTP/1.1" 200 None
2026-03-28 18:44:32 [auto1.de] INFO: Scrape type for TF95367: 1
2026-03-28 18:44:32 [auto1.de] INFO: Found listing with ID: MN30135
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30135%27 HTTP/1.1" 200 None
2026-03-28 18:44:32 [auto1.de] INFO: Scrape type for MN30135: 1
2026-03-28 18:44:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245606b550>
2026-03-28 18:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_816530c5efcba62e723a18e7b86b2706.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_816530c5efcba62e723a18e7b86b2706.jpg saved to cache
2026-03-28 18:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_a4dbfc354d13fe53491c195bf88c8108.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_a4dbfc354d13fe53491c195bf88c8108.jpg not downloaded yet
2026-03-28 18:44:32 [auto1.de] INFO: Found listing with ID: XK86012
2026-03-28 18:44:32 [auto1.de] INFO: Found listing with ID: MJ24427
2026-03-28 18:44:32 [auto1.de] INFO: Found listing with ID: WE87104
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87104%27 HTTP/1.1" 200 None
2026-03-28 18:44:32 [auto1.de] INFO: Scrape type for WE87104: 2
2026-03-28 18:44:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4a4b41a-385a-5f1d-bb74-c4fd73beff06 with identifier: WE87104
2026-03-28 18:44:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4a4b41a-385a-5f1d-bb74-c4fd73beff06 with scrape type 2
2026-03-28 18:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4a4b41a-385a-5f1d-bb74-c4fd73beff06 with scrape type 2
2026-03-28 18:44:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4a4b41a-385a-5f1d-bb74-c4fd73beff06, identifier: WE87104
2026-03-28 18:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM12575/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY94515/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: GM93554
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: KC33777
2026-03-28 18:44:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4a4b41a-385a-5f1d-bb74-c4fd73beff06 with identifier: WE87104
2026-03-28 18:44:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4a4b41a-385a-5f1d-bb74-c4fd73beff06 with identifier: WE87104
2026-03-28 18:44:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4a4b41a-385a-5f1d-bb74-c4fd73beff06 with identifier: WE87104 to the API
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:28:38Z',
 'fuel_type': 'petrol',
 'id': 'd4a4b41a-385a-5f1d-bb74-c4fd73beff06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE87104',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 181007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-25',
 'seller_name': None,
 'title': 'Audi A5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87104%27 HTTP/1.1" 200 None
2026-03-28 18:44:33 [auto1.de] INFO: Saving data for WE87104: {'auction_closing_time': 1774884518.0, 'created_time': 1774118783.041569, 'last_price_update_time': 1774723473.365029}
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE87104') HTTP/1.1" 204 0
2026-03-28 18:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT14776/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AZ23133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_d1f24d2621ad3c27c6d07878e69c036d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_d1f24d2621ad3c27c6d07878e69c036d.jpg not downloaded yet
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: TY73105
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: ZC07667
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: RY65257
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: VF76211
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: YC98449
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC98449%27 HTTP/1.1" 200 None
2026-03-28 18:44:33 [auto1.de] INFO: Scrape type for YC98449: 1
2026-03-28 18:44:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454785450>
2026-03-28 18:44:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_5529af265835508bae7a663eac37ad04.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_5529af265835508bae7a663eac37ad04.jpg saved to cache
2026-03-28 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-03-28 18:44:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_a65fe639e17aec38aa5a81804d241b45.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_a65fe639e17aec38aa5a81804d241b45.jpg not downloaded yet
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: AN00284
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: PW75443
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: XZ09557
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: ZU51849
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: KD69831
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD69831%27 HTTP/1.1" 200 None
2026-03-28 18:44:33 [auto1.de] INFO: Scrape type for KD69831: 1
2026-03-28 18:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV44457/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6723bdd675148afd2a830196bfc76895.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2be1cf2204621f75525f828a6d5b94e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_5c8eb95149972e4f12029cc1d6d8296a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_5c8eb95149972e4f12029cc1d6d8296a.jpg not downloaded yet
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: VS08295
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: DZ10370
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: YE71263
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE71263%27 HTTP/1.1" 200 None
2026-03-28 18:44:33 [auto1.de] INFO: Scrape type for YE71263: 1
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_7662bd5534e7fb604e2be885f2a0c1e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_7662bd5534e7fb604e2be885f2a0c1e9.jpg not downloaded yet
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: PW03502
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW03502%27 HTTP/1.1" 200 None
2026-03-28 18:44:33 [auto1.de] INFO: Scrape type for PW03502: 1
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_0e9ac38e7464135143370d9772227b70.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_0e9ac38e7464135143370d9772227b70.jpg not downloaded yet
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: LH85097
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: TZ90544
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90544%27 HTTP/1.1" 200 None
2026-03-28 18:44:33 [auto1.de] INFO: Scrape type for TZ90544: 1
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_c2cc300a567e4750525f5308b4f40477.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_c2cc300a567e4750525f5308b4f40477.jpg not downloaded yet
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: ZM06899
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: MW28967
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: ZB32219
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: HL71303
2026-03-28 18:44:33 [auto1.de] INFO: Found listing with ID: BU00937
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00937%27 HTTP/1.1" 200 None
2026-03-28 18:44:33 [auto1.de] INFO: Scrape type for BU00937: 2
2026-03-28 18:44:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b128df5a-33a7-5868-869e-85c745ee281e with identifier: BU00937
2026-03-28 18:44:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b128df5a-33a7-5868-869e-85c745ee281e with scrape type 2
2026-03-28 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b128df5a-33a7-5868-869e-85c745ee281e with scrape type 2
2026-03-28 18:44:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b128df5a-33a7-5868-869e-85c745ee281e, identifier: BU00937
2026-03-28 18:44:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b128df5a-33a7-5868-869e-85c745ee281e with identifier: BU00937
2026-03-28 18:44:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b128df5a-33a7-5868-869e-85c745ee281e with identifier: BU00937
2026-03-28 18:44:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b128df5a-33a7-5868-869e-85c745ee281e with identifier: BU00937 to the API
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:54:25Z',
 'fuel_type': 'diesel',
 'id': 'b128df5a-33a7-5868-869e-85c745ee281e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU00937',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 188119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-22',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 HDi 99G',
 'transmission': 'manual',
 'trim': '99G',
 'year': 2010}
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00937%27 HTTP/1.1" 200 None
2026-03-28 18:44:34 [auto1.de] INFO: Saving data for BU00937: {'auction_closing_time': 1774886065.0, 'created_time': 1774034663.183864, 'last_price_update_time': 1774723474.240149}
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU00937') HTTP/1.1" 204 0
2026-03-28 18:44:34 [auto1.de] INFO: Found listing with ID: CB58662
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB58662%27 HTTP/1.1" 200 None
2026-03-28 18:44:34 [auto1.de] INFO: Scrape type for CB58662: 1
2026-03-28 18:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_0f21d8d29352ba111ac6ba356843bab0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE81625/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563c2d10>
2026-03-28 18:44:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_6723bdd675148afd2a830196bfc76895.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6723bdd675148afd2a830196bfc76895.jpg saved to cache
2026-03-28 18:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-03-28 18:44:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245648d310>
2026-03-28 18:44:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_2be1cf2204621f75525f828a6d5b94e2.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2be1cf2204621f75525f828a6d5b94e2.jpg saved to cache
2026-03-28 18:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-03-28 18:44:34 [auto1.de] INFO: Found listing with ID: WN13628
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN13628%27 HTTP/1.1" 200 None
2026-03-28 18:44:34 [auto1.de] INFO: Scrape type for WN13628: 2
2026-03-28 18:44:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21e09935-c3aa-5c50-ac50-ff052f4fd5ae with identifier: WN13628
2026-03-28 18:44:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21e09935-c3aa-5c50-ac50-ff052f4fd5ae with scrape type 2
2026-03-28 18:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21e09935-c3aa-5c50-ac50-ff052f4fd5ae with scrape type 2
2026-03-28 18:44:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21e09935-c3aa-5c50-ac50-ff052f4fd5ae, identifier: WN13628
2026-03-28 18:44:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21e09935-c3aa-5c50-ac50-ff052f4fd5ae with identifier: WN13628
2026-03-28 18:44:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21e09935-c3aa-5c50-ac50-ff052f4fd5ae with identifier: WN13628
2026-03-28 18:44:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21e09935-c3aa-5c50-ac50-ff052f4fd5ae with identifier: WN13628 to the API
2026-03-28 18:44:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:08:57Z',
 'fuel_type': 'petrol',
 'id': '21e09935-c3aa-5c50-ac50-ff052f4fd5ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN13628',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 84821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-26',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS 245',
 'transmission': 'automatic',
 'trim': 'RS 245',
 'year': 2019}
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN13628%27 HTTP/1.1" 200 None
2026-03-28 18:44:35 [auto1.de] INFO: Saving data for WN13628: {'auction_closing_time': 1774883337.0, 'created_time': 1774350310.473324, 'last_price_update_time': 1774723475.162057}
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN13628') HTTP/1.1" 204 0
2026-03-28 18:44:35 [auto1.de] INFO: Found listing with ID: SC39619
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC39619%27 HTTP/1.1" 200 None
2026-03-28 18:44:35 [auto1.de] INFO: Scrape type for SC39619: 1
2026-03-28 18:44:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477ac50>
2026-03-28 18:44:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_0f21d8d29352ba111ac6ba356843bab0.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_0f21d8d29352ba111ac6ba356843bab0.jpg saved to cache
2026-03-28 18:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67fe3d5d-bcec-5da0-967d-974bce60c94a
2026-03-28 18:44:35 [auto1.de] INFO: Found listing with ID: HP58071
2026-03-28 18:44:35 [auto1.de] INFO: Found listing with ID: VW03364
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW03364%27 HTTP/1.1" 200 None
2026-03-28 18:44:35 [auto1.de] INFO: Scrape type for VW03364: 2
2026-03-28 18:44:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19253ffb-d3e1-5362-80bd-b80b9ffa47f9 with identifier: VW03364
2026-03-28 18:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19253ffb-d3e1-5362-80bd-b80b9ffa47f9 with scrape type 2
2026-03-28 18:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19253ffb-d3e1-5362-80bd-b80b9ffa47f9 with scrape type 2
2026-03-28 18:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19253ffb-d3e1-5362-80bd-b80b9ffa47f9, identifier: VW03364
2026-03-28 18:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19253ffb-d3e1-5362-80bd-b80b9ffa47f9 with identifier: VW03364
2026-03-28 18:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19253ffb-d3e1-5362-80bd-b80b9ffa47f9 with identifier: VW03364
2026-03-28 18:44:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19253ffb-d3e1-5362-80bd-b80b9ffa47f9 with identifier: VW03364 to the API
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:30:44Z',
 'fuel_type': 'diesel',
 'id': '19253ffb-d3e1-5362-80bd-b80b9ffa47f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW03364',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 260047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-13',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW03364%27 HTTP/1.1" 200 None
2026-03-28 18:44:35 [auto1.de] INFO: Saving data for VW03364: {'auction_closing_time': 1774884644.0, 'created_time': 1774089472.869277, 'last_price_update_time': 1774723475.715336}
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW03364') HTTP/1.1" 204 0
2026-03-28 18:44:35 [auto1.de] INFO: Found listing with ID: DN85056
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN85056%27 HTTP/1.1" 200 None
2026-03-28 18:44:35 [auto1.de] INFO: Scrape type for DN85056: 1
2026-03-28 18:44:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_c2cc300a567e4750525f5308b4f40477.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:35 [auto1.de] INFO: Found listing with ID: DZ90314
2026-03-28 18:44:35 [auto1.de] INFO: Found listing with ID: KV10415
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV10415%27 HTTP/1.1" 200 None
2026-03-28 18:44:35 [auto1.de] INFO: Scrape type for KV10415: 1
2026-03-28 18:44:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY60901/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:35 [auto1.de] INFO: Found listing with ID: SF76682
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF76682%27 HTTP/1.1" 200 None
2026-03-28 18:44:35 [auto1.de] INFO: Scrape type for SF76682: 2
2026-03-28 18:44:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d329d3d4-ab4b-5315-863d-c0b306597e15 with identifier: SF76682
2026-03-28 18:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d329d3d4-ab4b-5315-863d-c0b306597e15 with scrape type 2
2026-03-28 18:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d329d3d4-ab4b-5315-863d-c0b306597e15 with scrape type 2
2026-03-28 18:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d329d3d4-ab4b-5315-863d-c0b306597e15, identifier: SF76682
2026-03-28 18:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d329d3d4-ab4b-5315-863d-c0b306597e15 with identifier: SF76682
2026-03-28 18:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d329d3d4-ab4b-5315-863d-c0b306597e15 with identifier: SF76682
2026-03-28 18:44:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d329d3d4-ab4b-5315-863d-c0b306597e15 with identifier: SF76682 to the API
2026-03-28 18:44:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:23:51Z',
 'fuel_type': 'petrol',
 'id': 'd329d3d4-ab4b-5315-863d-c0b306597e15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF76682',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 128433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-01',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 GDI Edition 7",
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2013}
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF76682%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [auto1.de] INFO: Saving data for SF76682: {'auction_closing_time': 1774884231.0, 'created_time': 1774118987.313037, 'last_price_update_time': 1774723476.221382}
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF76682') HTTP/1.1" 204 0
2026-03-28 18:44:36 [auto1.de] INFO: Found listing with ID: CE35567
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE35567%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [auto1.de] INFO: Scrape type for CE35567: 2
2026-03-28 18:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6380c7-4986-5799-a904-6292c01fdbda with identifier: CE35567
2026-03-28 18:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6380c7-4986-5799-a904-6292c01fdbda with scrape type 2
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6380c7-4986-5799-a904-6292c01fdbda with scrape type 2
2026-03-28 18:44:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d6380c7-4986-5799-a904-6292c01fdbda, identifier: CE35567
2026-03-28 18:44:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d6380c7-4986-5799-a904-6292c01fdbda with identifier: CE35567
2026-03-28 18:44:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d6380c7-4986-5799-a904-6292c01fdbda with identifier: CE35567
2026-03-28 18:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d6380c7-4986-5799-a904-6292c01fdbda with identifier: CE35567 to the API
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:08:27Z',
 'fuel_type': 'petrol',
 'id': '8d6380c7-4986-5799-a904-6292c01fdbda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE35567',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 217994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-12',
 'seller_name': None,
 'title': 'BMW 3er 328i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE35567%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [auto1.de] INFO: Saving data for CE35567: {'auction_closing_time': 1774883307.0, 'created_time': 1773428269.953947, 'last_price_update_time': 1774723476.653185}
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE35567') HTTP/1.1" 204 0
2026-03-28 18:44:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR61927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN30135/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:36 [auto1.de] INFO: Found listing with ID: EC92138
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC92138%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [auto1.de] INFO: Scrape type for EC92138: 1
2026-03-28 18:44:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM47126> (referer: https://www.auto1.com/v1/car-details-view/LM47126/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR72428> (referer: https://www.auto1.com/v1/car-details-view/MR72428/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b6190>
2026-03-28 18:44:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_c2cc300a567e4750525f5308b4f40477.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_c2cc300a567e4750525f5308b4f40477.jpg saved to cache
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67fe3d5d-bcec-5da0-967d-974bce60c94a
2026-03-28 18:44:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_f8bec1bcc4ca5240fe82351091bf92fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_a4dbfc354d13fe53491c195bf88c8108.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_0e9ac38e7464135143370d9772227b70.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593adad4-ce90-5b52-99e2-41b1879a42bd with identifier: LM47126
2026-03-28 18:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593adad4-ce90-5b52-99e2-41b1879a42bd with scrape type 1
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 593adad4-ce90-5b52-99e2-41b1879a42bd
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F23%252Fda2348c602ba6a3d7e1342c8717bc11b%252Fpa%252FLM47126_4f685991623fe8b12ce9bf44da2bc8be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_4f685991623fe8b12ce9bf44da2bc8be.jpg already downloaded
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F23%252Fda2348c602ba6a3d7e1342c8717bc11b%252Fpa%252FLM47126_38fbecdc29fd4b55c69ef375aa84798d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_38fbecdc29fd4b55c69ef375aa84798d.jpg already downloaded
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F23%252Fda2348c602ba6a3d7e1342c8717bc11b%252Fpa%252FLM47126_a7ef3051b41e9a83608e2b6c9554f15c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_a7ef3051b41e9a83608e2b6c9554f15c.jpg already downloaded
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F23%252Fda2348c602ba6a3d7e1342c8717bc11b%252Fpa%252FLM47126_38a263fbca0dffd560f2356ebc582506.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_38a263fbca0dffd560f2356ebc582506.jpg already downloaded
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F23%252Fda2348c602ba6a3d7e1342c8717bc11b%252Fpa%252FLM47126_6c55ffb27012075821f92a28918e5bb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_6c55ffb27012075821f92a28918e5bb2.jpg already downloaded
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F23%252Fda2348c602ba6a3d7e1342c8717bc11b%252Fpa%252FLM47126_e4644d82ca8b612a932fd85cdb8c35d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_e4644d82ca8b612a932fd85cdb8c35d8.jpg already downloaded
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F23%252Fda2348c602ba6a3d7e1342c8717bc11b%252Fpa%252FLM47126_72caf88e0a69e818806594e389d853ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_72caf88e0a69e818806594e389d853ff.jpg already downloaded
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F23%252Fda2348c602ba6a3d7e1342c8717bc11b%252Fpa%252FLM47126_b4e40daf02929799d48f7a016a1ef52a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_b4e40daf02929799d48f7a016a1ef52a.jpg already downloaded
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F23%252Fda2348c602ba6a3d7e1342c8717bc11b%252Fpa%252FLM47126_a04eed51af78d42a26b6f2e07d1d9fe1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_a04eed51af78d42a26b6f2e07d1d9fe1.jpg already downloaded
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F23%252Fda2348c602ba6a3d7e1342c8717bc11b%252Fpa%252FLM47126_bdd0c76ca8963758870c7dec73eed696.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_bdd0c76ca8963758870c7dec73eed696.jpg already downloaded
2026-03-28 18:44:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 593adad4-ce90-5b52-99e2-41b1879a42bd, identifier: LM47126
2026-03-28 18:44:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2a37e25-e516-585f-88a3-031569e62087 with identifier: MR72428
2026-03-28 18:44:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a37e25-e516-585f-88a3-031569e62087 with scrape type 1
2026-03-28 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2a37e25-e516-585f-88a3-031569e62087
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc7abd4c7c341216f45c4c1830e2b42%252Fpa%252FMR72428_063e1a63425cfa6558b174292531d023.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_063e1a63425cfa6558b174292531d023.jpg already downloaded
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc7abd4c7c341216f45c4c1830e2b42%252Fpa%252FMR72428_7d10d2f73c2bd3dbd0999fbee6e3405b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_7d10d2f73c2bd3dbd0999fbee6e3405b.jpg already downloaded
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc7abd4c7c341216f45c4c1830e2b42%252Fpa%252FMR72428_9e1cbab034be625f634a9bfba08a6277.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_9e1cbab034be625f634a9bfba08a6277.jpg already downloaded
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc7abd4c7c341216f45c4c1830e2b42%252Fpa%252FMR72428_e319a63dc2e91b056449d421fecdc690.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_e319a63dc2e91b056449d421fecdc690.jpg already downloaded
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc7abd4c7c341216f45c4c1830e2b42%252Fpa%252FMR72428_98f26b035da6931710449ef905f7c318.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_98f26b035da6931710449ef905f7c318.jpg already downloaded
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc7abd4c7c341216f45c4c1830e2b42%252Fpa%252FMR72428_0ab8d7bb8705eca31861e201aab0e494.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_0ab8d7bb8705eca31861e201aab0e494.jpg already downloaded
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc7abd4c7c341216f45c4c1830e2b42%252Fpa%252FMR72428_5a873516f69fba1b5f7df0dae829c82c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_5a873516f69fba1b5f7df0dae829c82c.jpg already downloaded
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc7abd4c7c341216f45c4c1830e2b42%252Fpa%252FMR72428_7355586c5da5a592c227c29c6fa6f98b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_7355586c5da5a592c227c29c6fa6f98b.jpg already downloaded
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc7abd4c7c341216f45c4c1830e2b42%252Fpa%252FMR72428_ecf7770b4af6f151057af4fa3d0e850d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_ecf7770b4af6f151057af4fa3d0e850d.jpg already downloaded
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc7abd4c7c341216f45c4c1830e2b42%252Fpa%252FMR72428_54f3439ef7874e6c2b2412186c587109.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_54f3439ef7874e6c2b2412186c587109.jpg already downloaded
2026-03-28 18:44:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2a37e25-e516-585f-88a3-031569e62087, identifier: MR72428
2026-03-28 18:44:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 593adad4-ce90-5b52-99e2-41b1879a42bd with identifier: LM47126
2026-03-28 18:44:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 593adad4-ce90-5b52-99e2-41b1879a42bd with identifier: LM47126
2026-03-28 18:44:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 593adad4-ce90-5b52-99e2-41b1879a42bd with identifier: LM47126 to the API
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LM47126>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:34:20Z',
 'fuel_type': 'petrol',
 'id': '593adad4-ce90-5b52-99e2-41b1879a42bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM47126',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 91084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_4f685991623fe8b12ce9bf44da2bc8be.jpg',
                'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_38fbecdc29fd4b55c69ef375aa84798d.jpg',
                'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_a7ef3051b41e9a83608e2b6c9554f15c.jpg',
                'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_38a263fbca0dffd560f2356ebc582506.jpg',
                'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_6c55ffb27012075821f92a28918e5bb2.jpg',
                'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_e4644d82ca8b612a932fd85cdb8c35d8.jpg',
                'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_72caf88e0a69e818806594e389d853ff.jpg',
                'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_b4e40daf02929799d48f7a016a1ef52a.jpg',
                'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_a04eed51af78d42a26b6f2e07d1d9fe1.jpg',
                'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_bdd0c76ca8963758870c7dec73eed696.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593adad4-ce90-5b52-99e2-41b1879a42bd/593adad4-ce90-5b52-99e2-41b1879a42bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2895157,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_4f685991623fe8b12ce9bf44da2bc8be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593adad4-ce90-5b52-99e2-41b1879a42bd/593adad4-ce90-5b52-99e2-41b1879a42bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2882128,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_38fbecdc29fd4b55c69ef375aa84798d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593adad4-ce90-5b52-99e2-41b1879a42bd/593adad4-ce90-5b52-99e2-41b1879a42bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2871246,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_a7ef3051b41e9a83608e2b6c9554f15c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593adad4-ce90-5b52-99e2-41b1879a42bd/593adad4-ce90-5b52-99e2-41b1879a42bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_38a263fbca0dffd560f2356ebc582506.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593adad4-ce90-5b52-99e2-41b1879a42bd/593adad4-ce90-5b52-99e2-41b1879a42bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2822343,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_6c55ffb27012075821f92a28918e5bb2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593adad4-ce90-5b52-99e2-41b1879a42bd/593adad4-ce90-5b52-99e2-41b1879a42bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2794342,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_e4644d82ca8b612a932fd85cdb8c35d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593adad4-ce90-5b52-99e2-41b1879a42bd/593adad4-ce90-5b52-99e2-41b1879a42bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2845100,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_72caf88e0a69e818806594e389d853ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593adad4-ce90-5b52-99e2-41b1879a42bd/593adad4-ce90-5b52-99e2-41b1879a42bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2931743,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_b4e40daf02929799d48f7a016a1ef52a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593adad4-ce90-5b52-99e2-41b1879a42bd/593adad4-ce90-5b52-99e2-41b1879a42bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2833998,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_a04eed51af78d42a26b6f2e07d1d9fe1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593adad4-ce90-5b52-99e2-41b1879a42bd/593adad4-ce90-5b52-99e2-41b1879a42bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/23/da2348c602ba6a3d7e1342c8717bc11b/pa/LM47126_bdd0c76ca8963758870c7dec73eed696.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM47126%27 HTTP/1.1" 200 None
2026-03-28 18:44:37 [auto1.de] INFO: Saving data for LM47126: {'created_time': 1774723477.670643, 'last_price_update_time': 1774723477.670655, 'auction_closing_time': 1774884860.0}
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM47126') HTTP/1.1" 204 0
2026-03-28 18:44:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2a37e25-e516-585f-88a3-031569e62087 with identifier: MR72428
2026-03-28 18:44:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2a37e25-e516-585f-88a3-031569e62087 with identifier: MR72428
2026-03-28 18:44:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2a37e25-e516-585f-88a3-031569e62087 with identifier: MR72428 to the API
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MR72428>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 227,
 'expiration_date': '2026-03-30T15:21:59Z',
 'fuel_type': 'petrol',
 'id': 'a2a37e25-e516-585f-88a3-031569e62087',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR72428',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mercedes-Benz',
 'model': 'CLE-Klasse',
 'odometer': 1193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_063e1a63425cfa6558b174292531d023.jpg',
                'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_7d10d2f73c2bd3dbd0999fbee6e3405b.jpg',
                'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_9e1cbab034be625f634a9bfba08a6277.jpg',
                'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_e319a63dc2e91b056449d421fecdc690.jpg',
                'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_98f26b035da6931710449ef905f7c318.jpg',
                'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_0ab8d7bb8705eca31861e201aab0e494.jpg',
                'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_5a873516f69fba1b5f7df0dae829c82c.jpg',
                'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_7355586c5da5a592c227c29c6fa6f98b.jpg',
                'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_ecf7770b4af6f151057af4fa3d0e850d.jpg',
                'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_54f3439ef7874e6c2b2412186c587109.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a37e25-e516-585f-88a3-031569e62087/a2a37e25-e516-585f-88a3-031569e62087_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73226,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_063e1a63425cfa6558b174292531d023.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a37e25-e516-585f-88a3-031569e62087/a2a37e25-e516-585f-88a3-031569e62087_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72539,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_7d10d2f73c2bd3dbd0999fbee6e3405b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a37e25-e516-585f-88a3-031569e62087/a2a37e25-e516-585f-88a3-031569e62087_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68924,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_9e1cbab034be625f634a9bfba08a6277.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a37e25-e516-585f-88a3-031569e62087/a2a37e25-e516-585f-88a3-031569e62087_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60050,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_e319a63dc2e91b056449d421fecdc690.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a37e25-e516-585f-88a3-031569e62087/a2a37e25-e516-585f-88a3-031569e62087_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53851,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_98f26b035da6931710449ef905f7c318.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a37e25-e516-585f-88a3-031569e62087/a2a37e25-e516-585f-88a3-031569e62087_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45365,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_0ab8d7bb8705eca31861e201aab0e494.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a37e25-e516-585f-88a3-031569e62087/a2a37e25-e516-585f-88a3-031569e62087_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_5a873516f69fba1b5f7df0dae829c82c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a37e25-e516-585f-88a3-031569e62087/a2a37e25-e516-585f-88a3-031569e62087_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_7355586c5da5a592c227c29c6fa6f98b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a37e25-e516-585f-88a3-031569e62087/a2a37e25-e516-585f-88a3-031569e62087_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63575,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_ecf7770b4af6f151057af4fa3d0e850d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a37e25-e516-585f-88a3-031569e62087/a2a37e25-e516-585f-88a3-031569e62087_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53515,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc7abd4c7c341216f45c4c1830e2b42/pa/MR72428_54f3439ef7874e6c2b2412186c587109.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-07-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz CLE-Klasse CLE 200 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2025}
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72428%27 HTTP/1.1" 200 None
2026-03-28 18:44:38 [auto1.de] INFO: Saving data for MR72428: {'created_time': 1774723478.09875, 'last_price_update_time': 1774723478.098763, 'auction_closing_time': 1774884119.0}
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR72428') HTTP/1.1" 204 0
2026-03-28 18:44:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245630b950>
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_f8bec1bcc4ca5240fe82351091bf92fd.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_f8bec1bcc4ca5240fe82351091bf92fd.jpg saved to cache
2026-03-28 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67fe3d5d-bcec-5da0-967d-974bce60c94a
2026-03-28 18:44:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b8910>
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_a4dbfc354d13fe53491c195bf88c8108.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_a4dbfc354d13fe53491c195bf88c8108.jpg saved to cache
2026-03-28 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67fe3d5d-bcec-5da0-967d-974bce60c94a
2026-03-28 18:44:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547ec4d0>
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_0e9ac38e7464135143370d9772227b70.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_0e9ac38e7464135143370d9772227b70.jpg saved to cache
2026-03-28 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67fe3d5d-bcec-5da0-967d-974bce60c94a
2026-03-28 18:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_7662bd5534e7fb604e2be885f2a0c1e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547ed850>
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_7662bd5534e7fb604e2be885f2a0c1e9.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_7662bd5534e7fb604e2be885f2a0c1e9.jpg saved to cache
2026-03-28 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67fe3d5d-bcec-5da0-967d-974bce60c94a
2026-03-28 18:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU29396> (referer: https://www.auto1.com/v1/car-details-view/WU29396/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5193fb67-ff68-5bf9-aae2-de74f3b7460e with identifier: WU29396
2026-03-28 18:44:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e with scrape type 1
2026-03-28 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_da89f206b8c716b453727114a8438ed3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_da89f206b8c716b453727114a8438ed3.jpg not downloaded yet
2026-03-28 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_be0056646687e9330d80b2f0a564077f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_be0056646687e9330d80b2f0a564077f.jpg not downloaded yet
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_3d95d6c8b3c726568e4074ec19e37562.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_3d95d6c8b3c726568e4074ec19e37562.jpg not downloaded yet
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_86491ad6b0e0045a8cedf61cc88fbd7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_86491ad6b0e0045a8cedf61cc88fbd7d.jpg not downloaded yet
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_666ddfaecd8764b9094c68de4504f2f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_666ddfaecd8764b9094c68de4504f2f3.jpg not downloaded yet
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_ad3e7239ad6a48a56a0ef147a751259b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_ad3e7239ad6a48a56a0ef147a751259b.jpg not downloaded yet
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_91b95d64be12d107462f08a4ee838b33.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_91b95d64be12d107462f08a4ee838b33.jpg not downloaded yet
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_bfec48cc2ae6b249caa88918e4f11ec2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_bfec48cc2ae6b249caa88918e4f11ec2.jpg not downloaded yet
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_20f404c7699b7fc999c15c129179bd30.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_20f404c7699b7fc999c15c129179bd30.jpg not downloaded yet
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_4c613fbb4f2eeffe53e2c04a02cbe192.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_4c613fbb4f2eeffe53e2c04a02cbe192.jpg not downloaded yet
2026-03-28 18:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ90544/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB58662/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN85056/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_4c613fbb4f2eeffe53e2c04a02cbe192.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_20f404c7699b7fc999c15c129179bd30.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_bfec48cc2ae6b249caa88918e4f11ec2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547ed610>
2026-03-28 18:44:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_4c613fbb4f2eeffe53e2c04a02cbe192.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_4c613fbb4f2eeffe53e2c04a02cbe192.jpg saved to cache
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e
2026-03-28 18:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245649ac90>
2026-03-28 18:44:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_20f404c7699b7fc999c15c129179bd30.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_20f404c7699b7fc999c15c129179bd30.jpg saved to cache
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e
2026-03-28 18:44:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bb090>
2026-03-28 18:44:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_bfec48cc2ae6b249caa88918e4f11ec2.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_bfec48cc2ae6b249caa88918e4f11ec2.jpg saved to cache
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e
2026-03-28 18:44:39 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 6012 | hits on page: 40
2026-03-28 18:44:39 [auto1.de] INFO: Found listing with ID: RN02934
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN02934%27 HTTP/1.1" 200 None
2026-03-28 18:44:39 [auto1.de] INFO: Scrape type for RN02934: 1
2026-03-28 18:44:39 [auto1.de] INFO: Found listing with ID: UY39264
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY39264%27 HTTP/1.1" 200 None
2026-03-28 18:44:39 [auto1.de] INFO: Scrape type for UY39264: 1
2026-03-28 18:44:39 [auto1.de] INFO: Found listing with ID: ZD05213
2026-03-28 18:44:39 [auto1.de] INFO: Found listing with ID: VL59163
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL59163%27 HTTP/1.1" 200 None
2026-03-28 18:44:39 [auto1.de] INFO: Scrape type for VL59163: 1
2026-03-28 18:44:39 [auto1.de] INFO: Found listing with ID: AH54106
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH54106%27 HTTP/1.1" 200 None
2026-03-28 18:44:39 [auto1.de] INFO: Scrape type for AH54106: 2
2026-03-28 18:44:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4a0dbcb-feb7-538a-b7ee-f3763978a16f with identifier: AH54106
2026-03-28 18:44:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4a0dbcb-feb7-538a-b7ee-f3763978a16f with scrape type 2
2026-03-28 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4a0dbcb-feb7-538a-b7ee-f3763978a16f with scrape type 2
2026-03-28 18:44:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4a0dbcb-feb7-538a-b7ee-f3763978a16f, identifier: AH54106
2026-03-28 18:44:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4a0dbcb-feb7-538a-b7ee-f3763978a16f with identifier: AH54106
2026-03-28 18:44:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4a0dbcb-feb7-538a-b7ee-f3763978a16f with identifier: AH54106
2026-03-28 18:44:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4a0dbcb-feb7-538a-b7ee-f3763978a16f with identifier: AH54106 to the API
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:01:41Z',
 'fuel_type': 'diesel',
 'id': 'b4a0dbcb-feb7-538a-b7ee-f3763978a16f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH54106',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 169901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-25',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH54106%27 HTTP/1.1" 200 None
2026-03-28 18:44:40 [auto1.de] INFO: Saving data for AH54106: {'auction_closing_time': 1774882901.0, 'created_time': 1774034126.898787, 'last_price_update_time': 1774723480.404863}
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH54106') HTTP/1.1" 204 0
2026-03-28 18:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_91b95d64be12d107462f08a4ee838b33.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:40 [auto1.de] INFO: Found listing with ID: WC53392
2026-03-28 18:44:40 [auto1.de] INFO: Found listing with ID: KB62882
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62882%27 HTTP/1.1" 200 None
2026-03-28 18:44:40 [auto1.de] INFO: Scrape type for KB62882: 1
2026-03-28 18:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV10415/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC39619/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:40 [auto1.de] INFO: Found listing with ID: JZ33625
2026-03-28 18:44:40 [auto1.de] INFO: Found listing with ID: SS01468
2026-03-28 18:44:40 [auto1.de] INFO: Found listing with ID: RX82336
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX82336%27 HTTP/1.1" 200 None
2026-03-28 18:44:40 [auto1.de] INFO: Scrape type for RX82336: 1
2026-03-28 18:44:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE81625> (referer: https://www.auto1.com/v1/car-details-view/BE81625/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:40 [auto1.de] INFO: Found listing with ID: VU61436
2026-03-28 18:44:40 [auto1.de] INFO: Found listing with ID: EW87662
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW87662%27 HTTP/1.1" 200 None
2026-03-28 18:44:40 [auto1.de] INFO: Scrape type for EW87662: 2
2026-03-28 18:44:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79540c1c-0156-5b32-b7cd-436a8d03764c with identifier: EW87662
2026-03-28 18:44:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79540c1c-0156-5b32-b7cd-436a8d03764c with scrape type 2
2026-03-28 18:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79540c1c-0156-5b32-b7cd-436a8d03764c with scrape type 2
2026-03-28 18:44:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79540c1c-0156-5b32-b7cd-436a8d03764c, identifier: EW87662
2026-03-28 18:44:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79540c1c-0156-5b32-b7cd-436a8d03764c with identifier: EW87662
2026-03-28 18:44:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79540c1c-0156-5b32-b7cd-436a8d03764c with identifier: EW87662
2026-03-28 18:44:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79540c1c-0156-5b32-b7cd-436a8d03764c with identifier: EW87662 to the API
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:08:12Z',
 'fuel_type': 'petrol',
 'id': '79540c1c-0156-5b32-b7cd-436a8d03764c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW87662',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 58912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-10',
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI quattro Coupe',
 'transmission': 'automatic',
 'trim': 'quattro Coupe',
 'year': 2017}
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW87662%27 HTTP/1.1" 200 None
2026-03-28 18:44:40 [auto1.de] INFO: Saving data for EW87662: {'auction_closing_time': 1774883292.0, 'created_time': 1774118742.161504, 'last_price_update_time': 1774723480.905315}
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW87662') HTTP/1.1" 204 0
2026-03-28 18:44:41 [auto1.de] INFO: Found listing with ID: KE07703
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE07703%27 HTTP/1.1" 200 None
2026-03-28 18:44:41 [auto1.de] INFO: Scrape type for KE07703: 2
2026-03-28 18:44:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1bcd5b1-8690-5a8d-acfe-b737031f1bd6 with identifier: KE07703
2026-03-28 18:44:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1bcd5b1-8690-5a8d-acfe-b737031f1bd6 with scrape type 2
2026-03-28 18:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1bcd5b1-8690-5a8d-acfe-b737031f1bd6 with scrape type 2
2026-03-28 18:44:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1bcd5b1-8690-5a8d-acfe-b737031f1bd6, identifier: KE07703
2026-03-28 18:44:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1bcd5b1-8690-5a8d-acfe-b737031f1bd6 with identifier: KE07703
2026-03-28 18:44:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1bcd5b1-8690-5a8d-acfe-b737031f1bd6 with identifier: KE07703
2026-03-28 18:44:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1bcd5b1-8690-5a8d-acfe-b737031f1bd6 with identifier: KE07703 to the API
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:01:31Z',
 'fuel_type': 'diesel',
 'id': 'a1bcd5b1-8690-5a8d-acfe-b737031f1bd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE07703',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 125848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-25',
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE07703%27 HTTP/1.1" 200 None
2026-03-28 18:44:41 [auto1.de] INFO: Saving data for KE07703: {'auction_closing_time': 1774882891.0, 'created_time': 1773427657.895962, 'last_price_update_time': 1774723481.508484}
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE07703') HTTP/1.1" 204 0
2026-03-28 18:44:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456058710>
2026-03-28 18:44:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_91b95d64be12d107462f08a4ee838b33.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_91b95d64be12d107462f08a4ee838b33.jpg saved to cache
2026-03-28 18:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e
2026-03-28 18:44:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae5199a5-1ebe-52b0-8ac9-992116b90421 with identifier: BE81625
2026-03-28 18:44:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae5199a5-1ebe-52b0-8ac9-992116b90421 with scrape type 1
2026-03-28 18:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae5199a5-1ebe-52b0-8ac9-992116b90421
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_f1a4d8f879afff5b4bbb75cfc3538c86.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_f1a4d8f879afff5b4bbb75cfc3538c86.jpg not downloaded yet
2026-03-28 18:44:41 [auto1.de] INFO: Found listing with ID: YD79813
2026-03-28 18:44:41 [auto1.de] INFO: Found listing with ID: WS06165
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06165%27 HTTP/1.1" 200 None
2026-03-28 18:44:41 [auto1.de] INFO: Scrape type for WS06165: 2
2026-03-28 18:44:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7d53189-39df-54df-96a7-7ff859397120 with identifier: WS06165
2026-03-28 18:44:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7d53189-39df-54df-96a7-7ff859397120 with scrape type 2
2026-03-28 18:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7d53189-39df-54df-96a7-7ff859397120 with scrape type 2
2026-03-28 18:44:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7d53189-39df-54df-96a7-7ff859397120, identifier: WS06165
2026-03-28 18:44:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7d53189-39df-54df-96a7-7ff859397120 with identifier: WS06165
2026-03-28 18:44:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7d53189-39df-54df-96a7-7ff859397120 with identifier: WS06165
2026-03-28 18:44:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7d53189-39df-54df-96a7-7ff859397120 with identifier: WS06165 to the API
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:34Z',
 'fuel_type': 'diesel',
 'id': 'd7d53189-39df-54df-96a7-7ff859397120',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS06165',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 96287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-18',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi Energy L2H2 HKa 3,5 Komfort',
 'transmission': 'manual',
 'trim': 'L2H2 HKa 3,5 Komfort',
 'year': 2023}
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06165%27 HTTP/1.1" 200 None
2026-03-28 18:44:42 [auto1.de] INFO: Saving data for WS06165: {'auction_closing_time': 1774884754.0, 'created_time': 1773429217.864546, 'last_price_update_time': 1774723482.028866}
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS06165') HTTP/1.1" 204 0
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_131aabc6b0735086a9ca51c8cd9e434f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_131aabc6b0735086a9ca51c8cd9e434f.jpg not downloaded yet
2026-03-28 18:44:42 [auto1.de] INFO: Found listing with ID: XE70546
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE70546%27 HTTP/1.1" 200 None
2026-03-28 18:44:42 [auto1.de] INFO: Scrape type for XE70546: 2
2026-03-28 18:44:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94e47550-1cba-5ee2-9b57-c588d8fcc0cf with identifier: XE70546
2026-03-28 18:44:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94e47550-1cba-5ee2-9b57-c588d8fcc0cf with scrape type 2
2026-03-28 18:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94e47550-1cba-5ee2-9b57-c588d8fcc0cf with scrape type 2
2026-03-28 18:44:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94e47550-1cba-5ee2-9b57-c588d8fcc0cf, identifier: XE70546
2026-03-28 18:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY60901> (referer: https://www.auto1.com/v1/car-details-view/UY60901/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW03502/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94e47550-1cba-5ee2-9b57-c588d8fcc0cf with identifier: XE70546
2026-03-28 18:44:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94e47550-1cba-5ee2-9b57-c588d8fcc0cf with identifier: XE70546
2026-03-28 18:44:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94e47550-1cba-5ee2-9b57-c588d8fcc0cf with identifier: XE70546 to the API
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:28Z',
 'fuel_type': 'diesel',
 'id': '94e47550-1cba-5ee2-9b57-c588d8fcc0cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE70546',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 143112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-28',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2018}
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE70546%27 HTTP/1.1" 200 None
2026-03-28 18:44:42 [auto1.de] INFO: Saving data for XE70546: {'auction_closing_time': 1774885828.0, 'created_time': 1774034279.192256, 'last_price_update_time': 1774723482.518645}
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE70546') HTTP/1.1" 204 0
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_fa14c1d27326a9d5d8c4cc5735eae66a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_fa14c1d27326a9d5d8c4cc5735eae66a.jpg not downloaded yet
2026-03-28 18:44:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:42 [auto1.de] INFO: Found listing with ID: JR23306
2026-03-28 18:44:42 [auto1.de] INFO: Found listing with ID: FK29510
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK29510%27 HTTP/1.1" 200 None
2026-03-28 18:44:42 [auto1.de] INFO: Scrape type for FK29510: 1
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_5d3335fd8ecea0f5ecda05cdb71080be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_5d3335fd8ecea0f5ecda05cdb71080be.jpg not downloaded yet
2026-03-28 18:44:42 [auto1.de] INFO: Found listing with ID: YN71631
2026-03-28 18:44:42 [auto1.de] INFO: Found listing with ID: AP27322
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27322%27 HTTP/1.1" 200 None
2026-03-28 18:44:42 [auto1.de] INFO: Scrape type for AP27322: 2
2026-03-28 18:44:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1b7d8c3-b009-5f71-a5b8-85f007982ed5 with identifier: AP27322
2026-03-28 18:44:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1b7d8c3-b009-5f71-a5b8-85f007982ed5 with scrape type 2
2026-03-28 18:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1b7d8c3-b009-5f71-a5b8-85f007982ed5 with scrape type 2
2026-03-28 18:44:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1b7d8c3-b009-5f71-a5b8-85f007982ed5, identifier: AP27322
2026-03-28 18:44:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3865c2e-3891-5656-982a-919ba8851b55 with identifier: UY60901
2026-03-28 18:44:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3865c2e-3891-5656-982a-919ba8851b55 with scrape type 1
2026-03-28 18:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3865c2e-3891-5656-982a-919ba8851b55
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_e55f0fe0e9340813c57723bb75ce99a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_e55f0fe0e9340813c57723bb75ce99a9.jpg not downloaded yet
2026-03-28 18:44:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1b7d8c3-b009-5f71-a5b8-85f007982ed5 with identifier: AP27322
2026-03-28 18:44:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1b7d8c3-b009-5f71-a5b8-85f007982ed5 with identifier: AP27322
2026-03-28 18:44:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1b7d8c3-b009-5f71-a5b8-85f007982ed5 with identifier: AP27322 to the API
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:45:34Z',
 'fuel_type': 'petrol',
 'id': 'f1b7d8c3-b009-5f71-a5b8-85f007982ed5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP27322',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 63546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-09',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27322%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [auto1.de] INFO: Saving data for AP27322: {'auction_closing_time': 1774885534.0, 'created_time': 1774031765.300595, 'last_price_update_time': 1774723483.049404}
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP27322') HTTP/1.1" 204 0
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_0f8c039e2aad0a52ddb5087e0ff3d13f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_0f8c039e2aad0a52ddb5087e0ff3d13f.jpg not downloaded yet
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: NW52708
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW52708%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [auto1.de] INFO: Scrape type for NW52708: 1
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_1c1dfc881616aab1515c5ae47d4bba64.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_1c1dfc881616aab1515c5ae47d4bba64.jpg not downloaded yet
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_f3ce313902409f15e139ecb87bf9e4c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_f3ce313902409f15e139ecb87bf9e4c7.jpg not downloaded yet
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: NH18171
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH18171%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [auto1.de] INFO: Scrape type for NH18171: 2
2026-03-28 18:44:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6434537c-c830-551c-819b-37c664f296fe with identifier: NH18171
2026-03-28 18:44:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6434537c-c830-551c-819b-37c664f296fe with scrape type 2
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6434537c-c830-551c-819b-37c664f296fe with scrape type 2
2026-03-28 18:44:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6434537c-c830-551c-819b-37c664f296fe, identifier: NH18171
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_5b56fef93574d68d62c93a1b46d72528.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_5b56fef93574d68d62c93a1b46d72528.jpg not downloaded yet
2026-03-28 18:44:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6434537c-c830-551c-819b-37c664f296fe with identifier: NH18171
2026-03-28 18:44:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6434537c-c830-551c-819b-37c664f296fe with identifier: NH18171
2026-03-28 18:44:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6434537c-c830-551c-819b-37c664f296fe with identifier: NH18171 to the API
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:09:58Z',
 'fuel_type': 'petrol',
 'id': '6434537c-c830-551c-819b-37c664f296fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH18171',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 33330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-22',
 'seller_name': None,
 'title': 'Renault Captur 0.9 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2019}
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH18171%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [auto1.de] INFO: Saving data for NH18171: {'auction_closing_time': 1774883398.0, 'created_time': 1774118372.477069, 'last_price_update_time': 1774723483.628595}
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH18171') HTTP/1.1" 204 0
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_d0dcd056698ae463ff3f3dce0f4d95c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_d0dcd056698ae463ff3f3dce0f4d95c6.jpg not downloaded yet
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: EM86154
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: JN22818
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN22818%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [auto1.de] INFO: Scrape type for JN22818: 1
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_75d7c9fb69da680c030927dbf50f45b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_75d7c9fb69da680c030927dbf50f45b8.jpg not downloaded yet
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_d79305ca314ec428389c2422a9fd0279.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_d79305ca314ec428389c2422a9fd0279.jpg not downloaded yet
2026-03-28 18:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC92138/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: SK06184
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: SZ07968
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: RT44513
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: JB74543
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: HX73394
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: ES38254
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: PU69799
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: BM68891
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: AN35443
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: XA64298
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA64298%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [auto1.de] INFO: Scrape type for XA64298: 1
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_10675433c81f01f207fd8cfe382b499f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_10675433c81f01f207fd8cfe382b499f.jpg not downloaded yet
2026-03-28 18:44:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN30135> (referer: https://www.auto1.com/v1/car-details-view/MN30135/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_b9b35e7af6db165d154fd9a42d357311.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_b9b35e7af6db165d154fd9a42d357311.jpg not downloaded yet
2026-03-28 18:44:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: FU18032
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU18032%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [auto1.de] INFO: Scrape type for FU18032: 1
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_54960e5803559128a3bac7925ec39d4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_54960e5803559128a3bac7925ec39d4a.jpg not downloaded yet
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_d68f3674d503669fcc4166f75f7fcecc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_d68f3674d503669fcc4166f75f7fcecc.jpg not downloaded yet
2026-03-28 18:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR61927> (referer: https://www.auto1.com/v1/car-details-view/LR61927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: RT07537
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT07537%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [auto1.de] INFO: Scrape type for RT07537: 1
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_e12d23832415cfb437b15a811df4c532.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_e12d23832415cfb437b15a811df4c532.jpg not downloaded yet
2026-03-28 18:44:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: CP64572
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: CA31284
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: JE64211
2026-03-28 18:44:43 [auto1.de] INFO: Found listing with ID: FJ20192
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ20192%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [auto1.de] INFO: Scrape type for FJ20192: 2
2026-03-28 18:44:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b0a2038-466e-5898-8c5e-1c50a9fd499f with identifier: FJ20192
2026-03-28 18:44:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b0a2038-466e-5898-8c5e-1c50a9fd499f with scrape type 2
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b0a2038-466e-5898-8c5e-1c50a9fd499f with scrape type 2
2026-03-28 18:44:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b0a2038-466e-5898-8c5e-1c50a9fd499f, identifier: FJ20192
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_3f0fa036f4fea9fda4b7bc66e9fa5faa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_3f0fa036f4fea9fda4b7bc66e9fa5faa.jpg not downloaded yet
2026-03-28 18:44:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b0a2038-466e-5898-8c5e-1c50a9fd499f with identifier: FJ20192
2026-03-28 18:44:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b0a2038-466e-5898-8c5e-1c50a9fd499f with identifier: FJ20192
2026-03-28 18:44:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b0a2038-466e-5898-8c5e-1c50a9fd499f with identifier: FJ20192 to the API
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:29:54Z',
 'fuel_type': 'petrol',
 'id': '6b0a2038-466e-5898-8c5e-1c50a9fd499f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ20192',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 103731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-10',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ20192%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [auto1.de] INFO: Saving data for FJ20192: {'auction_closing_time': 1774884594.0, 'created_time': 1774464391.444324, 'last_price_update_time': 1774723484.387514}
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ20192') HTTP/1.1" 204 0
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_b2b966d3baf0bdcc1caae3d1bad48da9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_b2b966d3baf0bdcc1caae3d1bad48da9.jpg not downloaded yet
2026-03-28 18:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF95367/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_768c3b0b476b4c5e448b6c4e1c9cd813.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_768c3b0b476b4c5e448b6c4e1c9cd813.jpg not downloaded yet
2026-03-28 18:44:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN85056> (referer: https://www.auto1.com/v1/car-details-view/DN85056/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YE71263/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9c7e85a-099a-5974-88e1-a43d3a7ae8d2 with identifier: MN30135
2026-03-28 18:44:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2 with scrape type 1
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_8ff416105566bec1af86658ae35833b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_8ff416105566bec1af86658ae35833b6.jpg not downloaded yet
2026-03-28 18:44:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ef68d61-efa4-54e0-b308-8b263cf39bd2 with identifier: LR61927
2026-03-28 18:44:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2 with scrape type 1
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_9f7a00689f9ef9ef1c0ae3312d084c42.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_9f7a00689f9ef9ef1c0ae3312d084c42.jpg not downloaded yet
2026-03-28 18:44:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_091f7e214d1495a364cb663dded32ea8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_091f7e214d1495a364cb663dded32ea8.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_e4e02a91f343495be3ce8a6b7f787140.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_e4e02a91f343495be3ce8a6b7f787140.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_3fcea4a7b124855ed69988bef7e3d50c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_3fcea4a7b124855ed69988bef7e3d50c.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_f68a3f4e48082f7aad743c6ab1ec4033.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_f68a3f4e48082f7aad743c6ab1ec4033.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_6e7c636fb96d6aa34fb48a0cf281fec0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_6e7c636fb96d6aa34fb48a0cf281fec0.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_02e7b6065da3d39b82be4c1bf861becd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_02e7b6065da3d39b82be4c1bf861becd.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_f9537652860648233b42c3aeb07c841d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_f9537652860648233b42c3aeb07c841d.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_f4aaf2abb0dff332bc1dbdc8293d6dbe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_f4aaf2abb0dff332bc1dbdc8293d6dbe.jpg not downloaded yet
2026-03-28 18:44:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3547840c-581b-5de6-9e40-95ddef174f8d with identifier: DN85056
2026-03-28 18:44:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3547840c-581b-5de6-9e40-95ddef174f8d with scrape type 1
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3547840c-581b-5de6-9e40-95ddef174f8d
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_e4810e3d1f54e118847e223ae4fee443.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_e4810e3d1f54e118847e223ae4fee443.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_2516b0e4b635e85b6d20bf5d63b0ae95.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_2516b0e4b635e85b6d20bf5d63b0ae95.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_1e722cbce2a7f0711bf7dec16e729ca5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_1e722cbce2a7f0711bf7dec16e729ca5.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_d7fb97f6a3d116ecb52c2bc645e69628.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_d7fb97f6a3d116ecb52c2bc645e69628.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_5c87e2fd4bd3457ddfa1315b3761d785.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_5c87e2fd4bd3457ddfa1315b3761d785.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_f6dcbe719b8a6262db59fdb522021026.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_f6dcbe719b8a6262db59fdb522021026.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_d81aa7571442521203f559f0a6b94900.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_d81aa7571442521203f559f0a6b94900.jpg not downloaded yet
2026-03-28 18:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_3f0fa036f4fea9fda4b7bc66e9fa5faa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_81dd44dd5e0fecc96beecc0262fcaed8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_81dd44dd5e0fecc96beecc0262fcaed8.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_cbd7b2f53d5e2692b0f3f40d3baa3762.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_cbd7b2f53d5e2692b0f3f40d3baa3762.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_2b24ff28c115a14ccc442b6337d18b88.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_2b24ff28c115a14ccc442b6337d18b88.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_bf818a2f8f7f1bb90cec5461b7c57035.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_bf818a2f8f7f1bb90cec5461b7c57035.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_43d1a4f42473ac809fb4d4345878c4cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_43d1a4f42473ac809fb4d4345878c4cd.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_006c5ce64f14d1c6aabe59203144e916.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_006c5ce64f14d1c6aabe59203144e916.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_3a1d5338e3fd79b89367e120b3cad189.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_3a1d5338e3fd79b89367e120b3cad189.jpg not downloaded yet
2026-03-28 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_5879e666b21dbdb627ca55409b199ae6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_5879e666b21dbdb627ca55409b199ae6.jpg not downloaded yet
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_3322cea6d17a43bf07a3a23e1b1a2c44.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_3322cea6d17a43bf07a3a23e1b1a2c44.jpg not downloaded yet
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_662c4a35eec55e40f8fb13e4bb8b85b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_662c4a35eec55e40f8fb13e4bb8b85b3.jpg not downloaded yet
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456199ed0>
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_3f0fa036f4fea9fda4b7bc66e9fa5faa.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_3f0fa036f4fea9fda4b7bc66e9fa5faa.jpg saved to cache
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3865c2e-3891-5656-982a-919ba8851b55
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_83ed4af40e1aeedd7a61e6873f382fa1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_83ed4af40e1aeedd7a61e6873f382fa1.jpg not downloaded yet
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_e69aea03c5faf52a15d3f70ade14c341.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_e69aea03c5faf52a15d3f70ade14c341.jpg not downloaded yet
2026-03-28 18:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_f6dcbe719b8a6262db59fdb522021026.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS79135> (referer: https://www.auto1.com/v1/car-details-view/PS79135/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_be7394f163ac92c9c60205bd887c1d7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_be7394f163ac92c9c60205bd887c1d7d.jpg not downloaded yet
2026-03-28 18:44:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_54960e5803559128a3bac7925ec39d4a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_75d7c9fb69da680c030927dbf50f45b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_f1a4d8f879afff5b4bbb75cfc3538c86.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_131aabc6b0735086a9ca51c8cd9e434f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_b2b966d3baf0bdcc1caae3d1bad48da9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_d79305ca314ec428389c2422a9fd0279.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_e69aea03c5faf52a15d3f70ade14c341.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_83ed4af40e1aeedd7a61e6873f382fa1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855d850>
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_f6dcbe719b8a6262db59fdb522021026.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_f6dcbe719b8a6262db59fdb522021026.jpg saved to cache
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2
2026-03-28 18:44:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55dbdf91-7561-58c2-8e0d-cba238364bf9 with identifier: PS79135
2026-03-28 18:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55dbdf91-7561-58c2-8e0d-cba238364bf9 with scrape type 1
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55dbdf91-7561-58c2-8e0d-cba238364bf9
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_fea3f6ec0ee237e124103cc5597bc563.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_fea3f6ec0ee237e124103cc5597bc563.jpg not downloaded yet
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_8b2fe3ab874abdccb27892e340f648ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_8b2fe3ab874abdccb27892e340f648ad.jpg not downloaded yet
2026-03-28 18:44:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855e390>
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_54960e5803559128a3bac7925ec39d4a.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_54960e5803559128a3bac7925ec39d4a.jpg saved to cache
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3865c2e-3891-5656-982a-919ba8851b55
2026-03-28 18:44:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245627c150>
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_75d7c9fb69da680c030927dbf50f45b8.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_75d7c9fb69da680c030927dbf50f45b8.jpg saved to cache
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3865c2e-3891-5656-982a-919ba8851b55
2026-03-28 18:44:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456063050>
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_f1a4d8f879afff5b4bbb75cfc3538c86.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_f1a4d8f879afff5b4bbb75cfc3538c86.jpg saved to cache
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae5199a5-1ebe-52b0-8ac9-992116b90421
2026-03-28 18:44:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456130790>
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_131aabc6b0735086a9ca51c8cd9e434f.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_131aabc6b0735086a9ca51c8cd9e434f.jpg saved to cache
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae5199a5-1ebe-52b0-8ac9-992116b90421
2026-03-28 18:44:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245608d050>
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_b2b966d3baf0bdcc1caae3d1bad48da9.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_b2b966d3baf0bdcc1caae3d1bad48da9.jpg saved to cache
2026-03-28 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3865c2e-3891-5656-982a-919ba8851b55
2026-03-28 18:44:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456193290>
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_d79305ca314ec428389c2422a9fd0279.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_d79305ca314ec428389c2422a9fd0279.jpg saved to cache
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae5199a5-1ebe-52b0-8ac9-992116b90421
2026-03-28 18:44:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563771d0>
2026-03-28 18:44:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_e69aea03c5faf52a15d3f70ade14c341.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_e69aea03c5faf52a15d3f70ade14c341.jpg saved to cache
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3547840c-581b-5de6-9e40-95ddef174f8d
2026-03-28 18:44:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456376b50>
2026-03-28 18:44:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_83ed4af40e1aeedd7a61e6873f382fa1.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_83ed4af40e1aeedd7a61e6873f382fa1.jpg saved to cache
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3547840c-581b-5de6-9e40-95ddef174f8d
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_fc852801fe5a9ba11a366d2d2edf12bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_fc852801fe5a9ba11a366d2d2edf12bd.jpg not downloaded yet
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_d3d2a2257d70ea204353cedc18fc8521.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_d3d2a2257d70ea204353cedc18fc8521.jpg not downloaded yet
2026-03-28 18:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB58662> (referer: https://www.auto1.com/v1/car-details-view/CB58662/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL59163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB62882/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ90544> (referer: https://www.auto1.com/v1/car-details-view/TZ90544/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY39264/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_e42972433614633c025b4c4af82b714b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_e42972433614633c025b4c4af82b714b.jpg not downloaded yet
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_1e88615675caa92e443c9aaa0737e055.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_1e88615675caa92e443c9aaa0737e055.jpg not downloaded yet
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_f5c846a0f20f42e371019f50d4850d68.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_f5c846a0f20f42e371019f50d4850d68.jpg not downloaded yet
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_b228d3591b3c8023e8fcebd278f93ed2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_b228d3591b3c8023e8fcebd278f93ed2.jpg not downloaded yet
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_7d604f739567a9cd9675e971635240a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_7d604f739567a9cd9675e971635240a0.jpg not downloaded yet
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_399af50c061bc14b180f0201ba5306ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_399af50c061bc14b180f0201ba5306ef.jpg not downloaded yet
2026-03-28 18:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fa8b7b5-e78f-516c-8dde-c54186f576df with identifier: CB58662
2026-03-28 18:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fa8b7b5-e78f-516c-8dde-c54186f576df with scrape type 1
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fa8b7b5-e78f-516c-8dde-c54186f576df
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff8%252F14f8577e9e6b7fd35bcf25a8bbe9eae5%252Fpa%252FCB58662_b4ea8a0d0425934554f6e73fbe803f1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_b4ea8a0d0425934554f6e73fbe803f1e.jpg already downloaded
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff8%252F14f8577e9e6b7fd35bcf25a8bbe9eae5%252Fpa%252FCB58662_ecd1073918a032cbb0ad655b903af8fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_ecd1073918a032cbb0ad655b903af8fb.jpg already downloaded
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff8%252F14f8577e9e6b7fd35bcf25a8bbe9eae5%252Fpa%252FCB58662_8542247214757405a072870629ce07d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_8542247214757405a072870629ce07d9.jpg already downloaded
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff8%252F14f8577e9e6b7fd35bcf25a8bbe9eae5%252Fpa%252FCB58662_de9bb958ee269109e54ea93206a7646d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_de9bb958ee269109e54ea93206a7646d.jpg already downloaded
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff8%252F14f8577e9e6b7fd35bcf25a8bbe9eae5%252Fpa%252FCB58662_d2e27c97e10abec748106f0c46947e11.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_d2e27c97e10abec748106f0c46947e11.jpg already downloaded
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff8%252F14f8577e9e6b7fd35bcf25a8bbe9eae5%252Fpa%252FCB58662_e80f55c5bb4d1220ff9096b1dfb612d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_e80f55c5bb4d1220ff9096b1dfb612d9.jpg already downloaded
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff8%252F14f8577e9e6b7fd35bcf25a8bbe9eae5%252Fpa%252FCB58662_55b4bd7b306153da86d75a28deb0f2d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_55b4bd7b306153da86d75a28deb0f2d1.jpg already downloaded
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff8%252F14f8577e9e6b7fd35bcf25a8bbe9eae5%252Fpa%252FCB58662_42dc950280ffb6c7fd65b7f7d6b3c748.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_42dc950280ffb6c7fd65b7f7d6b3c748.jpg already downloaded
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff8%252F14f8577e9e6b7fd35bcf25a8bbe9eae5%252Fpa%252FCB58662_d27e364720e921969e2482cb91b24dec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_d27e364720e921969e2482cb91b24dec.jpg already downloaded
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Ff8%252F14f8577e9e6b7fd35bcf25a8bbe9eae5%252Fpa%252FCB58662_472f872e225f12d0a05cf1d94035d485.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_472f872e225f12d0a05cf1d94035d485.jpg already downloaded
2026-03-28 18:44:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fa8b7b5-e78f-516c-8dde-c54186f576df, identifier: CB58662
2026-03-28 18:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 064bc42b-c995-5dd4-92a4-4cce0eb30571 with identifier: TZ90544
2026-03-28 18:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 064bc42b-c995-5dd4-92a4-4cce0eb30571 with scrape type 1
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 064bc42b-c995-5dd4-92a4-4cce0eb30571
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_80756a2bfaccd587f6c9c07ec06063cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_80756a2bfaccd587f6c9c07ec06063cf.jpg not downloaded yet
2026-03-28 18:44:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fa8b7b5-e78f-516c-8dde-c54186f576df with identifier: CB58662
2026-03-28 18:44:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fa8b7b5-e78f-516c-8dde-c54186f576df with identifier: CB58662
2026-03-28 18:44:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fa8b7b5-e78f-516c-8dde-c54186f576df with identifier: CB58662 to the API
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CB58662>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:05Z',
 'fuel_type': 'diesel',
 'id': '1fa8b7b5-e78f-516c-8dde-c54186f576df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB58662',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 202054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_b4ea8a0d0425934554f6e73fbe803f1e.jpg',
                'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_ecd1073918a032cbb0ad655b903af8fb.jpg',
                'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_8542247214757405a072870629ce07d9.jpg',
                'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_de9bb958ee269109e54ea93206a7646d.jpg',
                'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_d2e27c97e10abec748106f0c46947e11.jpg',
                'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_e80f55c5bb4d1220ff9096b1dfb612d9.jpg',
                'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_55b4bd7b306153da86d75a28deb0f2d1.jpg',
                'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_42dc950280ffb6c7fd65b7f7d6b3c748.jpg',
                'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_d27e364720e921969e2482cb91b24dec.jpg',
                'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_472f872e225f12d0a05cf1d94035d485.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fa8b7b5-e78f-516c-8dde-c54186f576df/1fa8b7b5-e78f-516c-8dde-c54186f576df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_b4ea8a0d0425934554f6e73fbe803f1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fa8b7b5-e78f-516c-8dde-c54186f576df/1fa8b7b5-e78f-516c-8dde-c54186f576df_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_ecd1073918a032cbb0ad655b903af8fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fa8b7b5-e78f-516c-8dde-c54186f576df/1fa8b7b5-e78f-516c-8dde-c54186f576df_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_8542247214757405a072870629ce07d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fa8b7b5-e78f-516c-8dde-c54186f576df/1fa8b7b5-e78f-516c-8dde-c54186f576df_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_de9bb958ee269109e54ea93206a7646d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fa8b7b5-e78f-516c-8dde-c54186f576df/1fa8b7b5-e78f-516c-8dde-c54186f576df_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_d2e27c97e10abec748106f0c46947e11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fa8b7b5-e78f-516c-8dde-c54186f576df/1fa8b7b5-e78f-516c-8dde-c54186f576df_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_e80f55c5bb4d1220ff9096b1dfb612d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fa8b7b5-e78f-516c-8dde-c54186f576df/1fa8b7b5-e78f-516c-8dde-c54186f576df_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_55b4bd7b306153da86d75a28deb0f2d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fa8b7b5-e78f-516c-8dde-c54186f576df/1fa8b7b5-e78f-516c-8dde-c54186f576df_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_42dc950280ffb6c7fd65b7f7d6b3c748.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fa8b7b5-e78f-516c-8dde-c54186f576df/1fa8b7b5-e78f-516c-8dde-c54186f576df_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_d27e364720e921969e2482cb91b24dec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fa8b7b5-e78f-516c-8dde-c54186f576df/1fa8b7b5-e78f-516c-8dde-c54186f576df_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/f8/14f8577e9e6b7fd35bcf25a8bbe9eae5/pa/CB58662_472f872e225f12d0a05cf1d94035d485.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2017}
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB58662%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [auto1.de] INFO: Saving data for CB58662: {'created_time': 1774723487.081927, 'last_price_update_time': 1774723487.081939, 'auction_closing_time': 1774885565.0}
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB58662') HTTP/1.1" 204 0
2026-03-28 18:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_3a1d5338e3fd79b89367e120b3cad189.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_fe45be8daa63b3ad248a1dc4e713a55d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_fe45be8daa63b3ad248a1dc4e713a55d.jpg not downloaded yet
2026-03-28 18:44:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_5879e666b21dbdb627ca55409b199ae6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_86ba15c8c62d65f9aaea6fd0d5ff1361.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_86ba15c8c62d65f9aaea6fd0d5ff1361.jpg not downloaded yet
2026-03-28 18:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC92138> (referer: https://www.auto1.com/v1/car-details-view/EC92138/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_afd1d0e66e4b7a5f66ad3431aa0e4007.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_afd1d0e66e4b7a5f66ad3431aa0e4007.jpg not downloaded yet
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_821ad3ba67df68e3aa7bafba98933b7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_821ad3ba67df68e3aa7bafba98933b7c.jpg not downloaded yet
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_18bc0494f2ab500104cd10311aadda34.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_18bc0494f2ab500104cd10311aadda34.jpg not downloaded yet
2026-03-28 18:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_006c5ce64f14d1c6aabe59203144e916.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547cd290>
2026-03-28 18:44:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_3a1d5338e3fd79b89367e120b3cad189.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_3a1d5338e3fd79b89367e120b3cad189.jpg saved to cache
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_ec8b73c1562104a26ad0834643d85c89.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_ec8b73c1562104a26ad0834643d85c89.jpg not downloaded yet
2026-03-28 18:44:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a6150>
2026-03-28 18:44:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_5879e666b21dbdb627ca55409b199ae6.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_5879e666b21dbdb627ca55409b199ae6.jpg saved to cache
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2
2026-03-28 18:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_662c4a35eec55e40f8fb13e4bb8b85b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_01d2c3592e0a7df8d8f28570760edb47.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_01d2c3592e0a7df8d8f28570760edb47.jpg not downloaded yet
2026-03-28 18:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_43d1a4f42473ac809fb4d4345878c4cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_22598b824f440de79c7d24cf2a318e82.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_22598b824f440de79c7d24cf2a318e82.jpg not downloaded yet
2026-03-28 18:44:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3 with identifier: EC92138
2026-03-28 18:44:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3 with scrape type 1
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6d%252F186df9dab80672201a0aa7cd3cb14757%252Fpa%252FEC92138_35f56ca8d568ad40040156b6d176af39.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_35f56ca8d568ad40040156b6d176af39.jpg already downloaded
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6d%252F186df9dab80672201a0aa7cd3cb14757%252Fpa%252FEC92138_bb83ccf0a80bd49d753f26d908e5038d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_bb83ccf0a80bd49d753f26d908e5038d.jpg already downloaded
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6d%252F186df9dab80672201a0aa7cd3cb14757%252Fpa%252FEC92138_768ef86491e07816e1c9ee693a7c0ad4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_768ef86491e07816e1c9ee693a7c0ad4.jpg already downloaded
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6d%252F186df9dab80672201a0aa7cd3cb14757%252Fpa%252FEC92138_2a51363fc6b0db669a65cdfbf30a71e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_2a51363fc6b0db669a65cdfbf30a71e3.jpg already downloaded
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6d%252F186df9dab80672201a0aa7cd3cb14757%252Fpa%252FEC92138_43eeaadf67c696b04dc7953f1a0996a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_43eeaadf67c696b04dc7953f1a0996a8.jpg already downloaded
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6d%252F186df9dab80672201a0aa7cd3cb14757%252Fpa%252FEC92138_0a8803b5ade9aa2e7da7671b9ba7395e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_0a8803b5ade9aa2e7da7671b9ba7395e.jpg already downloaded
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6d%252F186df9dab80672201a0aa7cd3cb14757%252Fpa%252FEC92138_4370bca82a7ac43c766906df7eeddfa0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_4370bca82a7ac43c766906df7eeddfa0.jpg already downloaded
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6d%252F186df9dab80672201a0aa7cd3cb14757%252Fpa%252FEC92138_64f263d7f157e3e84c256b87d0e4fe2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_64f263d7f157e3e84c256b87d0e4fe2e.jpg already downloaded
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6d%252F186df9dab80672201a0aa7cd3cb14757%252Fpa%252FEC92138_0e709c826748d93ec0f1b809fef7eb68.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_0e709c826748d93ec0f1b809fef7eb68.jpg already downloaded
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6d%252F186df9dab80672201a0aa7cd3cb14757%252Fpa%252FEC92138_8583ceb0909879a547ca718512177b24.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_8583ceb0909879a547ca718512177b24.jpg already downloaded
2026-03-28 18:44:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3, identifier: EC92138
2026-03-28 18:44:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456097950>
2026-03-28 18:44:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_006c5ce64f14d1c6aabe59203144e916.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_006c5ce64f14d1c6aabe59203144e916.jpg saved to cache
2026-03-28 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3547840c-581b-5de6-9e40-95ddef174f8d
2026-03-28 18:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_be7394f163ac92c9c60205bd887c1d7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3 with identifier: EC92138
2026-03-28 18:44:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3 with identifier: EC92138
2026-03-28 18:44:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3 with identifier: EC92138 to the API
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EC92138>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:33:20Z',
 'fuel_type': 'petrol',
 'id': '445ea4df-4e5f-5af7-bbf4-d142ba7f80e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC92138',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'make': 'Alfa Romeo',
 'model': 'Tonale',
 'odometer': 83614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_35f56ca8d568ad40040156b6d176af39.jpg',
                'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_bb83ccf0a80bd49d753f26d908e5038d.jpg',
                'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_768ef86491e07816e1c9ee693a7c0ad4.jpg',
                'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_2a51363fc6b0db669a65cdfbf30a71e3.jpg',
                'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_43eeaadf67c696b04dc7953f1a0996a8.jpg',
                'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_0a8803b5ade9aa2e7da7671b9ba7395e.jpg',
                'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_4370bca82a7ac43c766906df7eeddfa0.jpg',
                'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_64f263d7f157e3e84c256b87d0e4fe2e.jpg',
                'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_0e709c826748d93ec0f1b809fef7eb68.jpg',
                'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_8583ceb0909879a547ca718512177b24.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445ea4df-4e5f-5af7-bbf4-d142ba7f80e3/445ea4df-4e5f-5af7-bbf4-d142ba7f80e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_35f56ca8d568ad40040156b6d176af39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445ea4df-4e5f-5af7-bbf4-d142ba7f80e3/445ea4df-4e5f-5af7-bbf4-d142ba7f80e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_bb83ccf0a80bd49d753f26d908e5038d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445ea4df-4e5f-5af7-bbf4-d142ba7f80e3/445ea4df-4e5f-5af7-bbf4-d142ba7f80e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_768ef86491e07816e1c9ee693a7c0ad4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445ea4df-4e5f-5af7-bbf4-d142ba7f80e3/445ea4df-4e5f-5af7-bbf4-d142ba7f80e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_2a51363fc6b0db669a65cdfbf30a71e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445ea4df-4e5f-5af7-bbf4-d142ba7f80e3/445ea4df-4e5f-5af7-bbf4-d142ba7f80e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_43eeaadf67c696b04dc7953f1a0996a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445ea4df-4e5f-5af7-bbf4-d142ba7f80e3/445ea4df-4e5f-5af7-bbf4-d142ba7f80e3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_0a8803b5ade9aa2e7da7671b9ba7395e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445ea4df-4e5f-5af7-bbf4-d142ba7f80e3/445ea4df-4e5f-5af7-bbf4-d142ba7f80e3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_4370bca82a7ac43c766906df7eeddfa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445ea4df-4e5f-5af7-bbf4-d142ba7f80e3/445ea4df-4e5f-5af7-bbf4-d142ba7f80e3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_64f263d7f157e3e84c256b87d0e4fe2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445ea4df-4e5f-5af7-bbf4-d142ba7f80e3/445ea4df-4e5f-5af7-bbf4-d142ba7f80e3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_0e709c826748d93ec0f1b809fef7eb68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445ea4df-4e5f-5af7-bbf4-d142ba7f80e3/445ea4df-4e5f-5af7-bbf4-d142ba7f80e3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6d/186df9dab80672201a0aa7cd3cb14757/pa/EC92138_8583ceb0909879a547ca718512177b24.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Sprint',
 'transmission': 'automatic',
 'trim': 'Sprint',
 'year': 2023}
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC92138%27 HTTP/1.1" 200 None
2026-03-28 18:44:48 [auto1.de] INFO: Saving data for EC92138: {'created_time': 1774723488.080194, 'last_price_update_time': 1774723488.080205, 'auction_closing_time': 1774884800.0}
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC92138') HTTP/1.1" 204 0
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_29f99ee86e1a822632c1b0b487a1b37e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_29f99ee86e1a822632c1b0b487a1b37e.jpg not downloaded yet
2026-03-28 18:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_bf818a2f8f7f1bb90cec5461b7c57035.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV44457> (referer: https://www.auto1.com/v1/car-details-view/CV44457/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_cbd7b2f53d5e2692b0f3f40d3baa3762.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456180510>
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_662c4a35eec55e40f8fb13e4bb8b85b3.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_662c4a35eec55e40f8fb13e4bb8b85b3.jpg saved to cache
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3547840c-581b-5de6-9e40-95ddef174f8d
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a41d0>
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_43d1a4f42473ac809fb4d4345878c4cd.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_43d1a4f42473ac809fb4d4345878c4cd.jpg saved to cache
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2
2026-03-28 18:44:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456409050>
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_be7394f163ac92c9c60205bd887c1d7d.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_be7394f163ac92c9c60205bd887c1d7d.jpg saved to cache
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3547840c-581b-5de6-9e40-95ddef174f8d
2026-03-28 18:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_80756a2bfaccd587f6c9c07ec06063cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456263c10>
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_bf818a2f8f7f1bb90cec5461b7c57035.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_bf818a2f8f7f1bb90cec5461b7c57035.jpg saved to cache
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2
2026-03-28 18:44:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a762c6e-42ea-5b31-a42c-234875b02206 with identifier: CV44457
2026-03-28 18:44:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a762c6e-42ea-5b31-a42c-234875b02206 with scrape type 1
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a762c6e-42ea-5b31-a42c-234875b02206
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_bebfcee574cb89883afb76ff95910754.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_bebfcee574cb89883afb76ff95910754.jpg not downloaded yet
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561bccd0>
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_cbd7b2f53d5e2692b0f3f40d3baa3762.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_cbd7b2f53d5e2692b0f3f40d3baa3762.jpg saved to cache
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_6d0d73799414da6f930604a7dbdc01fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_6d0d73799414da6f930604a7dbdc01fe.jpg not downloaded yet
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_88b3c5aa6a45126ebea1131543c47a5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_88b3c5aa6a45126ebea1131543c47a5d.jpg not downloaded yet
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_aca34d78d6175ed50a6a9d8becca409c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_aca34d78d6175ed50a6a9d8becca409c.jpg not downloaded yet
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b9110>
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_80756a2bfaccd587f6c9c07ec06063cf.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_80756a2bfaccd587f6c9c07ec06063cf.jpg saved to cache
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 064bc42b-c995-5dd4-92a4-4cce0eb30571
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_1b9cd8a36a6888a4350d03816e5f5370.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_1b9cd8a36a6888a4350d03816e5f5370.jpg not downloaded yet
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_34dccff6712c5dde67da04e1dc764530.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_34dccff6712c5dde67da04e1dc764530.jpg not downloaded yet
2026-03-28 18:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_821ad3ba67df68e3aa7bafba98933b7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_3ba58f841920130287059859145e3563.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_3ba58f841920130287059859145e3563.jpg not downloaded yet
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_a7dafe4e5a8dea4c4337413106eef990.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_a7dafe4e5a8dea4c4337413106eef990.jpg not downloaded yet
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_f3ad70f58c4447206f4f8d0c589b36c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_f3ad70f58c4447206f4f8d0c589b36c2.jpg not downloaded yet
2026-03-28 18:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_ec8b73c1562104a26ad0834643d85c89.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_e39ac52e250ccdc8a96af99f2c7c960c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_e39ac52e250ccdc8a96af99f2c7c960c.jpg not downloaded yet
2026-03-28 18:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_3322cea6d17a43bf07a3a23e1b1a2c44.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_8b2fe3ab874abdccb27892e340f648ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_fc852801fe5a9ba11a366d2d2edf12bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_fea3f6ec0ee237e124103cc5597bc563.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_2b24ff28c115a14ccc442b6337d18b88.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_fe45be8daa63b3ad248a1dc4e713a55d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b8290>
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_821ad3ba67df68e3aa7bafba98933b7c.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_821ad3ba67df68e3aa7bafba98933b7c.jpg saved to cache
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 064bc42b-c995-5dd4-92a4-4cce0eb30571
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562e2f10>
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_ec8b73c1562104a26ad0834643d85c89.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_ec8b73c1562104a26ad0834643d85c89.jpg saved to cache
2026-03-28 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 064bc42b-c995-5dd4-92a4-4cce0eb30571
2026-03-28 18:44:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560ad4d0>
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_3322cea6d17a43bf07a3a23e1b1a2c44.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_3322cea6d17a43bf07a3a23e1b1a2c44.jpg saved to cache
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3547840c-581b-5de6-9e40-95ddef174f8d
2026-03-28 18:44:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245640eb50>
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_8b2fe3ab874abdccb27892e340f648ad.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_8b2fe3ab874abdccb27892e340f648ad.jpg saved to cache
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55dbdf91-7561-58c2-8e0d-cba238364bf9
2026-03-28 18:44:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b7810>
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_fc852801fe5a9ba11a366d2d2edf12bd.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_fc852801fe5a9ba11a366d2d2edf12bd.jpg saved to cache
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55dbdf91-7561-58c2-8e0d-cba238364bf9
2026-03-28 18:44:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456292810>
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_fea3f6ec0ee237e124103cc5597bc563.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_fea3f6ec0ee237e124103cc5597bc563.jpg saved to cache
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55dbdf91-7561-58c2-8e0d-cba238364bf9
2026-03-28 18:44:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475add0>
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_2b24ff28c115a14ccc442b6337d18b88.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_2b24ff28c115a14ccc442b6337d18b88.jpg saved to cache
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3547840c-581b-5de6-9e40-95ddef174f8d
2026-03-28 18:44:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456290f90>
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_fe45be8daa63b3ad248a1dc4e713a55d.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_fe45be8daa63b3ad248a1dc4e713a55d.jpg saved to cache
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 064bc42b-c995-5dd4-92a4-4cce0eb30571
2026-03-28 18:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_29f99ee86e1a822632c1b0b487a1b37e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_01d2c3592e0a7df8d8f28570760edb47.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY39264> (referer: https://www.auto1.com/v1/car-details-view/UY39264/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN02934/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_f3ad70f58c4447206f4f8d0c589b36c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_34dccff6712c5dde67da04e1dc764530.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_afd1d0e66e4b7a5f66ad3431aa0e4007.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_18bc0494f2ab500104cd10311aadda34.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_86ba15c8c62d65f9aaea6fd0d5ff1361.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_22598b824f440de79c7d24cf2a318e82.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b1210>
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_29f99ee86e1a822632c1b0b487a1b37e.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_29f99ee86e1a822632c1b0b487a1b37e.jpg saved to cache
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 064bc42b-c995-5dd4-92a4-4cce0eb30571
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456306810>
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_01d2c3592e0a7df8d8f28570760edb47.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_01d2c3592e0a7df8d8f28570760edb47.jpg saved to cache
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 064bc42b-c995-5dd4-92a4-4cce0eb30571
2026-03-28 18:44:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa with identifier: UY39264
2026-03-28 18:44:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa with scrape type 1
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6d%252F756d906a0d83eb9efaa2fdcb107535db%252Fpa%252FUY39264_dced4627650166813c9df10bf52bd97f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_dced4627650166813c9df10bf52bd97f.jpg not downloaded yet
2026-03-28 18:44:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547ccad0>
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_f3ad70f58c4447206f4f8d0c589b36c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_f3ad70f58c4447206f4f8d0c589b36c2.jpg saved to cache
2026-03-28 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a762c6e-42ea-5b31-a42c-234875b02206
2026-03-28 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6d%252F756d906a0d83eb9efaa2fdcb107535db%252Fpa%252FUY39264_8295b7225c8d8fce8de08157830b8780.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_8295b7225c8d8fce8de08157830b8780.jpg not downloaded yet
2026-03-28 18:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_a7dafe4e5a8dea4c4337413106eef990.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_e39ac52e250ccdc8a96af99f2c7c960c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245624f390>
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_34dccff6712c5dde67da04e1dc764530.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_34dccff6712c5dde67da04e1dc764530.jpg saved to cache
2026-03-28 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a762c6e-42ea-5b31-a42c-234875b02206
2026-03-28 18:44:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562e2650>
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_afd1d0e66e4b7a5f66ad3431aa0e4007.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_afd1d0e66e4b7a5f66ad3431aa0e4007.jpg saved to cache
2026-03-28 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 064bc42b-c995-5dd4-92a4-4cce0eb30571
2026-03-28 18:44:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456253990>
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_18bc0494f2ab500104cd10311aadda34.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_18bc0494f2ab500104cd10311aadda34.jpg saved to cache
2026-03-28 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 064bc42b-c995-5dd4-92a4-4cce0eb30571
2026-03-28 18:44:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245640e190>
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_86ba15c8c62d65f9aaea6fd0d5ff1361.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_86ba15c8c62d65f9aaea6fd0d5ff1361.jpg saved to cache
2026-03-28 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 064bc42b-c995-5dd4-92a4-4cce0eb30571
2026-03-28 18:44:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562fd7d0>
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff9%252Ff0f92eea120e009ae765c6a4ef5d0e58%252Fpa%252FTZ90544_22598b824f440de79c7d24cf2a318e82.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_22598b824f440de79c7d24cf2a318e82.jpg saved to cache
2026-03-28 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 064bc42b-c995-5dd4-92a4-4cce0eb30571
2026-03-28 18:44:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 064bc42b-c995-5dd4-92a4-4cce0eb30571, skipping ID generation
2026-03-28 18:44:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 064bc42b-c995-5dd4-92a4-4cce0eb30571 with scrape type 1
2026-03-28 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 064bc42b-c995-5dd4-92a4-4cce0eb30571 sending to next pipeline
2026-03-28 18:44:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 064bc42b-c995-5dd4-92a4-4cce0eb30571, identifier: TZ90544
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6d%252F756d906a0d83eb9efaa2fdcb107535db%252Fpa%252FUY39264_c58015a1113422a4a655bdd85a9d89d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_c58015a1113422a4a655bdd85a9d89d4.jpg not downloaded yet
2026-03-28 18:44:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 064bc42b-c995-5dd4-92a4-4cce0eb30571 with identifier: TZ90544
2026-03-28 18:44:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 064bc42b-c995-5dd4-92a4-4cce0eb30571 with identifier: TZ90544
2026-03-28 18:44:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 064bc42b-c995-5dd4-92a4-4cce0eb30571 with identifier: TZ90544 to the API
2026-03-28 18:44:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_22598b824f440de79c7d24cf2a318e82.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:58:19Z',
 'fuel_type': 'petrol',
 'id': '064bc42b-c995-5dd4-92a4-4cce0eb30571',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ90544',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Mazda',
 'model': '5',
 'odometer': 136097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_80756a2bfaccd587f6c9c07ec06063cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2997612,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_fe45be8daa63b3ad248a1dc4e713a55d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2866881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_86ba15c8c62d65f9aaea6fd0d5ff1361.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2752331,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_afd1d0e66e4b7a5f66ad3431aa0e4007.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_821ad3ba67df68e3aa7bafba98933b7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2996888,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_18bc0494f2ab500104cd10311aadda34.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_ec8b73c1562104a26ad0834643d85c89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_01d2c3592e0a7df8d8f28570760edb47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3099212,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_22598b824f440de79c7d24cf2a318e82.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064bc42b-c995-5dd4-92a4-4cce0eb30571/064bc42b-c995-5dd4-92a4-4cce0eb30571_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f9/f0f92eea120e009ae765c6a4ef5d0e58/pa/TZ90544_29f99ee86e1a822632c1b0b487a1b37e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mazda 5 1.8 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2012}
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90544%27 HTTP/1.1" 200 None
2026-03-28 18:44:52 [auto1.de] INFO: Saving data for TZ90544: {'created_time': 1774723492.120116, 'last_price_update_time': 1774723492.120127, 'auction_closing_time': 1774886299.0}
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ90544') HTTP/1.1" 204 0
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6d%252F756d906a0d83eb9efaa2fdcb107535db%252Fpa%252FUY39264_176dbf7c1fda46a9cc8fe40ed4ef30bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_176dbf7c1fda46a9cc8fe40ed4ef30bd.jpg not downloaded yet
2026-03-28 18:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL59163> (referer: https://www.auto1.com/v1/car-details-view/VL59163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456234fd0>
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_a7dafe4e5a8dea4c4337413106eef990.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_a7dafe4e5a8dea4c4337413106eef990.jpg saved to cache
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a762c6e-42ea-5b31-a42c-234875b02206
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561ef710>
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_e39ac52e250ccdc8a96af99f2c7c960c.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_e39ac52e250ccdc8a96af99f2c7c960c.jpg saved to cache
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a762c6e-42ea-5b31-a42c-234875b02206
2026-03-28 18:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_399af50c061bc14b180f0201ba5306ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6d%252F756d906a0d83eb9efaa2fdcb107535db%252Fpa%252FUY39264_f03692e5ac999588b36d7f41fe36b458.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_f03692e5ac999588b36d7f41fe36b458.jpg not downloaded yet
2026-03-28 18:44:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c9230a2-571c-5320-870a-63cd67096ff9 with identifier: VL59163
2026-03-28 18:44:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c9230a2-571c-5320-870a-63cd67096ff9 with scrape type 1
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c9230a2-571c-5320-870a-63cd67096ff9
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_4d3f4860dce6e45ea6598492dd418e79.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_4d3f4860dce6e45ea6598492dd418e79.jpg not downloaded yet
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_ae8d3d026ead85ff51338d0ebe7f724b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_ae8d3d026ead85ff51338d0ebe7f724b.jpg not downloaded yet
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_a2b4364f5d9459391926628b751177ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_a2b4364f5d9459391926628b751177ba.jpg not downloaded yet
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_6392bed7efd941ff82f9dbfe3c63f047.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_6392bed7efd941ff82f9dbfe3c63f047.jpg not downloaded yet
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561d8950>
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_399af50c061bc14b180f0201ba5306ef.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_399af50c061bc14b180f0201ba5306ef.jpg saved to cache
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55dbdf91-7561-58c2-8e0d-cba238364bf9
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_f101e64f7853f418e7b376ee3cfbc12a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_f101e64f7853f418e7b376ee3cfbc12a.jpg not downloaded yet
2026-03-28 18:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_c58015a1113422a4a655bdd85a9d89d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_e19cb3e4112dbba85e7a53c8c601b314.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_e19cb3e4112dbba85e7a53c8c601b314.jpg not downloaded yet
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_e8620c4c3b52fd7785c9e69ff68992fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_e8620c4c3b52fd7785c9e69ff68992fa.jpg not downloaded yet
2026-03-28 18:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_8295b7225c8d8fce8de08157830b8780.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_245cc188b6ce5ca4f0c917c1ba634c86.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_245cc188b6ce5ca4f0c917c1ba634c86.jpg not downloaded yet
2026-03-28 18:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_dced4627650166813c9df10bf52bd97f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_350328c316877fb7ee2092361ae77c40.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_350328c316877fb7ee2092361ae77c40.jpg not downloaded yet
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_2c85cb85e96073e82f143ad52e306d7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_2c85cb85e96073e82f143ad52e306d7c.jpg not downloaded yet
2026-03-28 18:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_88b3c5aa6a45126ebea1131543c47a5d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_1b9cd8a36a6888a4350d03816e5f5370.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_bebfcee574cb89883afb76ff95910754.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_3ba58f841920130287059859145e3563.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547a04d0>
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa/2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6d%252F756d906a0d83eb9efaa2fdcb107535db%252Fpa%252FUY39264_c58015a1113422a4a655bdd85a9d89d4.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_c58015a1113422a4a655bdd85a9d89d4.jpg saved to cache
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa
2026-03-28 18:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_6d0d73799414da6f930604a7dbdc01fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_aca34d78d6175ed50a6a9d8becca409c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564d3e50>
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa/2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6d%252F756d906a0d83eb9efaa2fdcb107535db%252Fpa%252FUY39264_8295b7225c8d8fce8de08157830b8780.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_8295b7225c8d8fce8de08157830b8780.jpg saved to cache
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563c0f50>
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa/2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6d%252F756d906a0d83eb9efaa2fdcb107535db%252Fpa%252FUY39264_dced4627650166813c9df10bf52bd97f.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_dced4627650166813c9df10bf52bd97f.jpg saved to cache
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa
2026-03-28 18:44:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245630f790>
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_88b3c5aa6a45126ebea1131543c47a5d.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_88b3c5aa6a45126ebea1131543c47a5d.jpg saved to cache
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a762c6e-42ea-5b31-a42c-234875b02206
2026-03-28 18:44:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618d690>
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_1b9cd8a36a6888a4350d03816e5f5370.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_1b9cd8a36a6888a4350d03816e5f5370.jpg saved to cache
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a762c6e-42ea-5b31-a42c-234875b02206
2026-03-28 18:44:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456096f10>
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_bebfcee574cb89883afb76ff95910754.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_bebfcee574cb89883afb76ff95910754.jpg saved to cache
2026-03-28 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a762c6e-42ea-5b31-a42c-234875b02206
2026-03-28 18:44:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a06d0>
2026-03-28 18:44:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_3ba58f841920130287059859145e3563.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_3ba58f841920130287059859145e3563.jpg saved to cache
2026-03-28 18:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a762c6e-42ea-5b31-a42c-234875b02206
2026-03-28 18:44:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_b228d3591b3c8023e8fcebd278f93ed2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_7d604f739567a9cd9675e971635240a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245648efd0>
2026-03-28 18:44:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_6d0d73799414da6f930604a7dbdc01fe.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_6d0d73799414da6f930604a7dbdc01fe.jpg saved to cache
2026-03-28 18:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a762c6e-42ea-5b31-a42c-234875b02206
2026-03-28 18:44:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24582ced50>
2026-03-28 18:44:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fa5%252F73a52a5fa5ec39c507111fcb74396855%252Fpa%252FCV44457_aca34d78d6175ed50a6a9d8becca409c.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_aca34d78d6175ed50a6a9d8becca409c.jpg saved to cache
2026-03-28 18:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a762c6e-42ea-5b31-a42c-234875b02206
2026-03-28 18:44:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a762c6e-42ea-5b31-a42c-234875b02206, skipping ID generation
2026-03-28 18:44:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a762c6e-42ea-5b31-a42c-234875b02206 with scrape type 1
2026-03-28 18:44:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a762c6e-42ea-5b31-a42c-234875b02206 sending to next pipeline
2026-03-28 18:44:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a762c6e-42ea-5b31-a42c-234875b02206, identifier: CV44457
2026-03-28 18:44:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a762c6e-42ea-5b31-a42c-234875b02206 with identifier: CV44457
2026-03-28 18:44:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a762c6e-42ea-5b31-a42c-234875b02206 with identifier: CV44457
2026-03-28 18:44:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a762c6e-42ea-5b31-a42c-234875b02206 with identifier: CV44457 to the API
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_aca34d78d6175ed50a6a9d8becca409c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:30:58Z',
 'fuel_type': 'petrol',
 'id': '2a762c6e-42ea-5b31-a42c-234875b02206',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV44457',
 'listing': 'auction',
 'location': 'DE, Zweibrücken',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 125013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2917669,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_bebfcee574cb89883afb76ff95910754.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3047798,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_6d0d73799414da6f930604a7dbdc01fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2876664,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_88b3c5aa6a45126ebea1131543c47a5d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2923588,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_aca34d78d6175ed50a6a9d8becca409c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2887174,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_1b9cd8a36a6888a4350d03816e5f5370.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2882475,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_34dccff6712c5dde67da04e1dc764530.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2985008,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_3ba58f841920130287059859145e3563.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_a7dafe4e5a8dea4c4337413106eef990.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2864718,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_f3ad70f58c4447206f4f8d0c589b36c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a762c6e-42ea-5b31-a42c-234875b02206/2a762c6e-42ea-5b31-a42c-234875b02206_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/a5/73a52a5fa5ec39c507111fcb74396855/pa/CV44457_e39ac52e250ccdc8a96af99f2c7c960c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.2 PureTech Active L1',
 'transmission': 'automatic',
 'trim': 'Active L1',
 'year': 2020}
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV44457%27 HTTP/1.1" 200 None
2026-03-28 18:44:53 [auto1.de] INFO: Saving data for CV44457: {'created_time': 1774723493.924409, 'last_price_update_time': 1774723493.924423, 'auction_closing_time': 1774884658.0}
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV44457') HTTP/1.1" 204 0
2026-03-28 18:44:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN02934> (referer: https://www.auto1.com/v1/car-details-view/RN02934/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB62882> (referer: https://www.auto1.com/v1/car-details-view/KB62882/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245630bb50>
2026-03-28 18:44:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_b228d3591b3c8023e8fcebd278f93ed2.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_b228d3591b3c8023e8fcebd278f93ed2.jpg saved to cache
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55dbdf91-7561-58c2-8e0d-cba238364bf9
2026-03-28 18:44:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456175990>
2026-03-28 18:44:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_7d604f739567a9cd9675e971635240a0.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_7d604f739567a9cd9675e971635240a0.jpg saved to cache
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55dbdf91-7561-58c2-8e0d-cba238364bf9
2026-03-28 18:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c with identifier: RN02934
2026-03-28 18:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c with scrape type 1
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_d0b3b381c19060f09ce0234fb64c7a0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_d0b3b381c19060f09ce0234fb64c7a0b.jpg not downloaded yet
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_a1b27f9820e5cc31c6fa2607f03794ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_a1b27f9820e5cc31c6fa2607f03794ba.jpg not downloaded yet
2026-03-28 18:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db344b49-748a-5151-a673-ec3f6933eac1 with identifier: KB62882
2026-03-28 18:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db344b49-748a-5151-a673-ec3f6933eac1 with scrape type 1
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db344b49-748a-5151-a673-ec3f6933eac1
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5f%252Fad5f2afb4d4f69fbf9b3324edb577a79%252Fpa%252FKB62882_9a7b3b2f30383364a556a68f352efdd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_9a7b3b2f30383364a556a68f352efdd3.jpg already downloaded
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5f%252Fad5f2afb4d4f69fbf9b3324edb577a79%252Fpa%252FKB62882_b555bc1b4781cc6d23b772a82c293bad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_b555bc1b4781cc6d23b772a82c293bad.jpg already downloaded
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5f%252Fad5f2afb4d4f69fbf9b3324edb577a79%252Fpa%252FKB62882_6def13deea69366dc151e7e2239dc410.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_6def13deea69366dc151e7e2239dc410.jpg already downloaded
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5f%252Fad5f2afb4d4f69fbf9b3324edb577a79%252Fpa%252FKB62882_0b9c8a13fca7ab2dce542d45a3dbcf9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_0b9c8a13fca7ab2dce542d45a3dbcf9d.jpg already downloaded
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5f%252Fad5f2afb4d4f69fbf9b3324edb577a79%252Fpa%252FKB62882_8e45d1a462f60c853711c2e60cef3ce4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_8e45d1a462f60c853711c2e60cef3ce4.jpg already downloaded
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5f%252Fad5f2afb4d4f69fbf9b3324edb577a79%252Fpa%252FKB62882_8fd91bef5d0091f98cb91deafc496ae4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_8fd91bef5d0091f98cb91deafc496ae4.jpg already downloaded
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5f%252Fad5f2afb4d4f69fbf9b3324edb577a79%252Fpa%252FKB62882_6e92bdb41820c6e081abda78cce5a03f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_6e92bdb41820c6e081abda78cce5a03f.jpg already downloaded
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5f%252Fad5f2afb4d4f69fbf9b3324edb577a79%252Fpa%252FKB62882_6ff008ec7f5e6365e213dfeb5b89e777.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_6ff008ec7f5e6365e213dfeb5b89e777.jpg already downloaded
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5f%252Fad5f2afb4d4f69fbf9b3324edb577a79%252Fpa%252FKB62882_47700978886d11b295633e8d56939f46.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_47700978886d11b295633e8d56939f46.jpg already downloaded
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5f%252Fad5f2afb4d4f69fbf9b3324edb577a79%252Fpa%252FKB62882_95721338b1f72c17b0b48f0cc2398034.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_95721338b1f72c17b0b48f0cc2398034.jpg already downloaded
2026-03-28 18:44:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db344b49-748a-5151-a673-ec3f6933eac1, identifier: KB62882
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_71e7a55059de645b3d9460ee60c7b341.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_71e7a55059de645b3d9460ee60c7b341.jpg not downloaded yet
2026-03-28 18:44:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db344b49-748a-5151-a673-ec3f6933eac1 with identifier: KB62882
2026-03-28 18:44:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db344b49-748a-5151-a673-ec3f6933eac1 with identifier: KB62882
2026-03-28 18:44:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db344b49-748a-5151-a673-ec3f6933eac1 with identifier: KB62882 to the API
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KB62882>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:47:17Z',
 'fuel_type': 'petrol',
 'id': 'db344b49-748a-5151-a673-ec3f6933eac1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB62882',
 'listing': 'auction',
 'location': 'DE, Halberstadt',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 22742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_9a7b3b2f30383364a556a68f352efdd3.jpg',
                'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_b555bc1b4781cc6d23b772a82c293bad.jpg',
                'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_6def13deea69366dc151e7e2239dc410.jpg',
                'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_0b9c8a13fca7ab2dce542d45a3dbcf9d.jpg',
                'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_8e45d1a462f60c853711c2e60cef3ce4.jpg',
                'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_8fd91bef5d0091f98cb91deafc496ae4.jpg',
                'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_6e92bdb41820c6e081abda78cce5a03f.jpg',
                'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_6ff008ec7f5e6365e213dfeb5b89e777.jpg',
                'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_47700978886d11b295633e8d56939f46.jpg',
                'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_95721338b1f72c17b0b48f0cc2398034.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db344b49-748a-5151-a673-ec3f6933eac1/db344b49-748a-5151-a673-ec3f6933eac1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_9a7b3b2f30383364a556a68f352efdd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db344b49-748a-5151-a673-ec3f6933eac1/db344b49-748a-5151-a673-ec3f6933eac1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_b555bc1b4781cc6d23b772a82c293bad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db344b49-748a-5151-a673-ec3f6933eac1/db344b49-748a-5151-a673-ec3f6933eac1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_6def13deea69366dc151e7e2239dc410.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db344b49-748a-5151-a673-ec3f6933eac1/db344b49-748a-5151-a673-ec3f6933eac1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_0b9c8a13fca7ab2dce542d45a3dbcf9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db344b49-748a-5151-a673-ec3f6933eac1/db344b49-748a-5151-a673-ec3f6933eac1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_8e45d1a462f60c853711c2e60cef3ce4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db344b49-748a-5151-a673-ec3f6933eac1/db344b49-748a-5151-a673-ec3f6933eac1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_8fd91bef5d0091f98cb91deafc496ae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db344b49-748a-5151-a673-ec3f6933eac1/db344b49-748a-5151-a673-ec3f6933eac1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_6e92bdb41820c6e081abda78cce5a03f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db344b49-748a-5151-a673-ec3f6933eac1/db344b49-748a-5151-a673-ec3f6933eac1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_6ff008ec7f5e6365e213dfeb5b89e777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db344b49-748a-5151-a673-ec3f6933eac1/db344b49-748a-5151-a673-ec3f6933eac1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_47700978886d11b295633e8d56939f46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db344b49-748a-5151-a673-ec3f6933eac1/db344b49-748a-5151-a673-ec3f6933eac1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/5f/ad5f2afb4d4f69fbf9b3324edb577a79/pa/KB62882_95721338b1f72c17b0b48f0cc2398034.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Navi',
 'transmission': 'automatic',
 'trim': 'Navi',
 'year': 2012}
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62882%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [auto1.de] INFO: Saving data for KB62882: {'created_time': 1774723494.778879, 'last_price_update_time': 1774723494.77889, 'auction_closing_time': 1774885637.0}
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB62882') HTTP/1.1" 204 0
2026-03-28 18:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_2c85cb85e96073e82f143ad52e306d7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_350328c316877fb7ee2092361ae77c40.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_60ff2e024ef11ce98c937c538d958559.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_60ff2e024ef11ce98c937c538d958559.jpg not downloaded yet
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_483105c19e363f915fb3032acd221228.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_483105c19e363f915fb3032acd221228.jpg not downloaded yet
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_550056c11543bc920845e456d51dff7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_550056c11543bc920845e456d51dff7a.jpg not downloaded yet
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_5eb2981d39b0dfa69bd789081442cd0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_5eb2981d39b0dfa69bd789081442cd0d.jpg not downloaded yet
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_1cf5471c2710412e93ef4fb38e37fdd4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_1cf5471c2710412e93ef4fb38e37fdd4.jpg not downloaded yet
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_9ec2933e656e8b2b127998bb21f68939.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_9ec2933e656e8b2b127998bb21f68939.jpg not downloaded yet
2026-03-28 18:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_e19cb3e4112dbba85e7a53c8c601b314.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_6392bed7efd941ff82f9dbfe3c63f047.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456314790>
2026-03-28 18:44:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_2c85cb85e96073e82f143ad52e306d7c.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_2c85cb85e96073e82f143ad52e306d7c.jpg saved to cache
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c9230a2-571c-5320-870a-63cd67096ff9
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245630fe10>
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_350328c316877fb7ee2092361ae77c40.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_350328c316877fb7ee2092361ae77c40.jpg saved to cache
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c9230a2-571c-5320-870a-63cd67096ff9
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_531a4251130376d26f82d7ca70d0906b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_531a4251130376d26f82d7ca70d0906b.jpg not downloaded yet
2026-03-28 18:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_e8620c4c3b52fd7785c9e69ff68992fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_245cc188b6ce5ca4f0c917c1ba634c86.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_f101e64f7853f418e7b376ee3cfbc12a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_1e88615675caa92e443c9aaa0737e055.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_f5c846a0f20f42e371019f50d4850d68.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_e42972433614633c025b4c4af82b714b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245610cd10>
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_e19cb3e4112dbba85e7a53c8c601b314.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_e19cb3e4112dbba85e7a53c8c601b314.jpg saved to cache
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c9230a2-571c-5320-870a-63cd67096ff9
2026-03-28 18:44:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563bf010>
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_6392bed7efd941ff82f9dbfe3c63f047.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_6392bed7efd941ff82f9dbfe3c63f047.jpg saved to cache
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c9230a2-571c-5320-870a-63cd67096ff9
2026-03-28 18:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_176dbf7c1fda46a9cc8fe40ed4ef30bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_a1b27f9820e5cc31c6fa2607f03794ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_f03692e5ac999588b36d7f41fe36b458.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a6210>
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_e8620c4c3b52fd7785c9e69ff68992fa.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_e8620c4c3b52fd7785c9e69ff68992fa.jpg saved to cache
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c9230a2-571c-5320-870a-63cd67096ff9
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456313750>
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_245cc188b6ce5ca4f0c917c1ba634c86.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_245cc188b6ce5ca4f0c917c1ba634c86.jpg saved to cache
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c9230a2-571c-5320-870a-63cd67096ff9
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456107490>
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_f101e64f7853f418e7b376ee3cfbc12a.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_f101e64f7853f418e7b376ee3cfbc12a.jpg saved to cache
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c9230a2-571c-5320-870a-63cd67096ff9
2026-03-28 18:44:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456104650>
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_1e88615675caa92e443c9aaa0737e055.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_1e88615675caa92e443c9aaa0737e055.jpg saved to cache
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55dbdf91-7561-58c2-8e0d-cba238364bf9
2026-03-28 18:44:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561ffc10>
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_f5c846a0f20f42e371019f50d4850d68.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_f5c846a0f20f42e371019f50d4850d68.jpg saved to cache
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55dbdf91-7561-58c2-8e0d-cba238364bf9
2026-03-28 18:44:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456431d10>
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_e42972433614633c025b4c4af82b714b.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_e42972433614633c025b4c4af82b714b.jpg saved to cache
2026-03-28 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55dbdf91-7561-58c2-8e0d-cba238364bf9
2026-03-28 18:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_71e7a55059de645b3d9460ee60c7b341.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456107e10>
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa/2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6d%252F756d906a0d83eb9efaa2fdcb107535db%252Fpa%252FUY39264_176dbf7c1fda46a9cc8fe40ed4ef30bd.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_176dbf7c1fda46a9cc8fe40ed4ef30bd.jpg saved to cache
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456106ad0>
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_a1b27f9820e5cc31c6fa2607f03794ba.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_a1b27f9820e5cc31c6fa2607f03794ba.jpg saved to cache
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245605d9d0>
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa/2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6d%252F756d906a0d83eb9efaa2fdcb107535db%252Fpa%252FUY39264_f03692e5ac999588b36d7f41fe36b458.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_f03692e5ac999588b36d7f41fe36b458.jpg saved to cache
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa
2026-03-28 18:44:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa, skipping ID generation
2026-03-28 18:44:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa with scrape type 1
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa sending to next pipeline
2026-03-28 18:44:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa, identifier: UY39264
2026-03-28 18:44:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa with identifier: UY39264
2026-03-28 18:44:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa with identifier: UY39264
2026-03-28 18:44:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa with identifier: UY39264 to the API
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_f03692e5ac999588b36d7f41fe36b458.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:24:58Z',
 'fuel_type': 'petrol',
 'id': '2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY39264',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 124797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa/2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_dced4627650166813c9df10bf52bd97f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa/2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_8295b7225c8d8fce8de08157830b8780.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa/2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_c58015a1113422a4a655bdd85a9d89d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa/2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_176dbf7c1fda46a9cc8fe40ed4ef30bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa/2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6d/756d906a0d83eb9efaa2fdcb107535db/pa/UY39264_f03692e5ac999588b36d7f41fe36b458.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY39264%27 HTTP/1.1" 200 None
2026-03-28 18:44:56 [auto1.de] INFO: Saving data for UY39264: {'created_time': 1774723496.590063, 'last_price_update_time': 1774723496.590075, 'auction_closing_time': 1774884298.0}
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY39264') HTTP/1.1" 204 0
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_1cf5471c2710412e93ef4fb38e37fdd4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_531a4251130376d26f82d7ca70d0906b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_9ec2933e656e8b2b127998bb21f68939.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_5eb2981d39b0dfa69bd789081442cd0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245607add0>
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_71e7a55059de645b3d9460ee60c7b341.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_71e7a55059de645b3d9460ee60c7b341.jpg saved to cache
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c
2026-03-28 18:44:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_a2b4364f5d9459391926628b751177ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_4d3f4860dce6e45ea6598492dd418e79.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_ae8d3d026ead85ff51338d0ebe7f724b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_d3d2a2257d70ea204353cedc18fc8521.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_550056c11543bc920845e456d51dff7a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_483105c19e363f915fb3032acd221228.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456156390>
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_1cf5471c2710412e93ef4fb38e37fdd4.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_1cf5471c2710412e93ef4fb38e37fdd4.jpg saved to cache
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_60ff2e024ef11ce98c937c538d958559.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456535210>
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_531a4251130376d26f82d7ca70d0906b.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_531a4251130376d26f82d7ca70d0906b.jpg saved to cache
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245606a410>
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_9ec2933e656e8b2b127998bb21f68939.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_9ec2933e656e8b2b127998bb21f68939.jpg saved to cache
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_d0b3b381c19060f09ce0234fb64c7a0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_5c87e2fd4bd3457ddfa1315b3761d785.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_81dd44dd5e0fecc96beecc0262fcaed8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a0150>
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_5eb2981d39b0dfa69bd789081442cd0d.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_5eb2981d39b0dfa69bd789081442cd0d.jpg saved to cache
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c
2026-03-28 18:44:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546459d0>
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_a2b4364f5d9459391926628b751177ba.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_a2b4364f5d9459391926628b751177ba.jpg saved to cache
2026-03-28 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c9230a2-571c-5320-870a-63cd67096ff9
2026-03-28 18:44:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a2d10>
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_4d3f4860dce6e45ea6598492dd418e79.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_4d3f4860dce6e45ea6598492dd418e79.jpg saved to cache
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c9230a2-571c-5320-870a-63cd67096ff9
2026-03-28 18:44:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245607a150>
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fe6%252F93e64485acbd36bd0ea1bc6d8a6cb8ae%252Fpa%252FVL59163_ae8d3d026ead85ff51338d0ebe7f724b.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_ae8d3d026ead85ff51338d0ebe7f724b.jpg saved to cache
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c9230a2-571c-5320-870a-63cd67096ff9
2026-03-28 18:44:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c9230a2-571c-5320-870a-63cd67096ff9, skipping ID generation
2026-03-28 18:44:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c9230a2-571c-5320-870a-63cd67096ff9 with scrape type 1
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c9230a2-571c-5320-870a-63cd67096ff9 sending to next pipeline
2026-03-28 18:44:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c9230a2-571c-5320-870a-63cd67096ff9, identifier: VL59163
2026-03-28 18:44:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245630f790>
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F3e%252Fa43ebd28886d52a9dbc0f8d59e4f9d90%252Fpa%252FPS79135_d3d2a2257d70ea204353cedc18fc8521.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_d3d2a2257d70ea204353cedc18fc8521.jpg saved to cache
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55dbdf91-7561-58c2-8e0d-cba238364bf9
2026-03-28 18:44:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55dbdf91-7561-58c2-8e0d-cba238364bf9, skipping ID generation
2026-03-28 18:44:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55dbdf91-7561-58c2-8e0d-cba238364bf9 with scrape type 1
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55dbdf91-7561-58c2-8e0d-cba238364bf9 sending to next pipeline
2026-03-28 18:44:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55dbdf91-7561-58c2-8e0d-cba238364bf9, identifier: PS79135
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546468d0>
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_550056c11543bc920845e456d51dff7a.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_550056c11543bc920845e456d51dff7a.jpg saved to cache
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456275bd0>
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_483105c19e363f915fb3032acd221228.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_483105c19e363f915fb3032acd221228.jpg saved to cache
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456155ed0>
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_60ff2e024ef11ce98c937c538d958559.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_60ff2e024ef11ce98c937c538d958559.jpg saved to cache
2026-03-28 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c
2026-03-28 18:44:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c9230a2-571c-5320-870a-63cd67096ff9 with identifier: VL59163
2026-03-28 18:44:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c9230a2-571c-5320-870a-63cd67096ff9 with identifier: VL59163
2026-03-28 18:44:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c9230a2-571c-5320-870a-63cd67096ff9 with identifier: VL59163 to the API
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_ae8d3d026ead85ff51338d0ebe7f724b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 144,
 'expiration_date': '2026-03-30T15:26:21Z',
 'fuel_type': 'diesel',
 'id': '6c9230a2-571c-5320-870a-63cd67096ff9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL59163',
 'listing': 'auction',
 'location': 'DE, München',
 'make': 'Opel',
 'model': 'Zafira Life',
 'odometer': 62180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2497851,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_4d3f4860dce6e45ea6598492dd418e79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2622779,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_ae8d3d026ead85ff51338d0ebe7f724b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2478855,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_a2b4364f5d9459391926628b751177ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570355,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_6392bed7efd941ff82f9dbfe3c63f047.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_f101e64f7853f418e7b376ee3cfbc12a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2516045,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_e19cb3e4112dbba85e7a53c8c601b314.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2639057,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_e8620c4c3b52fd7785c9e69ff68992fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_245cc188b6ce5ca4f0c917c1ba634c86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_350328c316877fb7ee2092361ae77c40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c9230a2-571c-5320-870a-63cd67096ff9/6c9230a2-571c-5320-870a-63cd67096ff9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/e6/93e64485acbd36bd0ea1bc6d8a6cb8ae/pa/VL59163_2c85cb85e96073e82f143ad52e306d7c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira Life 2.0 Diesel Tourer M (L2)',
 'transmission': 'manual',
 'trim': 'Tourer M (L2)',
 'year': 2021}
2026-03-28 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL59163%27 HTTP/1.1" 200 None
2026-03-28 18:44:58 [auto1.de] INFO: Saving data for VL59163: {'created_time': 1774723498.008537, 'last_price_update_time': 1774723498.008548, 'auction_closing_time': 1774884381.0}
2026-03-28 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL59163') HTTP/1.1" 204 0
2026-03-28 18:44:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55dbdf91-7561-58c2-8e0d-cba238364bf9 with identifier: PS79135
2026-03-28 18:44:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55dbdf91-7561-58c2-8e0d-cba238364bf9 with identifier: PS79135
2026-03-28 18:44:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55dbdf91-7561-58c2-8e0d-cba238364bf9 with identifier: PS79135 to the API
2026-03-28 18:44:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_d3d2a2257d70ea204353cedc18fc8521.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:43:15Z',
 'fuel_type': 'petrol',
 'id': '55dbdf91-7561-58c2-8e0d-cba238364bf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS79135',
 'listing': 'auction',
 'location': 'DE, Tradein',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 188068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3022762,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_fea3f6ec0ee237e124103cc5597bc563.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3031703,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_8b2fe3ab874abdccb27892e340f648ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3071112,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_fc852801fe5a9ba11a366d2d2edf12bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3143150,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_d3d2a2257d70ea204353cedc18fc8521.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3024693,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_e42972433614633c025b4c4af82b714b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3104804,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_1e88615675caa92e443c9aaa0737e055.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3178124,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_f5c846a0f20f42e371019f50d4850d68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_b228d3591b3c8023e8fcebd278f93ed2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_7d604f739567a9cd9675e971635240a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dbdf91-7561-58c2-8e0d-cba238364bf9/55dbdf91-7561-58c2-8e0d-cba238364bf9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/3e/a43ebd28886d52a9dbc0f8d59e4f9d90/pa/PS79135_399af50c061bc14b180f0201ba5306ef.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2013}
2026-03-28 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS79135%27 HTTP/1.1" 200 None
2026-03-28 18:44:58 [auto1.de] INFO: Saving data for PS79135: {'created_time': 1774723498.966873, 'last_price_update_time': 1774723498.966885, 'auction_closing_time': 1774885395.0}
2026-03-28 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS79135') HTTP/1.1" 204 0
2026-03-28 18:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_2516b0e4b635e85b6d20bf5d63b0ae95.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_1e722cbce2a7f0711bf7dec16e729ca5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245610f950>
2026-03-28 18:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F40%252Fba4032b9af9e1367a91f2e5dc997e088%252Fpa%252FRN02934_d0b3b381c19060f09ce0234fb64c7a0b.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_d0b3b381c19060f09ce0234fb64c7a0b.jpg saved to cache
2026-03-28 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c
2026-03-28 18:44:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c, skipping ID generation
2026-03-28 18:44:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c with scrape type 1
2026-03-28 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c sending to next pipeline
2026-03-28 18:44:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c, identifier: RN02934
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547cc510>
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_5c87e2fd4bd3457ddfa1315b3761d785.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_5c87e2fd4bd3457ddfa1315b3761d785.jpg saved to cache
2026-03-28 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547748d0>
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_81dd44dd5e0fecc96beecc0262fcaed8.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_81dd44dd5e0fecc96beecc0262fcaed8.jpg saved to cache
2026-03-28 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2
2026-03-28 18:44:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c with identifier: RN02934
2026-03-28 18:44:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c with identifier: RN02934
2026-03-28 18:44:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c with identifier: RN02934 to the API
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:44:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_d0b3b381c19060f09ce0234fb64c7a0b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:00:17Z',
 'fuel_type': 'diesel',
 'id': '6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN02934',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 156120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_d0b3b381c19060f09ce0234fb64c7a0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_a1b27f9820e5cc31c6fa2607f03794ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_71e7a55059de645b3d9460ee60c7b341.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_60ff2e024ef11ce98c937c538d958559.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_483105c19e363f915fb3032acd221228.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_550056c11543bc920845e456d51dff7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_5eb2981d39b0dfa69bd789081442cd0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_1cf5471c2710412e93ef4fb38e37fdd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_9ec2933e656e8b2b127998bb21f68939.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c/6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/40/ba4032b9af9e1367a91f2e5dc997e088/pa/RN02934_531a4251130376d26f82d7ca70d0906b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN02934%27 HTTP/1.1" 200 None
2026-03-28 18:44:59 [auto1.de] INFO: Saving data for RN02934: {'created_time': 1774723499.610726, 'last_price_update_time': 1774723499.610738, 'auction_closing_time': 1774882817.0}
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN02934') HTTP/1.1" 204 0
2026-03-28 18:44:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454771210>
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_2516b0e4b635e85b6d20bf5d63b0ae95.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_2516b0e4b635e85b6d20bf5d63b0ae95.jpg saved to cache
2026-03-28 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562122d0>
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_1e722cbce2a7f0711bf7dec16e729ca5.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_1e722cbce2a7f0711bf7dec16e729ca5.jpg saved to cache
2026-03-28 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2
2026-03-28 18:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_d7fb97f6a3d116ecb52c2bc645e69628.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_d81aa7571442521203f559f0a6b94900.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_e4810e3d1f54e118847e223ae4fee443.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_091f7e214d1495a364cb663dded32ea8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_3fcea4a7b124855ed69988bef7e3d50c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245636f1d0>
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_d7fb97f6a3d116ecb52c2bc645e69628.jpg') HTTP/1.1" 204 0
2026-03-28 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_d7fb97f6a3d116ecb52c2bc645e69628.jpg saved to cache
2026-03-28 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3547840c-581b-5de6-9e40-95ddef174f8d
2026-03-28 18:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_6e7c636fb96d6aa34fb48a0cf281fec0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_f68a3f4e48082f7aad743c6ab1ec4033.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YE71263> (referer: https://www.auto1.com/v1/car-details-view/YE71263/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:44:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456418c10>
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_d81aa7571442521203f559f0a6b94900.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_d81aa7571442521203f559f0a6b94900.jpg saved to cache
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3547840c-581b-5de6-9e40-95ddef174f8d
2026-03-28 18:45:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456212210>
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252Fa5%252F7fa5a55eab9bc88ad2f6e5fc2fe7b24e%252Fpa%252FDN85056_e4810e3d1f54e118847e223ae4fee443.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_e4810e3d1f54e118847e223ae4fee443.jpg saved to cache
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3547840c-581b-5de6-9e40-95ddef174f8d
2026-03-28 18:45:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3547840c-581b-5de6-9e40-95ddef174f8d, skipping ID generation
2026-03-28 18:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3547840c-581b-5de6-9e40-95ddef174f8d with scrape type 1
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3547840c-581b-5de6-9e40-95ddef174f8d sending to next pipeline
2026-03-28 18:45:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3547840c-581b-5de6-9e40-95ddef174f8d, identifier: DN85056
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560af7d0>
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_091f7e214d1495a364cb663dded32ea8.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_091f7e214d1495a364cb663dded32ea8.jpg saved to cache
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547f6550>
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_3fcea4a7b124855ed69988bef7e3d50c.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_3fcea4a7b124855ed69988bef7e3d50c.jpg saved to cache
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2
2026-03-28 18:45:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3547840c-581b-5de6-9e40-95ddef174f8d with identifier: DN85056
2026-03-28 18:45:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3547840c-581b-5de6-9e40-95ddef174f8d with identifier: DN85056
2026-03-28 18:45:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3547840c-581b-5de6-9e40-95ddef174f8d with identifier: DN85056 to the API
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_e4810e3d1f54e118847e223ae4fee443.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:29:34Z',
 'fuel_type': 'petrol',
 'id': '3547840c-581b-5de6-9e40-95ddef174f8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN85056',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'BMW',
 'model': '2er',
 'odometer': 141318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2982600,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_e4810e3d1f54e118847e223ae4fee443.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2919948,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_d7fb97f6a3d116ecb52c2bc645e69628.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2900593,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_d81aa7571442521203f559f0a6b94900.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542142,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_2b24ff28c115a14ccc442b6337d18b88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_006c5ce64f14d1c6aabe59203144e916.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2973744,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_3322cea6d17a43bf07a3a23e1b1a2c44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2565158,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_662c4a35eec55e40f8fb13e4bb8b85b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_83ed4af40e1aeedd7a61e6873f382fa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_e69aea03c5faf52a15d3f70ade14c341.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3547840c-581b-5de6-9e40-95ddef174f8d/3547840c-581b-5de6-9e40-95ddef174f8d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2851336,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/a5/7fa5a55eab9bc88ad2f6e5fc2fe7b24e/pa/DN85056_be7394f163ac92c9c60205bd887c1d7d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2015}
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN85056%27 HTTP/1.1" 200 None
2026-03-28 18:45:00 [auto1.de] INFO: Saving data for DN85056: {'created_time': 1774723500.869488, 'last_price_update_time': 1774723500.869498, 'auction_closing_time': 1774884574.0}
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN85056') HTTP/1.1" 204 0
2026-03-28 18:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_e12d23832415cfb437b15a811df4c532.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF95367> (referer: https://www.auto1.com/v1/car-details-view/TF95367/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_768c3b0b476b4c5e448b6c4e1c9cd813.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547a1050>
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_6e7c636fb96d6aa34fb48a0cf281fec0.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_6e7c636fb96d6aa34fb48a0cf281fec0.jpg saved to cache
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456252e90>
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_f68a3f4e48082f7aad743c6ab1ec4033.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_f68a3f4e48082f7aad743c6ab1ec4033.jpg saved to cache
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2
2026-03-28 18:45:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8 with identifier: YE71263
2026-03-28 18:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8 with scrape type 1
2026-03-28 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8
2026-03-28 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_3880217de8ee107b3ca15f0fc6f2386d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_3880217de8ee107b3ca15f0fc6f2386d.jpg not downloaded yet
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_638aad48a605851620e92fdeb58c8ebd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_638aad48a605851620e92fdeb58c8ebd.jpg not downloaded yet
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_ebf82fec9cd4f64fe5dcbbfb29ede2fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_ebf82fec9cd4f64fe5dcbbfb29ede2fa.jpg not downloaded yet
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477c390>
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_e12d23832415cfb437b15a811df4c532.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_e12d23832415cfb437b15a811df4c532.jpg saved to cache
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3865c2e-3891-5656-982a-919ba8851b55
2026-03-28 18:45:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 099874d2-9d2e-5dc2-9ca4-9eaf13792307 with identifier: TF95367
2026-03-28 18:45:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307 with scrape type 1
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_bccc66a8e670344e5ff6222cfad179f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_bccc66a8e670344e5ff6222cfad179f3.jpg not downloaded yet
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561db410>
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_768c3b0b476b4c5e448b6c4e1c9cd813.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_768c3b0b476b4c5e448b6c4e1c9cd813.jpg saved to cache
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3865c2e-3891-5656-982a-919ba8851b55
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_7749d7bbb60e2f7ecdb256da5e9f6ce3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_7749d7bbb60e2f7ecdb256da5e9f6ce3.jpg not downloaded yet
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_019efc6d86da7a79894fb62b05973e62.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_019efc6d86da7a79894fb62b05973e62.jpg not downloaded yet
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_2cec1fd0a08db2445a9f9314eccfbfc0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_2cec1fd0a08db2445a9f9314eccfbfc0.jpg not downloaded yet
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_9b4a47b9efce99c78970c81ed918b658.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_9b4a47b9efce99c78970c81ed918b658.jpg not downloaded yet
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_d68f3674d503669fcc4166f75f7fcecc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_ef172d1a65021797a130c8276fdb3d31.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_ef172d1a65021797a130c8276fdb3d31.jpg not downloaded yet
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_f9537652860648233b42c3aeb07c841d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_b9b35e7af6db165d154fd9a42d357311.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_6efe64df4b067a81b6e98103a9a42936.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_6efe64df4b067a81b6e98103a9a42936.jpg not downloaded yet
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_ceb5fb76b220ca0a4fad9c6705d5b58f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_ceb5fb76b220ca0a4fad9c6705d5b58f.jpg not downloaded yet
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_59f591f1debaddd12c7880475b613f91.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_59f591f1debaddd12c7880475b613f91.jpg not downloaded yet
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_dcc891b411e8697e4bda3bb1ea59df43.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_dcc891b411e8697e4bda3bb1ea59df43.jpg not downloaded yet
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_c53c093b92accb1315f7fb7fb12bed50.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_c53c093b92accb1315f7fb7fb12bed50.jpg not downloaded yet
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_db1852e6f9366108d04f4d7ac8741df0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_db1852e6f9366108d04f4d7ac8741df0.jpg not downloaded yet
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_2d013e4afb08829da7123f072ad3b348.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_2d013e4afb08829da7123f072ad3b348.jpg not downloaded yet
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_71763e3c6cd5eaf30c48d398a85caa50.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_71763e3c6cd5eaf30c48d398a85caa50.jpg not downloaded yet
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560562d0>
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_d68f3674d503669fcc4166f75f7fcecc.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_d68f3674d503669fcc4166f75f7fcecc.jpg saved to cache
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae5199a5-1ebe-52b0-8ac9-992116b90421
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_5b56fef93574d68d62c93a1b46d72528.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_10675433c81f01f207fd8cfe382b499f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_0884c7b596d66091deaf61de7099a70a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_0884c7b596d66091deaf61de7099a70a.jpg not downloaded yet
2026-03-28 18:45:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454786d90>
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_f9537652860648233b42c3aeb07c841d.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_f9537652860648233b42c3aeb07c841d.jpg saved to cache
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245651a090>
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_b9b35e7af6db165d154fd9a42d357311.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_b9b35e7af6db165d154fd9a42d357311.jpg saved to cache
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae5199a5-1ebe-52b0-8ac9-992116b90421
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_d068bd376b31db17e8d288c7407365b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_d068bd376b31db17e8d288c7407365b6.jpg not downloaded yet
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_52f7060e0bc9313c1b311e71fa8cff24.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_52f7060e0bc9313c1b311e71fa8cff24.jpg not downloaded yet
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN22818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564addd0>
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_5b56fef93574d68d62c93a1b46d72528.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_5b56fef93574d68d62c93a1b46d72528.jpg saved to cache
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3865c2e-3891-5656-982a-919ba8851b55
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563f7610>
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_10675433c81f01f207fd8cfe382b499f.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_10675433c81f01f207fd8cfe382b499f.jpg saved to cache
2026-03-28 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3865c2e-3891-5656-982a-919ba8851b55
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT07537/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_02e7b6065da3d39b82be4c1bf861becd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_8ff416105566bec1af86658ae35833b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_e4e02a91f343495be3ce8a6b7f787140.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_9f7a00689f9ef9ef1c0ae3312d084c42.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_f4aaf2abb0dff332bc1dbdc8293d6dbe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_d0dcd056698ae463ff3f3dce0f4d95c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA64298/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_2cec1fd0a08db2445a9f9314eccfbfc0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_f3ce313902409f15e139ecb87bf9e4c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245606bbd0>
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_02e7b6065da3d39b82be4c1bf861becd.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_02e7b6065da3d39b82be4c1bf861becd.jpg saved to cache
2026-03-28 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2
2026-03-28 18:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_52f7060e0bc9313c1b311e71fa8cff24.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618d390>
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd0%252F45d088e9d1e2ff383f61fadf77a612af%252Fpa%252FMN30135_8ff416105566bec1af86658ae35833b6.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_8ff416105566bec1af86658ae35833b6.jpg saved to cache
2026-03-28 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2
2026-03-28 18:45:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9c7e85a-099a-5974-88e1-a43d3a7ae8d2, skipping ID generation
2026-03-28 18:45:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2 with scrape type 1
2026-03-28 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2 sending to next pipeline
2026-03-28 18:45:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9c7e85a-099a-5974-88e1-a43d3a7ae8d2, identifier: MN30135
2026-03-28 18:45:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561d80d0>
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_e4e02a91f343495be3ce8a6b7f787140.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_e4e02a91f343495be3ce8a6b7f787140.jpg saved to cache
2026-03-28 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2
2026-03-28 18:45:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562fc6d0>
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_9f7a00689f9ef9ef1c0ae3312d084c42.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_9f7a00689f9ef9ef1c0ae3312d084c42.jpg saved to cache
2026-03-28 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2
2026-03-28 18:45:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454784f10>
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0d%252F690d519508e7fa00af3071ebbf9fc21a%252Fpa%252FLR61927_f4aaf2abb0dff332bc1dbdc8293d6dbe.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_f4aaf2abb0dff332bc1dbdc8293d6dbe.jpg saved to cache
2026-03-28 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2
2026-03-28 18:45:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ef68d61-efa4-54e0-b308-8b263cf39bd2, skipping ID generation
2026-03-28 18:45:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2 with scrape type 1
2026-03-28 18:45:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2 sending to next pipeline
2026-03-28 18:45:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ef68d61-efa4-54e0-b308-8b263cf39bd2, identifier: LR61927
2026-03-28 18:45:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456298710>
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_d0dcd056698ae463ff3f3dce0f4d95c6.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_d0dcd056698ae463ff3f3dce0f4d95c6.jpg saved to cache
2026-03-28 18:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae5199a5-1ebe-52b0-8ac9-992116b90421
2026-03-28 18:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454785dd0>
2026-03-28 18:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_2cec1fd0a08db2445a9f9314eccfbfc0.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_2cec1fd0a08db2445a9f9314eccfbfc0.jpg saved to cache
2026-03-28 18:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8
2026-03-28 18:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b6510>
2026-03-28 18:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_f3ce313902409f15e139ecb87bf9e4c7.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_f3ce313902409f15e139ecb87bf9e4c7.jpg saved to cache
2026-03-28 18:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae5199a5-1ebe-52b0-8ac9-992116b90421
2026-03-28 18:45:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9c7e85a-099a-5974-88e1-a43d3a7ae8d2 with identifier: MN30135
2026-03-28 18:45:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9c7e85a-099a-5974-88e1-a43d3a7ae8d2 with identifier: MN30135
2026-03-28 18:45:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9c7e85a-099a-5974-88e1-a43d3a7ae8d2 with identifier: MN30135 to the API
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_8ff416105566bec1af86658ae35833b6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:17Z',
 'fuel_type': 'petrol',
 'id': 'b9c7e85a-099a-5974-88e1-a43d3a7ae8d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN30135',
 'listing': 'auction',
 'location': 'DE, Hagen',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 16629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2655637,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_8ff416105566bec1af86658ae35833b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_091f7e214d1495a364cb663dded32ea8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_3fcea4a7b124855ed69988bef7e3d50c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_6e7c636fb96d6aa34fb48a0cf281fec0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2275642,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_f9537652860648233b42c3aeb07c841d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_2516b0e4b635e85b6d20bf5d63b0ae95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_5c87e2fd4bd3457ddfa1315b3761d785.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_81dd44dd5e0fecc96beecc0262fcaed8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_bf818a2f8f7f1bb90cec5461b7c57035.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9c7e85a-099a-5974-88e1-a43d3a7ae8d2/b9c7e85a-099a-5974-88e1-a43d3a7ae8d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d0/45d088e9d1e2ff383f61fadf77a612af/pa/MN30135_3a1d5338e3fd79b89367e120b3cad189.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.4 TSI Design BlueMotion',
 'transmission': 'automatic',
 'trim': 'Design BlueMotion',
 'year': 2018}
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30135%27 HTTP/1.1" 200 None
2026-03-28 18:45:03 [auto1.de] INFO: Saving data for MN30135: {'created_time': 1774723503.669623, 'last_price_update_time': 1774723503.669635, 'auction_closing_time': 1774884557.0}
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN30135') HTTP/1.1" 204 0
2026-03-28 18:45:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ef68d61-efa4-54e0-b308-8b263cf39bd2 with identifier: LR61927
2026-03-28 18:45:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ef68d61-efa4-54e0-b308-8b263cf39bd2 with identifier: LR61927
2026-03-28 18:45:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ef68d61-efa4-54e0-b308-8b263cf39bd2 with identifier: LR61927 to the API
2026-03-28 18:45:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_f4aaf2abb0dff332bc1dbdc8293d6dbe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:06:45Z',
 'fuel_type': 'diesel',
 'id': '7ef68d61-efa4-54e0-b308-8b263cf39bd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR61927',
 'listing': 'auction',
 'location': 'DE, Kaiserslautern',
 'make': 'BMW',
 'model': '5er',
 'odometer': 266641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3288645,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_9f7a00689f9ef9ef1c0ae3312d084c42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3171638,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_e4e02a91f343495be3ce8a6b7f787140.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_f68a3f4e48082f7aad743c6ab1ec4033.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3020007,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_02e7b6065da3d39b82be4c1bf861becd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3532728,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_f4aaf2abb0dff332bc1dbdc8293d6dbe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_1e722cbce2a7f0711bf7dec16e729ca5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_f6dcbe719b8a6262db59fdb522021026.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_cbd7b2f53d5e2692b0f3f40d3baa3762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_43d1a4f42473ac809fb4d4345878c4cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ef68d61-efa4-54e0-b308-8b263cf39bd2/7ef68d61-efa4-54e0-b308-8b263cf39bd2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0d/690d519508e7fa00af3071ebbf9fc21a/pa/LR61927_5879e666b21dbdb627ca55409b199ae6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2018}
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR61927%27 HTTP/1.1" 200 None
2026-03-28 18:45:04 [auto1.de] INFO: Saving data for LR61927: {'created_time': 1774723504.126781, 'last_price_update_time': 1774723504.126793, 'auction_closing_time': 1774883205.0}
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR61927') HTTP/1.1" 204 0
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245649e210>
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_52f7060e0bc9313c1b311e71fa8cff24.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_52f7060e0bc9313c1b311e71fa8cff24.jpg saved to cache
2026-03-28 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307
2026-03-28 18:45:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_d068bd376b31db17e8d288c7407365b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_9b4a47b9efce99c78970c81ed918b658.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_2d013e4afb08829da7123f072ad3b348.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_71763e3c6cd5eaf30c48d398a85caa50.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_ef172d1a65021797a130c8276fdb3d31.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a06d0>
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_d068bd376b31db17e8d288c7407365b6.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_d068bd376b31db17e8d288c7407365b6.jpg saved to cache
2026-03-28 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307
2026-03-28 18:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_0884c7b596d66091deaf61de7099a70a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_db1852e6f9366108d04f4d7ac8741df0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477f5d0>
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_9b4a47b9efce99c78970c81ed918b658.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_9b4a47b9efce99c78970c81ed918b658.jpg saved to cache
2026-03-28 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307
2026-03-28 18:45:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245608ed10>
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_2d013e4afb08829da7123f072ad3b348.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_2d013e4afb08829da7123f072ad3b348.jpg saved to cache
2026-03-28 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307
2026-03-28 18:45:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561bd690>
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_71763e3c6cd5eaf30c48d398a85caa50.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_71763e3c6cd5eaf30c48d398a85caa50.jpg saved to cache
2026-03-28 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8
2026-03-28 18:45:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245616f410>
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_ef172d1a65021797a130c8276fdb3d31.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_ef172d1a65021797a130c8276fdb3d31.jpg saved to cache
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8
2026-03-28 18:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU18032/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245616e950>
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_0884c7b596d66091deaf61de7099a70a.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_0884c7b596d66091deaf61de7099a70a.jpg saved to cache
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562d6cd0>
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_db1852e6f9366108d04f4d7ac8741df0.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_db1852e6f9366108d04f4d7ac8741df0.jpg saved to cache
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8
2026-03-28 18:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA64298> (referer: https://www.auto1.com/v1/car-details-view/XA64298/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_dcc891b411e8697e4bda3bb1ea59df43.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_ceb5fb76b220ca0a4fad9c6705d5b58f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_59f591f1debaddd12c7880475b613f91.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_019efc6d86da7a79894fb62b05973e62.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_6efe64df4b067a81b6e98103a9a42936.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_c53c093b92accb1315f7fb7fb12bed50.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_bccc66a8e670344e5ff6222cfad179f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 129d7b1c-9329-5e37-a7da-2bf4df575151 with identifier: XA64298
2026-03-28 18:45:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 129d7b1c-9329-5e37-a7da-2bf4df575151 with scrape type 1
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 129d7b1c-9329-5e37-a7da-2bf4df575151
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F58%252F8c58097587cd762fdcc1d0663908525a%252Fpa%252FXA64298_b42dd8b295456cbce0231c9b746c364a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_b42dd8b295456cbce0231c9b746c364a.jpg not downloaded yet
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F58%252F8c58097587cd762fdcc1d0663908525a%252Fpa%252FXA64298_0936bca916a4e085c7ad8bcf7ef89d7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_0936bca916a4e085c7ad8bcf7ef89d7f.jpg not downloaded yet
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F58%252F8c58097587cd762fdcc1d0663908525a%252Fpa%252FXA64298_18360f6c0035d51be907ca8f5bceaca5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_18360f6c0035d51be907ca8f5bceaca5.jpg not downloaded yet
2026-03-28 18:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245608d390>
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_dcc891b411e8697e4bda3bb1ea59df43.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_dcc891b411e8697e4bda3bb1ea59df43.jpg saved to cache
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8
2026-03-28 18:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454774390>
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_ceb5fb76b220ca0a4fad9c6705d5b58f.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_ceb5fb76b220ca0a4fad9c6705d5b58f.jpg saved to cache
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8
2026-03-28 18:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547f5210>
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_59f591f1debaddd12c7880475b613f91.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_59f591f1debaddd12c7880475b613f91.jpg saved to cache
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307
2026-03-28 18:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547f7690>
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_019efc6d86da7a79894fb62b05973e62.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_019efc6d86da7a79894fb62b05973e62.jpg saved to cache
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307
2026-03-28 18:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458560790>
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_6efe64df4b067a81b6e98103a9a42936.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_6efe64df4b067a81b6e98103a9a42936.jpg saved to cache
2026-03-28 18:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307
2026-03-28 18:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456191e90>
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_c53c093b92accb1315f7fb7fb12bed50.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_c53c093b92accb1315f7fb7fb12bed50.jpg saved to cache
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307
2026-03-28 18:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_7749d7bbb60e2f7ecdb256da5e9f6ce3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F58%252F8c58097587cd762fdcc1d0663908525a%252Fpa%252FXA64298_a1e138b0b5d82e450e8babc7e78a0c00.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_a1e138b0b5d82e450e8babc7e78a0c00.jpg not downloaded yet
2026-03-28 18:45:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456132210>
2026-03-28 18:45:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3c096f1bd67e48ef5a17d81edc175%252Fpa%252FTF95367_bccc66a8e670344e5ff6222cfad179f3.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_bccc66a8e670344e5ff6222cfad179f3.jpg saved to cache
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307
2026-03-28 18:45:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 099874d2-9d2e-5dc2-9ca4-9eaf13792307, skipping ID generation
2026-03-28 18:45:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307 with scrape type 1
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307 sending to next pipeline
2026-03-28 18:45:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 099874d2-9d2e-5dc2-9ca4-9eaf13792307, identifier: TF95367
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F58%252F8c58097587cd762fdcc1d0663908525a%252Fpa%252FXA64298_1d8dd8ea09d0a589675706eea68acce5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_1d8dd8ea09d0a589675706eea68acce5.jpg not downloaded yet
2026-03-28 18:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN22818> (referer: https://www.auto1.com/v1/car-details-view/JN22818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 099874d2-9d2e-5dc2-9ca4-9eaf13792307 with identifier: TF95367
2026-03-28 18:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 099874d2-9d2e-5dc2-9ca4-9eaf13792307 with identifier: TF95367
2026-03-28 18:45:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 099874d2-9d2e-5dc2-9ca4-9eaf13792307 with identifier: TF95367 to the API
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_bccc66a8e670344e5ff6222cfad179f3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:29:59Z',
 'fuel_type': 'diesel',
 'id': '099874d2-9d2e-5dc2-9ca4-9eaf13792307',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF95367',
 'listing': 'auction',
 'location': 'DE, Montabaur',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 290756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_bccc66a8e670344e5ff6222cfad179f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2873709,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_019efc6d86da7a79894fb62b05973e62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2777030,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_9b4a47b9efce99c78970c81ed918b658.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2945917,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_6efe64df4b067a81b6e98103a9a42936.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2895955,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_59f591f1debaddd12c7880475b613f91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2856956,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_c53c093b92accb1315f7fb7fb12bed50.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2960909,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_2d013e4afb08829da7123f072ad3b348.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_0884c7b596d66091deaf61de7099a70a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977668,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_d068bd376b31db17e8d288c7407365b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099874d2-9d2e-5dc2-9ca4-9eaf13792307/099874d2-9d2e-5dc2-9ca4-9eaf13792307_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3c096f1bd67e48ef5a17d81edc175/pa/TF95367_52f7060e0bc9313c1b311e71fa8cff24.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF95367%27 HTTP/1.1" 200 None
2026-03-28 18:45:06 [auto1.de] INFO: Saving data for TF95367: {'created_time': 1774723506.697036, 'last_price_update_time': 1774723506.697048, 'auction_closing_time': 1774884599.0}
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF95367') HTTP/1.1" 204 0
2026-03-28 18:45:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:06 [scrapy.extensions.logstats] INFO: Crawled 370 pages (at 83 pages/min), scraped 644 items (at 57 items/min)
2026-03-28 18:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 193MiB
2026-03-28 18:45:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b7590>
2026-03-28 18:45:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_7749d7bbb60e2f7ecdb256da5e9f6ce3.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_7749d7bbb60e2f7ecdb256da5e9f6ce3.jpg saved to cache
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8
2026-03-28 18:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08b94ab2-dad9-5ba9-9afc-b98728cb8c48 with identifier: JN22818
2026-03-28 18:45:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48 with scrape type 1
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_05a374d807b287a2ec40ed5eee3fe371.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_05a374d807b287a2ec40ed5eee3fe371.jpg not downloaded yet
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_9660cf184029118b153d7a043ace8db1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_9660cf184029118b153d7a043ace8db1.jpg not downloaded yet
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_aaf6267c88f1fab46a6fd5675042fe66.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_aaf6267c88f1fab46a6fd5675042fe66.jpg not downloaded yet
2026-03-28 18:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_a1e138b0b5d82e450e8babc7e78a0c00.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_3a009670904e2e65d9ef361666a4a2f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_3a009670904e2e65d9ef361666a4a2f9.jpg not downloaded yet
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_6607c377b36de09bb03a7433faa9f438.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_6607c377b36de09bb03a7433faa9f438.jpg not downloaded yet
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_4edcb1a96a8bfbedbbd5b3d4fc9750fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_4edcb1a96a8bfbedbbd5b3d4fc9750fe.jpg not downloaded yet
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_65d916a7dc9784c8e2b19755b7556030.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_65d916a7dc9784c8e2b19755b7556030.jpg not downloaded yet
2026-03-28 18:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW52708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_d9979f4bc0486de2e5a24636286974b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_d9979f4bc0486de2e5a24636286974b1.jpg not downloaded yet
2026-03-28 18:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_b42dd8b295456cbce0231c9b746c364a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_9f8711f441b0c764e870af190383850d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_9f8711f441b0c764e870af190383850d.jpg not downloaded yet
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_8c3e3b12bf1ef39f5f2591b09b869a41.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_8c3e3b12bf1ef39f5f2591b09b869a41.jpg not downloaded yet
2026-03-28 18:45:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454758750>
2026-03-28 18:45:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_129d7b1c-9329-5e37-a7da-2bf4df575151/129d7b1c-9329-5e37-a7da-2bf4df575151_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F58%252F8c58097587cd762fdcc1d0663908525a%252Fpa%252FXA64298_a1e138b0b5d82e450e8babc7e78a0c00.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_a1e138b0b5d82e450e8babc7e78a0c00.jpg saved to cache
2026-03-28 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 129d7b1c-9329-5e37-a7da-2bf4df575151
2026-03-28 18:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_0936bca916a4e085c7ad8bcf7ef89d7f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_18360f6c0035d51be907ca8f5bceaca5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_3880217de8ee107b3ca15f0fc6f2386d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_638aad48a605851620e92fdeb58c8ebd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_ebf82fec9cd4f64fe5dcbbfb29ede2fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_1c1dfc881616aab1515c5ae47d4bba64.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_0f8c039e2aad0a52ddb5087e0ff3d13f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561d2010>
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_129d7b1c-9329-5e37-a7da-2bf4df575151/129d7b1c-9329-5e37-a7da-2bf4df575151_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F58%252F8c58097587cd762fdcc1d0663908525a%252Fpa%252FXA64298_b42dd8b295456cbce0231c9b746c364a.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_b42dd8b295456cbce0231c9b746c364a.jpg saved to cache
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 129d7b1c-9329-5e37-a7da-2bf4df575151
2026-03-28 18:45:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_aaf6267c88f1fab46a6fd5675042fe66.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560ab050>
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_129d7b1c-9329-5e37-a7da-2bf4df575151/129d7b1c-9329-5e37-a7da-2bf4df575151_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F58%252F8c58097587cd762fdcc1d0663908525a%252Fpa%252FXA64298_0936bca916a4e085c7ad8bcf7ef89d7f.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_0936bca916a4e085c7ad8bcf7ef89d7f.jpg saved to cache
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 129d7b1c-9329-5e37-a7da-2bf4df575151
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562900d0>
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_129d7b1c-9329-5e37-a7da-2bf4df575151/129d7b1c-9329-5e37-a7da-2bf4df575151_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F58%252F8c58097587cd762fdcc1d0663908525a%252Fpa%252FXA64298_18360f6c0035d51be907ca8f5bceaca5.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_18360f6c0035d51be907ca8f5bceaca5.jpg saved to cache
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 129d7b1c-9329-5e37-a7da-2bf4df575151
2026-03-28 18:45:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454760510>
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_3880217de8ee107b3ca15f0fc6f2386d.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_3880217de8ee107b3ca15f0fc6f2386d.jpg saved to cache
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8
2026-03-28 18:45:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456534c10>
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_638aad48a605851620e92fdeb58c8ebd.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_638aad48a605851620e92fdeb58c8ebd.jpg saved to cache
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8
2026-03-28 18:45:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245649d150>
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fed%252Fc0ed0f09d0c8ba741e1639a3fc557219%252Fpa%252FYE71263_ebf82fec9cd4f64fe5dcbbfb29ede2fa.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_ebf82fec9cd4f64fe5dcbbfb29ede2fa.jpg saved to cache
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8
2026-03-28 18:45:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8, skipping ID generation
2026-03-28 18:45:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8 with scrape type 1
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8 sending to next pipeline
2026-03-28 18:45:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8, identifier: YE71263
2026-03-28 18:45:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561d33d0>
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_1c1dfc881616aab1515c5ae47d4bba64.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_1c1dfc881616aab1515c5ae47d4bba64.jpg saved to cache
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3865c2e-3891-5656-982a-919ba8851b55
2026-03-28 18:45:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456237dd0>
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_0f8c039e2aad0a52ddb5087e0ff3d13f.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_0f8c039e2aad0a52ddb5087e0ff3d13f.jpg saved to cache
2026-03-28 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae5199a5-1ebe-52b0-8ac9-992116b90421
2026-03-28 18:45:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8 with identifier: YE71263
2026-03-28 18:45:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8 with identifier: YE71263
2026-03-28 18:45:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8 with identifier: YE71263 to the API
2026-03-28 18:45:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_ebf82fec9cd4f64fe5dcbbfb29ede2fa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:29:17Z',
 'fuel_type': 'diesel',
 'id': 'eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE71263',
 'listing': 'auction',
 'location': 'DE, Bad Neuenahr-Ahrweiler',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 291567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652540,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_3880217de8ee107b3ca15f0fc6f2386d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2377261,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_638aad48a605851620e92fdeb58c8ebd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2545412,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_ebf82fec9cd4f64fe5dcbbfb29ede2fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_7749d7bbb60e2f7ecdb256da5e9f6ce3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_2cec1fd0a08db2445a9f9314eccfbfc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2790355,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_ef172d1a65021797a130c8276fdb3d31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561347,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_ceb5fb76b220ca0a4fad9c6705d5b58f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2607317,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_dcc891b411e8697e4bda3bb1ea59df43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_db1852e6f9366108d04f4d7ac8741df0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8/eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2770685,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ed/c0ed0f09d0c8ba741e1639a3fc557219/pa/YE71263_71763e3c6cd5eaf30c48d398a85caa50.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE71263%27 HTTP/1.1" 200 None
2026-03-28 18:45:08 [auto1.de] INFO: Saving data for YE71263: {'created_time': 1774723508.289231, 'last_price_update_time': 1774723508.289242, 'auction_closing_time': 1774884557.0}
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE71263') HTTP/1.1" 204 0
2026-03-28 18:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_5d3335fd8ecea0f5ecda05cdb71080be.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK29510/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU18032> (referer: https://www.auto1.com/v1/car-details-view/FU18032/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW03502> (referer: https://www.auto1.com/v1/car-details-view/PW03502/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564d0950>
2026-03-28 18:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_aaf6267c88f1fab46a6fd5675042fe66.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_aaf6267c88f1fab46a6fd5675042fe66.jpg saved to cache
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48
2026-03-28 18:45:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_e55f0fe0e9340813c57723bb75ce99a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_9f8711f441b0c764e870af190383850d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_65d916a7dc9784c8e2b19755b7556030.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_4edcb1a96a8bfbedbbd5b3d4fc9750fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_8c3e3b12bf1ef39f5f2591b09b869a41.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_d9979f4bc0486de2e5a24636286974b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618add0>
2026-03-28 18:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_5d3335fd8ecea0f5ecda05cdb71080be.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_5d3335fd8ecea0f5ecda05cdb71080be.jpg saved to cache
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae5199a5-1ebe-52b0-8ac9-992116b90421
2026-03-28 18:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_3a009670904e2e65d9ef361666a4a2f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_6607c377b36de09bb03a7433faa9f438.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc6c98d-7bd1-550b-8ded-2524d7f85bce with identifier: FU18032
2026-03-28 18:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc6c98d-7bd1-550b-8ded-2524d7f85bce with scrape type 1
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0dc6c98d-7bd1-550b-8ded-2524d7f85bce
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F0f%252F060fa4d7deb0e3b771e7b28062440fc9%252Fpa%252FFU18032_b3b9966cdbca280ac9500f7768817159.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_b3b9966cdbca280ac9500f7768817159.jpg already downloaded
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F0f%252F060fa4d7deb0e3b771e7b28062440fc9%252Fpa%252FFU18032_93913b73ad116e4604f9e0b1f21ed73e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_93913b73ad116e4604f9e0b1f21ed73e.jpg already downloaded
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F0f%252F060fa4d7deb0e3b771e7b28062440fc9%252Fpa%252FFU18032_947bae111faca20fedabd3eff90e5cb5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_947bae111faca20fedabd3eff90e5cb5.jpg already downloaded
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F0f%252F060fa4d7deb0e3b771e7b28062440fc9%252Fpa%252FFU18032_b44f8d2d0ab8d31727113cfeff912600.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_b44f8d2d0ab8d31727113cfeff912600.jpg already downloaded
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F0f%252F060fa4d7deb0e3b771e7b28062440fc9%252Fpa%252FFU18032_869bfd5a6d94e103d48ca828b5c575aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_869bfd5a6d94e103d48ca828b5c575aa.jpg already downloaded
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F0f%252F060fa4d7deb0e3b771e7b28062440fc9%252Fpa%252FFU18032_e97b8df50134c5c9fe93934a72cff03c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_e97b8df50134c5c9fe93934a72cff03c.jpg already downloaded
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F0f%252F060fa4d7deb0e3b771e7b28062440fc9%252Fpa%252FFU18032_6479b51a4919b7e32d7986f68b6abfd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_6479b51a4919b7e32d7986f68b6abfd6.jpg already downloaded
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F0f%252F060fa4d7deb0e3b771e7b28062440fc9%252Fpa%252FFU18032_a4b3e38b28bc373e4a24b5df5f6e25cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_a4b3e38b28bc373e4a24b5df5f6e25cc.jpg already downloaded
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F0f%252F060fa4d7deb0e3b771e7b28062440fc9%252Fpa%252FFU18032_834b8fa9da80b7ccb0d91bebfc73b036.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_834b8fa9da80b7ccb0d91bebfc73b036.jpg already downloaded
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F0f%252F060fa4d7deb0e3b771e7b28062440fc9%252Fpa%252FFU18032_9070202692c07825bed5738cc49a44c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_9070202692c07825bed5738cc49a44c8.jpg already downloaded
2026-03-28 18:45:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0dc6c98d-7bd1-550b-8ded-2524d7f85bce, identifier: FU18032
2026-03-28 18:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2be2fc2b-ef65-598a-b337-31a15295c10d with identifier: PW03502
2026-03-28 18:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2be2fc2b-ef65-598a-b337-31a15295c10d with scrape type 1
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2be2fc2b-ef65-598a-b337-31a15295c10d
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_2b5f486da4ced6f0d8730cd0736f4585.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_2b5f486da4ced6f0d8730cd0736f4585.jpg not downloaded yet
2026-03-28 18:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_1d8dd8ea09d0a589675706eea68acce5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0dc6c98d-7bd1-550b-8ded-2524d7f85bce with identifier: FU18032
2026-03-28 18:45:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0dc6c98d-7bd1-550b-8ded-2524d7f85bce with identifier: FU18032
2026-03-28 18:45:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0dc6c98d-7bd1-550b-8ded-2524d7f85bce with identifier: FU18032 to the API
2026-03-28 18:45:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FU18032>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:12:34Z',
 'fuel_type': 'diesel',
 'id': '0dc6c98d-7bd1-550b-8ded-2524d7f85bce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU18032',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 118846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_b3b9966cdbca280ac9500f7768817159.jpg',
                'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_93913b73ad116e4604f9e0b1f21ed73e.jpg',
                'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_947bae111faca20fedabd3eff90e5cb5.jpg',
                'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_b44f8d2d0ab8d31727113cfeff912600.jpg',
                'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_869bfd5a6d94e103d48ca828b5c575aa.jpg',
                'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_e97b8df50134c5c9fe93934a72cff03c.jpg',
                'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_6479b51a4919b7e32d7986f68b6abfd6.jpg',
                'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_a4b3e38b28bc373e4a24b5df5f6e25cc.jpg',
                'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_834b8fa9da80b7ccb0d91bebfc73b036.jpg',
                'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_9070202692c07825bed5738cc49a44c8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc6c98d-7bd1-550b-8ded-2524d7f85bce/0dc6c98d-7bd1-550b-8ded-2524d7f85bce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_b3b9966cdbca280ac9500f7768817159.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc6c98d-7bd1-550b-8ded-2524d7f85bce/0dc6c98d-7bd1-550b-8ded-2524d7f85bce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_93913b73ad116e4604f9e0b1f21ed73e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc6c98d-7bd1-550b-8ded-2524d7f85bce/0dc6c98d-7bd1-550b-8ded-2524d7f85bce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_947bae111faca20fedabd3eff90e5cb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc6c98d-7bd1-550b-8ded-2524d7f85bce/0dc6c98d-7bd1-550b-8ded-2524d7f85bce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_b44f8d2d0ab8d31727113cfeff912600.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc6c98d-7bd1-550b-8ded-2524d7f85bce/0dc6c98d-7bd1-550b-8ded-2524d7f85bce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_869bfd5a6d94e103d48ca828b5c575aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc6c98d-7bd1-550b-8ded-2524d7f85bce/0dc6c98d-7bd1-550b-8ded-2524d7f85bce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_e97b8df50134c5c9fe93934a72cff03c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc6c98d-7bd1-550b-8ded-2524d7f85bce/0dc6c98d-7bd1-550b-8ded-2524d7f85bce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_6479b51a4919b7e32d7986f68b6abfd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc6c98d-7bd1-550b-8ded-2524d7f85bce/0dc6c98d-7bd1-550b-8ded-2524d7f85bce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_a4b3e38b28bc373e4a24b5df5f6e25cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc6c98d-7bd1-550b-8ded-2524d7f85bce/0dc6c98d-7bd1-550b-8ded-2524d7f85bce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_834b8fa9da80b7ccb0d91bebfc73b036.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc6c98d-7bd1-550b-8ded-2524d7f85bce/0dc6c98d-7bd1-550b-8ded-2524d7f85bce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/0f/060fa4d7deb0e3b771e7b28062440fc9/pa/FU18032_9070202692c07825bed5738cc49a44c8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Life BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Life BlueMotion Tech',
 'year': 2013}
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU18032%27 HTTP/1.1" 200 None
2026-03-28 18:45:09 [auto1.de] INFO: Saving data for FU18032: {'created_time': 1774723509.165359, 'last_price_update_time': 1774723509.16537, 'auction_closing_time': 1774883554.0}
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU18032') HTTP/1.1" 204 0
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_1926e7099928f94a7112f96ecb37839f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_1926e7099928f94a7112f96ecb37839f.jpg not downloaded yet
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_d8ec8f05f722213780b44f9e38bff9d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_d8ec8f05f722213780b44f9e38bff9d9.jpg not downloaded yet
2026-03-28 18:45:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245620ed10>
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F75%252F62757de9ca4ede766d01778a518a89ac%252Fpa%252FUY60901_e55f0fe0e9340813c57723bb75ce99a9.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_e55f0fe0e9340813c57723bb75ce99a9.jpg saved to cache
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3865c2e-3891-5656-982a-919ba8851b55
2026-03-28 18:45:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3865c2e-3891-5656-982a-919ba8851b55, skipping ID generation
2026-03-28 18:45:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3865c2e-3891-5656-982a-919ba8851b55 with scrape type 1
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3865c2e-3891-5656-982a-919ba8851b55 sending to next pipeline
2026-03-28 18:45:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3865c2e-3891-5656-982a-919ba8851b55, identifier: UY60901
2026-03-28 18:45:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245650d190>
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_9f8711f441b0c764e870af190383850d.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_9f8711f441b0c764e870af190383850d.jpg saved to cache
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48
2026-03-28 18:45:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456189850>
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_65d916a7dc9784c8e2b19755b7556030.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_65d916a7dc9784c8e2b19755b7556030.jpg saved to cache
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48
2026-03-28 18:45:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245648aa90>
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_4edcb1a96a8bfbedbbd5b3d4fc9750fe.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_4edcb1a96a8bfbedbbd5b3d4fc9750fe.jpg saved to cache
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48
2026-03-28 18:45:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245627ec50>
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_8c3e3b12bf1ef39f5f2591b09b869a41.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_8c3e3b12bf1ef39f5f2591b09b869a41.jpg saved to cache
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48
2026-03-28 18:45:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563e8090>
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_d9979f4bc0486de2e5a24636286974b1.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_d9979f4bc0486de2e5a24636286974b1.jpg saved to cache
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564d2390>
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_3a009670904e2e65d9ef361666a4a2f9.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_3a009670904e2e65d9ef361666a4a2f9.jpg saved to cache
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245605a650>
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_6607c377b36de09bb03a7433faa9f438.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_6607c377b36de09bb03a7433faa9f438.jpg saved to cache
2026-03-28 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245636ff10>
2026-03-28 18:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_129d7b1c-9329-5e37-a7da-2bf4df575151/129d7b1c-9329-5e37-a7da-2bf4df575151_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F58%252F8c58097587cd762fdcc1d0663908525a%252Fpa%252FXA64298_1d8dd8ea09d0a589675706eea68acce5.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_1d8dd8ea09d0a589675706eea68acce5.jpg saved to cache
2026-03-28 18:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 129d7b1c-9329-5e37-a7da-2bf4df575151
2026-03-28 18:45:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 129d7b1c-9329-5e37-a7da-2bf4df575151, skipping ID generation
2026-03-28 18:45:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 129d7b1c-9329-5e37-a7da-2bf4df575151 with scrape type 1
2026-03-28 18:45:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 129d7b1c-9329-5e37-a7da-2bf4df575151 sending to next pipeline
2026-03-28 18:45:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 129d7b1c-9329-5e37-a7da-2bf4df575151, identifier: XA64298
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_67c3db8f76996efc3d3f6127c0255828.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_67c3db8f76996efc3d3f6127c0255828.jpg not downloaded yet
2026-03-28 18:45:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3865c2e-3891-5656-982a-919ba8851b55 with identifier: UY60901
2026-03-28 18:45:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3865c2e-3891-5656-982a-919ba8851b55 with identifier: UY60901
2026-03-28 18:45:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3865c2e-3891-5656-982a-919ba8851b55 with identifier: UY60901 to the API
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_e55f0fe0e9340813c57723bb75ce99a9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:38Z',
 'fuel_type': 'petrol',
 'id': 'a3865c2e-3891-5656-982a-919ba8851b55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY60901',
 'listing': 'auction',
 'location': 'DE, Neufahrn',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 128762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2475741,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_e55f0fe0e9340813c57723bb75ce99a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2250433,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_1c1dfc881616aab1515c5ae47d4bba64.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_5b56fef93574d68d62c93a1b46d72528.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2343773,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_75d7c9fb69da680c030927dbf50f45b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_10675433c81f01f207fd8cfe382b499f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2273231,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_54960e5803559128a3bac7925ec39d4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_e12d23832415cfb437b15a811df4c532.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_3f0fa036f4fea9fda4b7bc66e9fa5faa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2447896,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_b2b966d3baf0bdcc1caae3d1bad48da9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3865c2e-3891-5656-982a-919ba8851b55/a3865c2e-3891-5656-982a-919ba8851b55_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/75/62757de9ca4ede766d01778a518a89ac/pa/UY60901_768c3b0b476b4c5e448b6c4e1c9cd813.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'Instyle 4WD',
 'year': 2014}
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY60901%27 HTTP/1.1" 200 None
2026-03-28 18:45:10 [auto1.de] INFO: Saving data for UY60901: {'created_time': 1774723510.527824, 'last_price_update_time': 1774723510.527836, 'auction_closing_time': 1774885598.0}
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY60901') HTTP/1.1" 204 0
2026-03-28 18:45:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 129d7b1c-9329-5e37-a7da-2bf4df575151 with identifier: XA64298
2026-03-28 18:45:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 129d7b1c-9329-5e37-a7da-2bf4df575151 with identifier: XA64298
2026-03-28 18:45:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 129d7b1c-9329-5e37-a7da-2bf4df575151 with identifier: XA64298 to the API
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_1d8dd8ea09d0a589675706eea68acce5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:13:34Z',
 'fuel_type': 'petrol',
 'id': '129d7b1c-9329-5e37-a7da-2bf4df575151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA64298',
 'listing': 'auction',
 'location': 'DE, Worms',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 139811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_129d7b1c-9329-5e37-a7da-2bf4df575151/129d7b1c-9329-5e37-a7da-2bf4df575151_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_b42dd8b295456cbce0231c9b746c364a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_129d7b1c-9329-5e37-a7da-2bf4df575151/129d7b1c-9329-5e37-a7da-2bf4df575151_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_0936bca916a4e085c7ad8bcf7ef89d7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_129d7b1c-9329-5e37-a7da-2bf4df575151/129d7b1c-9329-5e37-a7da-2bf4df575151_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_18360f6c0035d51be907ca8f5bceaca5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_129d7b1c-9329-5e37-a7da-2bf4df575151/129d7b1c-9329-5e37-a7da-2bf4df575151_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_a1e138b0b5d82e450e8babc7e78a0c00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_129d7b1c-9329-5e37-a7da-2bf4df575151/129d7b1c-9329-5e37-a7da-2bf4df575151_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/58/8c58097587cd762fdcc1d0663908525a/pa/XA64298_1d8dd8ea09d0a589675706eea68acce5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Graphite',
 'transmission': 'manual',
 'trim': 'Graphite',
 'year': 2014}
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA64298%27 HTTP/1.1" 200 None
2026-03-28 18:45:10 [auto1.de] INFO: Saving data for XA64298: {'created_time': 1774723510.91576, 'last_price_update_time': 1774723510.915773, 'auction_closing_time': 1774883614.0}
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA64298') HTTP/1.1" 204 0
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_fd1b69c598e03619ce953bef5824a4a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_fd1b69c598e03619ce953bef5824a4a3.jpg not downloaded yet
2026-03-28 18:45:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_c966205b88f253b593294eeb970fed80.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_c966205b88f253b593294eeb970fed80.jpg not downloaded yet
2026-03-28 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_54d5ef28dce4fe878564902192c2111c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_54d5ef28dce4fe878564902192c2111c.jpg not downloaded yet
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_7ea73a6599eaa4fc4c68d80b6fe8ca89.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_7ea73a6599eaa4fc4c68d80b6fe8ca89.jpg not downloaded yet
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_7df6142563ab312dafaf95025b21173c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_7df6142563ab312dafaf95025b21173c.jpg not downloaded yet
2026-03-28 18:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_67c3db8f76996efc3d3f6127c0255828.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_4112180d4128dac08532fd8bc8b5f254.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_4112180d4128dac08532fd8bc8b5f254.jpg not downloaded yet
2026-03-28 18:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_1926e7099928f94a7112f96ecb37839f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_2b5f486da4ced6f0d8730cd0736f4585.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_05a374d807b287a2ec40ed5eee3fe371.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_9660cf184029118b153d7a043ace8db1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_fa14c1d27326a9d5d8c4cc5735eae66a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_d8ec8f05f722213780b44f9e38bff9d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_7df6142563ab312dafaf95025b21173c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_7ea73a6599eaa4fc4c68d80b6fe8ca89.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_ad3e7239ad6a48a56a0ef147a751259b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638d7d0>
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_67c3db8f76996efc3d3f6127c0255828.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_67c3db8f76996efc3d3f6127c0255828.jpg saved to cache
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2be2fc2b-ef65-598a-b337-31a15295c10d
2026-03-28 18:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_c966205b88f253b593294eeb970fed80.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_4112180d4128dac08532fd8bc8b5f254.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475f550>
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_1926e7099928f94a7112f96ecb37839f.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_1926e7099928f94a7112f96ecb37839f.jpg saved to cache
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2be2fc2b-ef65-598a-b337-31a15295c10d
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477ff50>
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_2b5f486da4ced6f0d8730cd0736f4585.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_2b5f486da4ced6f0d8730cd0736f4585.jpg saved to cache
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2be2fc2b-ef65-598a-b337-31a15295c10d
2026-03-28 18:45:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245648ec10>
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_05a374d807b287a2ec40ed5eee3fe371.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_05a374d807b287a2ec40ed5eee3fe371.jpg saved to cache
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48
2026-03-28 18:45:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477f9d0>
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe9%252F8ae9a1168d3215e7082dff0dfe7d51d8%252Fpa%252FJN22818_9660cf184029118b153d7a043ace8db1.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_9660cf184029118b153d7a043ace8db1.jpg saved to cache
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48
2026-03-28 18:45:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08b94ab2-dad9-5ba9-9afc-b98728cb8c48, skipping ID generation
2026-03-28 18:45:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48 with scrape type 1
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48 sending to next pipeline
2026-03-28 18:45:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08b94ab2-dad9-5ba9-9afc-b98728cb8c48, identifier: JN22818
2026-03-28 18:45:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561a7f50>
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ff7%252F5ff7ee80db8c21011ad1bfa96a3096fc%252Fpa%252FBE81625_fa14c1d27326a9d5d8c4cc5735eae66a.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_fa14c1d27326a9d5d8c4cc5735eae66a.jpg saved to cache
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae5199a5-1ebe-52b0-8ac9-992116b90421
2026-03-28 18:45:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae5199a5-1ebe-52b0-8ac9-992116b90421, skipping ID generation
2026-03-28 18:45:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae5199a5-1ebe-52b0-8ac9-992116b90421 with scrape type 1
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae5199a5-1ebe-52b0-8ac9-992116b90421 sending to next pipeline
2026-03-28 18:45:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae5199a5-1ebe-52b0-8ac9-992116b90421, identifier: BE81625
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475e890>
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_d8ec8f05f722213780b44f9e38bff9d9.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_d8ec8f05f722213780b44f9e38bff9d9.jpg saved to cache
2026-03-28 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2be2fc2b-ef65-598a-b337-31a15295c10d
2026-03-28 18:45:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08b94ab2-dad9-5ba9-9afc-b98728cb8c48 with identifier: JN22818
2026-03-28 18:45:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08b94ab2-dad9-5ba9-9afc-b98728cb8c48 with identifier: JN22818
2026-03-28 18:45:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08b94ab2-dad9-5ba9-9afc-b98728cb8c48 with identifier: JN22818 to the API
2026-03-28 18:45:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_9660cf184029118b153d7a043ace8db1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:12:47Z',
 'fuel_type': 'diesel',
 'id': '08b94ab2-dad9-5ba9-9afc-b98728cb8c48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN22818',
 'listing': 'auction',
 'location': 'DE, Deggendorf',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 67859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2290649,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_05a374d807b287a2ec40ed5eee3fe371.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2310853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_9660cf184029118b153d7a043ace8db1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_aaf6267c88f1fab46a6fd5675042fe66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_3a009670904e2e65d9ef361666a4a2f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_6607c377b36de09bb03a7433faa9f438.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2303514,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_4edcb1a96a8bfbedbbd5b3d4fc9750fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2206560,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_65d916a7dc9784c8e2b19755b7556030.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2347376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_d9979f4bc0486de2e5a24636286974b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2115078,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_9f8711f441b0c764e870af190383850d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08b94ab2-dad9-5ba9-9afc-b98728cb8c48/08b94ab2-dad9-5ba9-9afc-b98728cb8c48_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2244514,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e9/8ae9a1168d3215e7082dff0dfe7d51d8/pa/JN22818_8c3e3b12bf1ef39f5f2591b09b869a41.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 40 TDI Mild-Hybrid quattro advanced',
 'transmission': 'automatic',
 'trim': 'quattro advanced',
 'year': 2021}
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN22818%27 HTTP/1.1" 200 None
2026-03-28 18:45:12 [auto1.de] INFO: Saving data for JN22818: {'created_time': 1774723512.190869, 'last_price_update_time': 1774723512.190881, 'auction_closing_time': 1774883567.0}
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN22818') HTTP/1.1" 204 0
2026-03-28 18:45:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae5199a5-1ebe-52b0-8ac9-992116b90421 with identifier: BE81625
2026-03-28 18:45:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae5199a5-1ebe-52b0-8ac9-992116b90421 with identifier: BE81625
2026-03-28 18:45:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae5199a5-1ebe-52b0-8ac9-992116b90421 with identifier: BE81625 to the API
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_fa14c1d27326a9d5d8c4cc5735eae66a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:55Z',
 'fuel_type': 'diesel',
 'id': 'ae5199a5-1ebe-52b0-8ac9-992116b90421',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE81625',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 184193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3572557,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_f1a4d8f879afff5b4bbb75cfc3538c86.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3635777,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_131aabc6b0735086a9ca51c8cd9e434f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3447795,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_fa14c1d27326a9d5d8c4cc5735eae66a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_5d3335fd8ecea0f5ecda05cdb71080be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3364657,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_0f8c039e2aad0a52ddb5087e0ff3d13f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_f3ce313902409f15e139ecb87bf9e4c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3567246,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_d0dcd056698ae463ff3f3dce0f4d95c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3501069,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_d79305ca314ec428389c2422a9fd0279.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_b9b35e7af6db165d154fd9a42d357311.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5199a5-1ebe-52b0-8ac9-992116b90421/ae5199a5-1ebe-52b0-8ac9-992116b90421_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/f7/5ff7ee80db8c21011ad1bfa96a3096fc/pa/BE81625_d68f3674d503669fcc4166f75f7fcecc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE81625%27 HTTP/1.1" 200 None
2026-03-28 18:45:12 [auto1.de] INFO: Saving data for BE81625: {'created_time': 1774723512.571431, 'last_price_update_time': 1774723512.571444, 'auction_closing_time': 1774883455.0}
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE81625') HTTP/1.1" 204 0
2026-03-28 18:45:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_54d5ef28dce4fe878564902192c2111c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX82336/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW52708> (referer: https://www.auto1.com/v1/car-details-view/NW52708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC39619> (referer: https://www.auto1.com/v1/car-details-view/SC39619/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV10415> (referer: https://www.auto1.com/v1/car-details-view/KV10415/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT07537> (referer: https://www.auto1.com/v1/car-details-view/RT07537/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d2290>
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_7df6142563ab312dafaf95025b21173c.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_7df6142563ab312dafaf95025b21173c.jpg saved to cache
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2be2fc2b-ef65-598a-b337-31a15295c10d
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564ac050>
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_7ea73a6599eaa4fc4c68d80b6fe8ca89.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_7ea73a6599eaa4fc4c68d80b6fe8ca89.jpg saved to cache
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2be2fc2b-ef65-598a-b337-31a15295c10d
2026-03-28 18:45:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245648e650>
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_ad3e7239ad6a48a56a0ef147a751259b.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_ad3e7239ad6a48a56a0ef147a751259b.jpg saved to cache
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564d0710>
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_c966205b88f253b593294eeb970fed80.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_c966205b88f253b593294eeb970fed80.jpg saved to cache
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2be2fc2b-ef65-598a-b337-31a15295c10d
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a4090>
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_4112180d4128dac08532fd8bc8b5f254.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_4112180d4128dac08532fd8bc8b5f254.jpg saved to cache
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2be2fc2b-ef65-598a-b337-31a15295c10d
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245632e010>
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_54d5ef28dce4fe878564902192c2111c.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_54d5ef28dce4fe878564902192c2111c.jpg saved to cache
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2be2fc2b-ef65-598a-b337-31a15295c10d
2026-03-28 18:45:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdc5cc5d-f336-5200-b9c3-3919d5c08c8d with identifier: NW52708
2026-03-28 18:45:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdc5cc5d-f336-5200-b9c3-3919d5c08c8d with scrape type 1
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cdc5cc5d-f336-5200-b9c3-3919d5c08c8d
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F68%252F706851678b2c8bc8c64665a452211fc7%252Fpa%252FNW52708_ca00437216afdaae171bc8b1b6676466.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_ca00437216afdaae171bc8b1b6676466.jpg already downloaded
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F68%252F706851678b2c8bc8c64665a452211fc7%252Fpa%252FNW52708_5b4728cc43579be5b5a0d67c55d66dc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_5b4728cc43579be5b5a0d67c55d66dc9.jpg already downloaded
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F68%252F706851678b2c8bc8c64665a452211fc7%252Fpa%252FNW52708_bb531e3202afdf67312a27349d45d3c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_bb531e3202afdf67312a27349d45d3c0.jpg already downloaded
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F68%252F706851678b2c8bc8c64665a452211fc7%252Fpa%252FNW52708_782ecea71ec46b4e861fa7b06cfa87e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_782ecea71ec46b4e861fa7b06cfa87e9.jpg already downloaded
2026-03-28 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F68%252F706851678b2c8bc8c64665a452211fc7%252Fpa%252FNW52708_cf156fbc820a4e142440847953e7f073.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_cf156fbc820a4e142440847953e7f073.jpg already downloaded
2026-03-28 18:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdc5cc5d-f336-5200-b9c3-3919d5c08c8d, identifier: NW52708
2026-03-28 18:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc03520f-1607-53a6-a31c-008677adb290 with identifier: SC39619
2026-03-28 18:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc03520f-1607-53a6-a31c-008677adb290 with scrape type 1
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fc03520f-1607-53a6-a31c-008677adb290
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F9d%252F989de975c5ecd3111e46a12f64850f07%252Fpa%252FSC39619_2097cfb2bc80e72f9b9295e10cc737a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_2097cfb2bc80e72f9b9295e10cc737a5.jpg not downloaded yet
2026-03-28 18:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a54a8d50-57a9-5560-8e0b-7c12214f2c1f with identifier: KV10415
2026-03-28 18:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f with scrape type 1
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_5850184a81e9fb322c689d7fc2c12ea1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5850184a81e9fb322c689d7fc2c12ea1.jpg not downloaded yet
2026-03-28 18:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c33fb704-1fc2-55a4-9533-ce027dc4c6c8 with identifier: RT07537
2026-03-28 18:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8 with scrape type 1
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_6ad53d0c6f548a9c5a1fc5f82955b377.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_6ad53d0c6f548a9c5a1fc5f82955b377.jpg not downloaded yet
2026-03-28 18:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdc5cc5d-f336-5200-b9c3-3919d5c08c8d with identifier: NW52708
2026-03-28 18:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdc5cc5d-f336-5200-b9c3-3919d5c08c8d with identifier: NW52708
2026-03-28 18:45:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdc5cc5d-f336-5200-b9c3-3919d5c08c8d with identifier: NW52708 to the API
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NW52708>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:54:48Z',
 'fuel_type': 'petrol',
 'id': 'cdc5cc5d-f336-5200-b9c3-3919d5c08c8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW52708',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 157956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_ca00437216afdaae171bc8b1b6676466.jpg',
                'https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_5b4728cc43579be5b5a0d67c55d66dc9.jpg',
                'https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_bb531e3202afdf67312a27349d45d3c0.jpg',
                'https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_782ecea71ec46b4e861fa7b06cfa87e9.jpg',
                'https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_cf156fbc820a4e142440847953e7f073.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc5cc5d-f336-5200-b9c3-3919d5c08c8d/cdc5cc5d-f336-5200-b9c3-3919d5c08c8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_ca00437216afdaae171bc8b1b6676466.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc5cc5d-f336-5200-b9c3-3919d5c08c8d/cdc5cc5d-f336-5200-b9c3-3919d5c08c8d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_5b4728cc43579be5b5a0d67c55d66dc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc5cc5d-f336-5200-b9c3-3919d5c08c8d/cdc5cc5d-f336-5200-b9c3-3919d5c08c8d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_bb531e3202afdf67312a27349d45d3c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc5cc5d-f336-5200-b9c3-3919d5c08c8d/cdc5cc5d-f336-5200-b9c3-3919d5c08c8d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_782ecea71ec46b4e861fa7b06cfa87e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdc5cc5d-f336-5200-b9c3-3919d5c08c8d/cdc5cc5d-f336-5200-b9c3-3919d5c08c8d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/68/706851678b2c8bc8c64665a452211fc7/pa/NW52708_cf156fbc820a4e142440847953e7f073.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 Team 06',
 'transmission': 'manual',
 'trim': 'Team 06',
 'year': 2007}
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW52708%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [auto1.de] INFO: Saving data for NW52708: {'created_time': 1774723513.456677, 'last_price_update_time': 1774723513.456688, 'auction_closing_time': 1774886088.0}
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW52708') HTTP/1.1" 204 0
2026-03-28 18:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_86491ad6b0e0045a8cedf61cc88fbd7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F9d%252F989de975c5ecd3111e46a12f64850f07%252Fpa%252FSC39619_99ac7c685bbff340462cd7649283c9c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_99ac7c685bbff340462cd7649283c9c2.jpg not downloaded yet
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_56e2701068e8b191b70c22593062ed35.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_56e2701068e8b191b70c22593062ed35.jpg not downloaded yet
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_5234d18410c002ec3d421360fe236360.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_5234d18410c002ec3d421360fe236360.jpg not downloaded yet
2026-03-28 18:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_fd1b69c598e03619ce953bef5824a4a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_3d95d6c8b3c726568e4074ec19e37562.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F9d%252F989de975c5ecd3111e46a12f64850f07%252Fpa%252FSC39619_590b8356ddbe0c6769f695fc5cf859e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_590b8356ddbe0c6769f695fc5cf859e2.jpg not downloaded yet
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_5006d8a407a9d1826c79002ad340e446.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5006d8a407a9d1826c79002ad340e446.jpg not downloaded yet
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_eeea215a4c1c066db5b4d50a85561e24.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_eeea215a4c1c066db5b4d50a85561e24.jpg not downloaded yet
2026-03-28 18:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK29510> (referer: https://www.auto1.com/v1/car-details-view/FK29510/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F9d%252F989de975c5ecd3111e46a12f64850f07%252Fpa%252FSC39619_d5cce8205d35dc60a3a7a5c48492f0f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_d5cce8205d35dc60a3a7a5c48492f0f1.jpg not downloaded yet
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_1277c04bc2cce8191307bef6de58564f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_1277c04bc2cce8191307bef6de58564f.jpg not downloaded yet
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_d8280f0b0e3f0353e15ddf92e6b9a738.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_d8280f0b0e3f0353e15ddf92e6b9a738.jpg not downloaded yet
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F9d%252F989de975c5ecd3111e46a12f64850f07%252Fpa%252FSC39619_034f6b59ac18adb4ea2439ce66ebb8f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_034f6b59ac18adb4ea2439ce66ebb8f6.jpg not downloaded yet
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_4c1712b69a967eab3218550f438f986e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_4c1712b69a967eab3218550f438f986e.jpg not downloaded yet
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_fc2db4f6fb7407968e88595d38d5adc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_fc2db4f6fb7407968e88595d38d5adc2.jpg not downloaded yet
2026-03-28 18:45:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245640e250>
2026-03-28 18:45:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_86491ad6b0e0045a8cedf61cc88fbd7d.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_86491ad6b0e0045a8cedf61cc88fbd7d.jpg saved to cache
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e
2026-03-28 18:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_666ddfaecd8764b9094c68de4504f2f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_6ad53d0c6f548a9c5a1fc5f82955b377.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_2097cfb2bc80e72f9b9295e10cc737a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_837f9261eccd33715705bae16642e8ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_837f9261eccd33715705bae16642e8ef.jpg not downloaded yet
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_7f41ba831360f186cad1ff21217121d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_7f41ba831360f186cad1ff21217121d2.jpg not downloaded yet
2026-03-28 18:45:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245826d790>
2026-03-28 18:45:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F3c%252F0d3cb2b5472d8e09c9f7d2942d793367%252Fpa%252FPW03502_fd1b69c598e03619ce953bef5824a4a3.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_fd1b69c598e03619ce953bef5824a4a3.jpg saved to cache
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2be2fc2b-ef65-598a-b337-31a15295c10d
2026-03-28 18:45:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2be2fc2b-ef65-598a-b337-31a15295c10d, skipping ID generation
2026-03-28 18:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2be2fc2b-ef65-598a-b337-31a15295c10d with scrape type 1
2026-03-28 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2be2fc2b-ef65-598a-b337-31a15295c10d sending to next pipeline
2026-03-28 18:45:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2be2fc2b-ef65-598a-b337-31a15295c10d, identifier: PW03502
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456105bd0>
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_3d95d6c8b3c726568e4074ec19e37562.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_3d95d6c8b3c726568e4074ec19e37562.jpg saved to cache
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e
2026-03-28 18:45:14 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 6014 | hits on page: 40
2026-03-28 18:45:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c241f8d4-8b37-535c-9843-0f0efeb9d986 with identifier: FK29510
2026-03-28 18:45:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c241f8d4-8b37-535c-9843-0f0efeb9d986 with scrape type 1
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c241f8d4-8b37-535c-9843-0f0efeb9d986
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F13%252Ff0139b444fb9bcd2e320c2ed54528b8d%252Fpa%252FFK29510_1357cb6a3fa4e8ef625525c34e05bd99.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_1357cb6a3fa4e8ef625525c34e05bd99.jpg not downloaded yet
2026-03-28 18:45:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2be2fc2b-ef65-598a-b337-31a15295c10d with identifier: PW03502
2026-03-28 18:45:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2be2fc2b-ef65-598a-b337-31a15295c10d with identifier: PW03502
2026-03-28 18:45:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2be2fc2b-ef65-598a-b337-31a15295c10d with identifier: PW03502 to the API
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_fd1b69c598e03619ce953bef5824a4a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 299,
 'expiration_date': '2026-03-30T15:15:12Z',
 'fuel_type': 'diesel',
 'id': '2be2fc2b-ef65-598a-b337-31a15295c10d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW03502',
 'listing': 'auction',
 'location': 'DE',
 'make': 'BMW',
 'model': '7er',
 'odometer': 103729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_2b5f486da4ced6f0d8730cd0736f4585.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_1926e7099928f94a7112f96ecb37839f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_d8ec8f05f722213780b44f9e38bff9d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_67c3db8f76996efc3d3f6127c0255828.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_fd1b69c598e03619ce953bef5824a4a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_c966205b88f253b593294eeb970fed80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_54d5ef28dce4fe878564902192c2111c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_7ea73a6599eaa4fc4c68d80b6fe8ca89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_7df6142563ab312dafaf95025b21173c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be2fc2b-ef65-598a-b337-31a15295c10d/2be2fc2b-ef65-598a-b337-31a15295c10d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/3c/0d3cb2b5472d8e09c9f7d2942d793367/pa/PW03502_4112180d4128dac08532fd8bc8b5f254.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 7er 740d Mild-Hybrid xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2023}
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW03502%27 HTTP/1.1" 200 None
2026-03-28 18:45:14 [auto1.de] INFO: Saving data for PW03502: {'created_time': 1774723514.421453, 'last_price_update_time': 1774723514.421467, 'auction_closing_time': 1774883712.0}
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW03502') HTTP/1.1" 204 0
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_a544aada3e490f08fa6e305212057860.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_a544aada3e490f08fa6e305212057860.jpg not downloaded yet
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_bed9ea4088ba4646daa2071f5c1df580.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_bed9ea4088ba4646daa2071f5c1df580.jpg not downloaded yet
2026-03-28 18:45:14 [auto1.de] INFO: Found listing with ID: JE64211
2026-03-28 18:45:14 [auto1.de] INFO: Found listing with ID: FJ20192
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ20192%27 HTTP/1.1" 200 None
2026-03-28 18:45:14 [auto1.de] INFO: Scrape type for FJ20192: 0
2026-03-28 18:45:14 [auto1.de] INFO: Found listing with ID: ZV42561
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV42561%27 HTTP/1.1" 200 None
2026-03-28 18:45:14 [auto1.de] INFO: Scrape type for ZV42561: 1
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F13%252Ff0139b444fb9bcd2e320c2ed54528b8d%252Fpa%252FFK29510_50caffa48e0e1522a65ffa08f2b2192f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_50caffa48e0e1522a65ffa08f2b2192f.jpg not downloaded yet
2026-03-28 18:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD69831/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562f6a90>
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_666ddfaecd8764b9094c68de4504f2f3.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_666ddfaecd8764b9094c68de4504f2f3.jpg saved to cache
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456276810>
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_6ad53d0c6f548a9c5a1fc5f82955b377.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_6ad53d0c6f548a9c5a1fc5f82955b377.jpg saved to cache
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245476dcd0>
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc03520f-1607-53a6-a31c-008677adb290/fc03520f-1607-53a6-a31c-008677adb290_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F9d%252F989de975c5ecd3111e46a12f64850f07%252Fpa%252FSC39619_2097cfb2bc80e72f9b9295e10cc737a5.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_2097cfb2bc80e72f9b9295e10cc737a5.jpg saved to cache
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc03520f-1607-53a6-a31c-008677adb290
2026-03-28 18:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_eeea215a4c1c066db5b4d50a85561e24.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_f64b7c7330823b6f5c9f5122808f89c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_f64b7c7330823b6f5c9f5122808f89c8.jpg not downloaded yet
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_17370042642345e5a4a3be47e8e0afcc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_17370042642345e5a4a3be47e8e0afcc.jpg not downloaded yet
2026-03-28 18:45:14 [auto1.de] INFO: Found listing with ID: YZ24956
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ24956%27 HTTP/1.1" 200 None
2026-03-28 18:45:14 [auto1.de] INFO: Scrape type for YZ24956: 2
2026-03-28 18:45:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a95e2ab5-d8b9-5f01-b74f-434272ed5510 with identifier: YZ24956
2026-03-28 18:45:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a95e2ab5-d8b9-5f01-b74f-434272ed5510 with scrape type 2
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a95e2ab5-d8b9-5f01-b74f-434272ed5510 with scrape type 2
2026-03-28 18:45:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a95e2ab5-d8b9-5f01-b74f-434272ed5510, identifier: YZ24956
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F13%252Ff0139b444fb9bcd2e320c2ed54528b8d%252Fpa%252FFK29510_aebe9a42bc97d4b514ed70541711a93c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_aebe9a42bc97d4b514ed70541711a93c.jpg not downloaded yet
2026-03-28 18:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC98449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AZ23133> (referer: https://www.auto1.com/v1/car-details-view/AZ23133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT14776> (referer: https://www.auto1.com/v1/car-details-view/UT14776/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM12575> (referer: https://www.auto1.com/v1/car-details-view/LM12575/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_fc2db4f6fb7407968e88595d38d5adc2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a95e2ab5-d8b9-5f01-b74f-434272ed5510 with identifier: YZ24956
2026-03-28 18:45:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a95e2ab5-d8b9-5f01-b74f-434272ed5510 with identifier: YZ24956
2026-03-28 18:45:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a95e2ab5-d8b9-5f01-b74f-434272ed5510 with identifier: YZ24956 to the API
2026-03-28 18:45:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:30:47Z',
 'fuel_type': 'gas',
 'id': 'a95e2ab5-d8b9-5f01-b74f-434272ed5510',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ24956',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 26584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-22',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2022}
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ24956%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [auto1.de] INFO: Saving data for YZ24956: {'auction_closing_time': 1774884647.0, 'created_time': 1774034528.901724, 'last_price_update_time': 1774723515.233959}
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ24956') HTTP/1.1" 204 0
2026-03-28 18:45:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY94515> (referer: https://www.auto1.com/v1/car-details-view/GY94515/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_cc1929f9dcb252df83eb48ef95ff81c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_cc1929f9dcb252df83eb48ef95ff81c3.jpg not downloaded yet
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_715a0e40aab6f095a8cd939e58eda735.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_715a0e40aab6f095a8cd939e58eda735.jpg not downloaded yet
2026-03-28 18:45:15 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-28 18:45:15 [auto1.de] INFO: Found listing with ID: UM98970
2026-03-28 18:45:15 [auto1.de] INFO: Found listing with ID: PP81333
2026-03-28 18:45:15 [auto1.de] INFO: Found listing with ID: DG65550
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG65550%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [auto1.de] INFO: Scrape type for DG65550: 2
2026-03-28 18:45:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b1917fc-3c0f-58ff-be9e-ce284444534c with identifier: DG65550
2026-03-28 18:45:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b1917fc-3c0f-58ff-be9e-ce284444534c with scrape type 2
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b1917fc-3c0f-58ff-be9e-ce284444534c with scrape type 2
2026-03-28 18:45:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b1917fc-3c0f-58ff-be9e-ce284444534c, identifier: DG65550
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F13%252Ff0139b444fb9bcd2e320c2ed54528b8d%252Fpa%252FFK29510_1e38ab541a3ef7afa499c1c25983881f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_1e38ab541a3ef7afa499c1c25983881f.jpg not downloaded yet
2026-03-28 18:45:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b1917fc-3c0f-58ff-be9e-ce284444534c with identifier: DG65550
2026-03-28 18:45:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b1917fc-3c0f-58ff-be9e-ce284444534c with identifier: DG65550
2026-03-28 18:45:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b1917fc-3c0f-58ff-be9e-ce284444534c with identifier: DG65550 to the API
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:24:23Z',
 'fuel_type': 'petrol',
 'id': '5b1917fc-3c0f-58ff-be9e-ce284444534c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG65550',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 63779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG65550%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [auto1.de] INFO: Saving data for DG65550: {'auction_closing_time': 1774884263.0, 'created_time': 1774035523.480816, 'last_price_update_time': 1774723515.768706}
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG65550') HTTP/1.1" 204 0
2026-03-28 18:45:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_4c1712b69a967eab3218550f438f986e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_9a572ea36111b9cd3e7c8ae363016c30.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_9a572ea36111b9cd3e7c8ae363016c30.jpg not downloaded yet
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_a3754b0f9dd3fa42ed6bbdf31447393a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_a3754b0f9dd3fa42ed6bbdf31447393a.jpg not downloaded yet
2026-03-28 18:45:15 [auto1.de] INFO: Found listing with ID: SW06849
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW06849%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [auto1.de] INFO: Scrape type for SW06849: 1
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F13%252Ff0139b444fb9bcd2e320c2ed54528b8d%252Fpa%252FFK29510_2a794a65ba02c3d25cbdf958a1858664.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_2a794a65ba02c3d25cbdf958a1858664.jpg not downloaded yet
2026-03-28 18:45:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563c3c50>
2026-03-28 18:45:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_eeea215a4c1c066db5b4d50a85561e24.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_eeea215a4c1c066db5b4d50a85561e24.jpg saved to cache
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8
2026-03-28 18:45:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490cda3f-5eff-58c2-9d2c-334e28fbf634 with identifier: AZ23133
2026-03-28 18:45:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490cda3f-5eff-58c2-9d2c-334e28fbf634 with scrape type 1
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 490cda3f-5eff-58c2-9d2c-334e28fbf634
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa9%252Fdfa9b6d6182b381d54e6eeae9901d9b9%252Fpa%252FAZ23133_a663e69e53b1fbc16585bc1b79bc118f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_a663e69e53b1fbc16585bc1b79bc118f.jpg already downloaded
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa9%252Fdfa9b6d6182b381d54e6eeae9901d9b9%252Fpa%252FAZ23133_5d2897ee0f8f86620f48a613dae75f26.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_5d2897ee0f8f86620f48a613dae75f26.jpg already downloaded
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa9%252Fdfa9b6d6182b381d54e6eeae9901d9b9%252Fpa%252FAZ23133_635d7ee51c365831a015deb9e364ed85.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_635d7ee51c365831a015deb9e364ed85.jpg already downloaded
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa9%252Fdfa9b6d6182b381d54e6eeae9901d9b9%252Fpa%252FAZ23133_9b1acfe49b662e353f50adfdaeeaf7f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_9b1acfe49b662e353f50adfdaeeaf7f8.jpg already downloaded
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa9%252Fdfa9b6d6182b381d54e6eeae9901d9b9%252Fpa%252FAZ23133_9051d90a888069cc77f76a7c2bfee0dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_9051d90a888069cc77f76a7c2bfee0dd.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa9%252Fdfa9b6d6182b381d54e6eeae9901d9b9%252Fpa%252FAZ23133_954c2c82ba9d78155f637ceeccc17ab1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_954c2c82ba9d78155f637ceeccc17ab1.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa9%252Fdfa9b6d6182b381d54e6eeae9901d9b9%252Fpa%252FAZ23133_378672f33c720f8ded58c0fabc6bc99b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_378672f33c720f8ded58c0fabc6bc99b.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa9%252Fdfa9b6d6182b381d54e6eeae9901d9b9%252Fpa%252FAZ23133_a5d29fbd1f45361c7b89eb95599ebb9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_a5d29fbd1f45361c7b89eb95599ebb9f.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa9%252Fdfa9b6d6182b381d54e6eeae9901d9b9%252Fpa%252FAZ23133_2860b8119350e415b74468234fd0ef31.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_2860b8119350e415b74468234fd0ef31.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa9%252Fdfa9b6d6182b381d54e6eeae9901d9b9%252Fpa%252FAZ23133_e3c4da5a93dfd135c0b8443041161c86.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_e3c4da5a93dfd135c0b8443041161c86.jpg already downloaded
2026-03-28 18:45:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 490cda3f-5eff-58c2-9d2c-334e28fbf634, identifier: AZ23133
2026-03-28 18:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c with identifier: UT14776
2026-03-28 18:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c with scrape type 1
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F14%252Fd5140e2ddbc33548540110373f426178%252Fpa%252FUT14776_6003cb6761d5de4f984b46fd5d2cb2b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_6003cb6761d5de4f984b46fd5d2cb2b7.jpg not downloaded yet
2026-03-28 18:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 722f5647-615c-5667-9abd-4ffea2f2e371 with identifier: LM12575
2026-03-28 18:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 722f5647-615c-5667-9abd-4ffea2f2e371 with scrape type 1
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 722f5647-615c-5667-9abd-4ffea2f2e371
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_fc7fd69a9904699b44bbffe9a385b08f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_fc7fd69a9904699b44bbffe9a385b08f.jpg not downloaded yet
2026-03-28 18:45:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245642ea90>
2026-03-28 18:45:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_fc2db4f6fb7407968e88595d38d5adc2.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_fc2db4f6fb7407968e88595d38d5adc2.jpg saved to cache
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8
2026-03-28 18:45:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 490cda3f-5eff-58c2-9d2c-334e28fbf634 with identifier: AZ23133
2026-03-28 18:45:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 490cda3f-5eff-58c2-9d2c-334e28fbf634 with identifier: AZ23133
2026-03-28 18:45:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 490cda3f-5eff-58c2-9d2c-334e28fbf634 with identifier: AZ23133 to the API
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AZ23133>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:16:03Z',
 'fuel_type': 'petrol',
 'id': '490cda3f-5eff-58c2-9d2c-334e28fbf634',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ23133',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 34130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_a663e69e53b1fbc16585bc1b79bc118f.jpg',
                'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_5d2897ee0f8f86620f48a613dae75f26.jpg',
                'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_635d7ee51c365831a015deb9e364ed85.jpg',
                'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_9b1acfe49b662e353f50adfdaeeaf7f8.jpg',
                'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_9051d90a888069cc77f76a7c2bfee0dd.jpg',
                'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_954c2c82ba9d78155f637ceeccc17ab1.jpg',
                'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_378672f33c720f8ded58c0fabc6bc99b.jpg',
                'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_a5d29fbd1f45361c7b89eb95599ebb9f.jpg',
                'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_2860b8119350e415b74468234fd0ef31.jpg',
                'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_e3c4da5a93dfd135c0b8443041161c86.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490cda3f-5eff-58c2-9d2c-334e28fbf634/490cda3f-5eff-58c2-9d2c-334e28fbf634_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_a663e69e53b1fbc16585bc1b79bc118f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490cda3f-5eff-58c2-9d2c-334e28fbf634/490cda3f-5eff-58c2-9d2c-334e28fbf634_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_5d2897ee0f8f86620f48a613dae75f26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490cda3f-5eff-58c2-9d2c-334e28fbf634/490cda3f-5eff-58c2-9d2c-334e28fbf634_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_635d7ee51c365831a015deb9e364ed85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490cda3f-5eff-58c2-9d2c-334e28fbf634/490cda3f-5eff-58c2-9d2c-334e28fbf634_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_9b1acfe49b662e353f50adfdaeeaf7f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490cda3f-5eff-58c2-9d2c-334e28fbf634/490cda3f-5eff-58c2-9d2c-334e28fbf634_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_9051d90a888069cc77f76a7c2bfee0dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490cda3f-5eff-58c2-9d2c-334e28fbf634/490cda3f-5eff-58c2-9d2c-334e28fbf634_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_954c2c82ba9d78155f637ceeccc17ab1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490cda3f-5eff-58c2-9d2c-334e28fbf634/490cda3f-5eff-58c2-9d2c-334e28fbf634_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_378672f33c720f8ded58c0fabc6bc99b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490cda3f-5eff-58c2-9d2c-334e28fbf634/490cda3f-5eff-58c2-9d2c-334e28fbf634_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_a5d29fbd1f45361c7b89eb95599ebb9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490cda3f-5eff-58c2-9d2c-334e28fbf634/490cda3f-5eff-58c2-9d2c-334e28fbf634_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_2860b8119350e415b74468234fd0ef31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490cda3f-5eff-58c2-9d2c-334e28fbf634/490cda3f-5eff-58c2-9d2c-334e28fbf634_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a9/dfa9b6d6182b381d54e6eeae9901d9b9/pa/AZ23133_e3c4da5a93dfd135c0b8443041161c86.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.0 T-GDI Mild-Hybrid Select',
 'transmission': 'automatic',
 'trim': 'Select',
 'year': 2022}
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23133%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [auto1.de] INFO: Saving data for AZ23133: {'created_time': 1774723516.643974, 'last_price_update_time': 1774723516.643988, 'auction_closing_time': 1774883763.0}
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ23133') HTTP/1.1" 204 0
2026-03-28 18:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_034f6b59ac18adb4ea2439ce66ebb8f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:16 [auto1.de] INFO: Found listing with ID: GZ70356
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ70356%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [auto1.de] INFO: Scrape type for GZ70356: 1
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F14%252Fd5140e2ddbc33548540110373f426178%252Fpa%252FUT14776_54193bb9c5a1e4b9f321d8382379ae77.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_54193bb9c5a1e4b9f321d8382379ae77.jpg not downloaded yet
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_9c98912c9038a909f98b2c3f77bb96bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_9c98912c9038a909f98b2c3f77bb96bd.jpg not downloaded yet
2026-03-28 18:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64d17e0a-8633-59c7-a3cc-8c31edaed6ca with identifier: GY94515
2026-03-28 18:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64d17e0a-8633-59c7-a3cc-8c31edaed6ca with scrape type 1
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64d17e0a-8633-59c7-a3cc-8c31edaed6ca
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F24%252Ff7244cce95cdc0864e8cb1f7495c0c01%252Fpa%252FGY94515_a38fc08882c17116a3d8afd1adceec2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_a38fc08882c17116a3d8afd1adceec2e.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F24%252Ff7244cce95cdc0864e8cb1f7495c0c01%252Fpa%252FGY94515_6e3f0c001050e1fd6d3d09bf670598dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_6e3f0c001050e1fd6d3d09bf670598dd.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F24%252Ff7244cce95cdc0864e8cb1f7495c0c01%252Fpa%252FGY94515_796f9ef40d37e6ddc5d965a917f110d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_796f9ef40d37e6ddc5d965a917f110d5.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F24%252Ff7244cce95cdc0864e8cb1f7495c0c01%252Fpa%252FGY94515_fc09fbc0788de102a23338628222efd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_fc09fbc0788de102a23338628222efd5.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F24%252Ff7244cce95cdc0864e8cb1f7495c0c01%252Fpa%252FGY94515_c20fd38f060e517fb159b7e198f78f5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_c20fd38f060e517fb159b7e198f78f5c.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F24%252Ff7244cce95cdc0864e8cb1f7495c0c01%252Fpa%252FGY94515_8fc581eaffdee9d215c1fb38cce81843.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_8fc581eaffdee9d215c1fb38cce81843.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F24%252Ff7244cce95cdc0864e8cb1f7495c0c01%252Fpa%252FGY94515_9709a75a74ed7711ba766dabd809ea56.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_9709a75a74ed7711ba766dabd809ea56.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F24%252Ff7244cce95cdc0864e8cb1f7495c0c01%252Fpa%252FGY94515_8cd2daf299da32978e61088fec927a68.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_8cd2daf299da32978e61088fec927a68.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F24%252Ff7244cce95cdc0864e8cb1f7495c0c01%252Fpa%252FGY94515_4f2dfd572b72d21be671668c4c242099.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_4f2dfd572b72d21be671668c4c242099.jpg already downloaded
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F24%252Ff7244cce95cdc0864e8cb1f7495c0c01%252Fpa%252FGY94515_8d1b42a64c4ea7a519435641db92c36a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_8d1b42a64c4ea7a519435641db92c36a.jpg already downloaded
2026-03-28 18:45:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64d17e0a-8633-59c7-a3cc-8c31edaed6ca, identifier: GY94515
2026-03-28 18:45:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64d17e0a-8633-59c7-a3cc-8c31edaed6ca with identifier: GY94515
2026-03-28 18:45:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64d17e0a-8633-59c7-a3cc-8c31edaed6ca with identifier: GY94515
2026-03-28 18:45:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64d17e0a-8633-59c7-a3cc-8c31edaed6ca with identifier: GY94515 to the API
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GY94515>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:54Z',
 'fuel_type': 'petrol',
 'id': '64d17e0a-8633-59c7-a3cc-8c31edaed6ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY94515',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 59587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_a38fc08882c17116a3d8afd1adceec2e.jpg',
                'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_6e3f0c001050e1fd6d3d09bf670598dd.jpg',
                'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_796f9ef40d37e6ddc5d965a917f110d5.jpg',
                'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_fc09fbc0788de102a23338628222efd5.jpg',
                'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_c20fd38f060e517fb159b7e198f78f5c.jpg',
                'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_8fc581eaffdee9d215c1fb38cce81843.jpg',
                'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_9709a75a74ed7711ba766dabd809ea56.jpg',
                'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_8cd2daf299da32978e61088fec927a68.jpg',
                'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_4f2dfd572b72d21be671668c4c242099.jpg',
                'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_8d1b42a64c4ea7a519435641db92c36a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d17e0a-8633-59c7-a3cc-8c31edaed6ca/64d17e0a-8633-59c7-a3cc-8c31edaed6ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_a38fc08882c17116a3d8afd1adceec2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d17e0a-8633-59c7-a3cc-8c31edaed6ca/64d17e0a-8633-59c7-a3cc-8c31edaed6ca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_6e3f0c001050e1fd6d3d09bf670598dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d17e0a-8633-59c7-a3cc-8c31edaed6ca/64d17e0a-8633-59c7-a3cc-8c31edaed6ca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_796f9ef40d37e6ddc5d965a917f110d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d17e0a-8633-59c7-a3cc-8c31edaed6ca/64d17e0a-8633-59c7-a3cc-8c31edaed6ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_fc09fbc0788de102a23338628222efd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d17e0a-8633-59c7-a3cc-8c31edaed6ca/64d17e0a-8633-59c7-a3cc-8c31edaed6ca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_c20fd38f060e517fb159b7e198f78f5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d17e0a-8633-59c7-a3cc-8c31edaed6ca/64d17e0a-8633-59c7-a3cc-8c31edaed6ca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_8fc581eaffdee9d215c1fb38cce81843.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d17e0a-8633-59c7-a3cc-8c31edaed6ca/64d17e0a-8633-59c7-a3cc-8c31edaed6ca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_9709a75a74ed7711ba766dabd809ea56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d17e0a-8633-59c7-a3cc-8c31edaed6ca/64d17e0a-8633-59c7-a3cc-8c31edaed6ca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_8cd2daf299da32978e61088fec927a68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d17e0a-8633-59c7-a3cc-8c31edaed6ca/64d17e0a-8633-59c7-a3cc-8c31edaed6ca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_4f2dfd572b72d21be671668c4c242099.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64d17e0a-8633-59c7-a3cc-8c31edaed6ca/64d17e0a-8633-59c7-a3cc-8c31edaed6ca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/24/f7244cce95cdc0864e8cb1f7495c0c01/pa/GY94515_8d1b42a64c4ea7a519435641db92c36a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 35 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY94515%27 HTTP/1.1" 200 None
2026-03-28 18:45:17 [auto1.de] INFO: Saving data for GY94515: {'created_time': 1774723517.367865, 'last_price_update_time': 1774723517.367876, 'auction_closing_time': 1774883094.0}
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY94515') HTTP/1.1" 204 0
2026-03-28 18:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_50caffa48e0e1522a65ffa08f2b2192f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:17 [auto1.de] INFO: Found listing with ID: RS29828
2026-03-28 18:45:17 [auto1.de] INFO: Found listing with ID: WB65429
2026-03-28 18:45:17 [auto1.de] INFO: Found listing with ID: BV82977
2026-03-28 18:45:17 [auto1.de] INFO: Found listing with ID: XM98153
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM98153%27 HTTP/1.1" 200 None
2026-03-28 18:45:17 [auto1.de] INFO: Scrape type for XM98153: 2
2026-03-28 18:45:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dc3e0f0-76bf-5377-a863-0095d26634d1 with identifier: XM98153
2026-03-28 18:45:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dc3e0f0-76bf-5377-a863-0095d26634d1 with scrape type 2
2026-03-28 18:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dc3e0f0-76bf-5377-a863-0095d26634d1 with scrape type 2
2026-03-28 18:45:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dc3e0f0-76bf-5377-a863-0095d26634d1, identifier: XM98153
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F14%252Fd5140e2ddbc33548540110373f426178%252Fpa%252FUT14776_504c6dec1739ea031241f103c3629ce0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_504c6dec1739ea031241f103c3629ce0.jpg not downloaded yet
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_c5a81cb42745989a6b4aafa4cda7b30d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_c5a81cb42745989a6b4aafa4cda7b30d.jpg not downloaded yet
2026-03-28 18:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_bed9ea4088ba4646daa2071f5c1df580.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dc3e0f0-76bf-5377-a863-0095d26634d1 with identifier: XM98153
2026-03-28 18:45:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dc3e0f0-76bf-5377-a863-0095d26634d1 with identifier: XM98153
2026-03-28 18:45:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dc3e0f0-76bf-5377-a863-0095d26634d1 with identifier: XM98153 to the API
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:33Z',
 'fuel_type': 'diesel',
 'id': '4dc3e0f0-76bf-5377-a863-0095d26634d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM98153',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 109660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-04',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Business M',
 'transmission': 'manual',
 'trim': 'Business M',
 'year': 2017}
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM98153%27 HTTP/1.1" 200 None
2026-03-28 18:45:17 [auto1.de] INFO: Saving data for XM98153: {'auction_closing_time': 1774886073.0, 'created_time': 1773429542.875939, 'last_price_update_time': 1774723517.847947}
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM98153') HTTP/1.1" 204 0
2026-03-28 18:45:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477fc90>
2026-03-28 18:45:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_4c1712b69a967eab3218550f438f986e.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_4c1712b69a967eab3218550f438f986e.jpg saved to cache
2026-03-28 18:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-03-28 18:45:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456131b50>
2026-03-28 18:45:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc03520f-1607-53a6-a31c-008677adb290/fc03520f-1607-53a6-a31c-008677adb290_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F9d%252F989de975c5ecd3111e46a12f64850f07%252Fpa%252FSC39619_034f6b59ac18adb4ea2439ce66ebb8f6.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_034f6b59ac18adb4ea2439ce66ebb8f6.jpg saved to cache
2026-03-28 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc03520f-1607-53a6-a31c-008677adb290
2026-03-28 18:45:18 [auto1.de] INFO: Found listing with ID: ZV11386
2026-03-28 18:45:18 [auto1.de] INFO: Found listing with ID: TM97127
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM97127%27 HTTP/1.1" 200 None
2026-03-28 18:45:18 [auto1.de] INFO: Scrape type for TM97127: 2
2026-03-28 18:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f0cf49-8191-50e2-baae-e8bb3be7b93e with identifier: TM97127
2026-03-28 18:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f0cf49-8191-50e2-baae-e8bb3be7b93e with scrape type 2
2026-03-28 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4f0cf49-8191-50e2-baae-e8bb3be7b93e with scrape type 2
2026-03-28 18:45:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4f0cf49-8191-50e2-baae-e8bb3be7b93e, identifier: TM97127
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F14%252Fd5140e2ddbc33548540110373f426178%252Fpa%252FUT14776_9e9ebc7701013c7efe203bb27de3b0ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_9e9ebc7701013c7efe203bb27de3b0ea.jpg not downloaded yet
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_87daacca0276771f136af3a7f9898c25.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_87daacca0276771f136af3a7f9898c25.jpg not downloaded yet
2026-03-28 18:45:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4f0cf49-8191-50e2-baae-e8bb3be7b93e with identifier: TM97127
2026-03-28 18:45:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4f0cf49-8191-50e2-baae-e8bb3be7b93e with identifier: TM97127
2026-03-28 18:45:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4f0cf49-8191-50e2-baae-e8bb3be7b93e with identifier: TM97127 to the API
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:47:52Z',
 'fuel_type': 'petrol',
 'id': 'a4f0cf49-8191-50e2-baae-e8bb3be7b93e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM97127',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 160326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-08',
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2006}
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM97127%27 HTTP/1.1" 200 None
2026-03-28 18:45:18 [auto1.de] INFO: Saving data for TM97127: {'auction_closing_time': 1774885672.0, 'created_time': 1773400892.474072, 'last_price_update_time': 1774723518.559159}
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM97127') HTTP/1.1" 204 0
2026-03-28 18:45:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245482a850>
2026-03-28 18:45:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c241f8d4-8b37-535c-9843-0f0efeb9d986/c241f8d4-8b37-535c-9843-0f0efeb9d986_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F13%252Ff0139b444fb9bcd2e320c2ed54528b8d%252Fpa%252FFK29510_50caffa48e0e1522a65ffa08f2b2192f.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_50caffa48e0e1522a65ffa08f2b2192f.jpg saved to cache
2026-03-28 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c241f8d4-8b37-535c-9843-0f0efeb9d986
2026-03-28 18:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_a544aada3e490f08fa6e305212057860.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:18 [auto1.de] INFO: Found listing with ID: FW24707
2026-03-28 18:45:18 [auto1.de] INFO: Found listing with ID: ZB09378
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB09378%27 HTTP/1.1" 200 None
2026-03-28 18:45:18 [auto1.de] INFO: Scrape type for ZB09378: 1
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F14%252Fd5140e2ddbc33548540110373f426178%252Fpa%252FUT14776_9235a6315813d9d619ee7d7d32f072dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_9235a6315813d9d619ee7d7d32f072dc.jpg not downloaded yet
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_94bdfb3751eff0f29a3f76469e56a350.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_94bdfb3751eff0f29a3f76469e56a350.jpg not downloaded yet
2026-03-28 18:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV42561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245479e690>
2026-03-28 18:45:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_bed9ea4088ba4646daa2071f5c1df580.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_bed9ea4088ba4646daa2071f5c1df580.jpg saved to cache
2026-03-28 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8
2026-03-28 18:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_1357cb6a3fa4e8ef625525c34e05bd99.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:18 [auto1.de] INFO: Found listing with ID: NE29415
2026-03-28 18:45:18 [auto1.de] INFO: Found listing with ID: ES97586
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES97586%27 HTTP/1.1" 200 None
2026-03-28 18:45:18 [auto1.de] INFO: Scrape type for ES97586: 2
2026-03-28 18:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 112ccead-de1c-5e88-88a5-1016072e3bab with identifier: ES97586
2026-03-28 18:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 112ccead-de1c-5e88-88a5-1016072e3bab with scrape type 2
2026-03-28 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 112ccead-de1c-5e88-88a5-1016072e3bab with scrape type 2
2026-03-28 18:45:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 112ccead-de1c-5e88-88a5-1016072e3bab, identifier: ES97586
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_eea6efce765046bec8a1d1eb3be83b37.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_eea6efce765046bec8a1d1eb3be83b37.jpg not downloaded yet
2026-03-28 18:45:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 112ccead-de1c-5e88-88a5-1016072e3bab with identifier: ES97586
2026-03-28 18:45:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 112ccead-de1c-5e88-88a5-1016072e3bab with identifier: ES97586
2026-03-28 18:45:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 112ccead-de1c-5e88-88a5-1016072e3bab with identifier: ES97586 to the API
2026-03-28 18:45:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:04:58Z',
 'fuel_type': 'diesel',
 'id': '112ccead-de1c-5e88-88a5-1016072e3bab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES97586',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 135943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-16',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2015}
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES97586%27 HTTP/1.1" 200 None
2026-03-28 18:45:19 [auto1.de] INFO: Saving data for ES97586: {'auction_closing_time': 1774883098.0, 'created_time': 1774349950.111334, 'last_price_update_time': 1774723519.198023}
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES97586') HTTP/1.1" 204 0
2026-03-28 18:45:19 [auto1.de] INFO: Found listing with ID: LF31183
2026-03-28 18:45:19 [auto1.de] INFO: Found listing with ID: RU06209
2026-03-28 18:45:19 [auto1.de] INFO: Found listing with ID: MW27042
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW27042%27 HTTP/1.1" 200 None
2026-03-28 18:45:19 [auto1.de] INFO: Scrape type for MW27042: 1
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_a80500eb1b40e6d1b9ff083cafddccdb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_a80500eb1b40e6d1b9ff083cafddccdb.jpg not downloaded yet
2026-03-28 18:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_be0056646687e9330d80b2f0a564077f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_7f41ba831360f186cad1ff21217121d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD69831> (referer: https://www.auto1.com/v1/car-details-view/KD69831/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456287810>
2026-03-28 18:45:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_a544aada3e490f08fa6e305212057860.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_a544aada3e490f08fa6e305212057860.jpg saved to cache
2026-03-28 18:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-03-28 18:45:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454656d10>
2026-03-28 18:45:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c241f8d4-8b37-535c-9843-0f0efeb9d986/c241f8d4-8b37-535c-9843-0f0efeb9d986_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F13%252Ff0139b444fb9bcd2e320c2ed54528b8d%252Fpa%252FFK29510_1357cb6a3fa4e8ef625525c34e05bd99.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_1357cb6a3fa4e8ef625525c34e05bd99.jpg saved to cache
2026-03-28 18:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c241f8d4-8b37-535c-9843-0f0efeb9d986
2026-03-28 18:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_aebe9a42bc97d4b514ed70541711a93c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:19 [auto1.de] INFO: Found listing with ID: CN30644
2026-03-28 18:45:19 [auto1.de] INFO: Found listing with ID: VF79484
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF79484%27 HTTP/1.1" 200 None
2026-03-28 18:45:19 [auto1.de] INFO: Scrape type for VF79484: 2
2026-03-28 18:45:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f56f04d6-ee26-5e85-9c86-d4f783338dc4 with identifier: VF79484
2026-03-28 18:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f56f04d6-ee26-5e85-9c86-d4f783338dc4 with scrape type 2
2026-03-28 18:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f56f04d6-ee26-5e85-9c86-d4f783338dc4 with scrape type 2
2026-03-28 18:45:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f56f04d6-ee26-5e85-9c86-d4f783338dc4, identifier: VF79484
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_09a59be5beb6d4d4faa275e0fc5d4e75.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_09a59be5beb6d4d4faa275e0fc5d4e75.jpg not downloaded yet
2026-03-28 18:45:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f56f04d6-ee26-5e85-9c86-d4f783338dc4 with identifier: VF79484
2026-03-28 18:45:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f56f04d6-ee26-5e85-9c86-d4f783338dc4 with identifier: VF79484
2026-03-28 18:45:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f56f04d6-ee26-5e85-9c86-d4f783338dc4 with identifier: VF79484 to the API
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:05:46Z',
 'fuel_type': 'petrol',
 'id': 'f56f04d6-ee26-5e85-9c86-d4f783338dc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF79484',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Jimny',
 'odometer': 117114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-09-11',
 'seller_name': None,
 'title': 'Suzuki Jimny 1.3 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2002}
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF79484%27 HTTP/1.1" 200 None
2026-03-28 18:45:19 [auto1.de] INFO: Saving data for VF79484: {'auction_closing_time': 1774883146.0, 'created_time': 1774350051.613492, 'last_price_update_time': 1774723519.789852}
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF79484') HTTP/1.1" 204 0
2026-03-28 18:45:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_da89f206b8c716b453727114a8438ed3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:19 [auto1.de] INFO: Found listing with ID: PC42361
2026-03-28 18:45:19 [auto1.de] INFO: Found listing with ID: ZD03679
2026-03-28 18:45:19 [auto1.de] INFO: Found listing with ID: AJ68338
2026-03-28 18:45:19 [auto1.de] INFO: Found listing with ID: YS53721
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS53721%27 HTTP/1.1" 200 None
2026-03-28 18:45:19 [auto1.de] INFO: Scrape type for YS53721: 2
2026-03-28 18:45:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecb48922-a012-5054-a92f-b848665cc20a with identifier: YS53721
2026-03-28 18:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecb48922-a012-5054-a92f-b848665cc20a with scrape type 2
2026-03-28 18:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecb48922-a012-5054-a92f-b848665cc20a with scrape type 2
2026-03-28 18:45:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecb48922-a012-5054-a92f-b848665cc20a, identifier: YS53721
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_d763f39fe70674fc3f2131a8857236ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_d763f39fe70674fc3f2131a8857236ae.jpg not downloaded yet
2026-03-28 18:45:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecb48922-a012-5054-a92f-b848665cc20a with identifier: YS53721
2026-03-28 18:45:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecb48922-a012-5054-a92f-b848665cc20a with identifier: YS53721
2026-03-28 18:45:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecb48922-a012-5054-a92f-b848665cc20a with identifier: YS53721 to the API
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:18:23Z',
 'fuel_type': 'diesel',
 'id': 'ecb48922-a012-5054-a92f-b848665cc20a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS53721',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 256757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2015}
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS53721%27 HTTP/1.1" 200 None
2026-03-28 18:45:20 [auto1.de] INFO: Saving data for YS53721: {'auction_closing_time': 1774883903.0, 'created_time': 1774033778.500654, 'last_price_update_time': 1774723520.408843}
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS53721') HTTP/1.1" 204 0
2026-03-28 18:45:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_9c98912c9038a909f98b2c3f77bb96bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:20 [auto1.de] INFO: Found listing with ID: XY91311
2026-03-28 18:45:20 [auto1.de] INFO: Found listing with ID: NX07210
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX07210%27 HTTP/1.1" 200 None
2026-03-28 18:45:20 [auto1.de] INFO: Scrape type for NX07210: 1
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_3568fb67ca6dda9cedfac717b01814e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_3568fb67ca6dda9cedfac717b01814e4.jpg not downloaded yet
2026-03-28 18:45:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546a3850>
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_be0056646687e9330d80b2f0a564077f.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_be0056646687e9330d80b2f0a564077f.jpg saved to cache
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245627d4d0>
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_7f41ba831360f186cad1ff21217121d2.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_7f41ba831360f186cad1ff21217121d2.jpg saved to cache
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8
2026-03-28 18:45:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2afa2b31-3a15-567a-9846-ee6f74b02f7a with identifier: KD69831
2026-03-28 18:45:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2afa2b31-3a15-567a-9846-ee6f74b02f7a with scrape type 1
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2afa2b31-3a15-567a-9846-ee6f74b02f7a
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc2%252F31c29182ff2258c3e5d10370eb345360%252Fpa%252FKD69831_24bf52f0d2e72c4607ebc4e581de8b62.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_24bf52f0d2e72c4607ebc4e581de8b62.jpg not downloaded yet
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454687590>
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c241f8d4-8b37-535c-9843-0f0efeb9d986/c241f8d4-8b37-535c-9843-0f0efeb9d986_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F13%252Ff0139b444fb9bcd2e320c2ed54528b8d%252Fpa%252FFK29510_aebe9a42bc97d4b514ed70541711a93c.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_aebe9a42bc97d4b514ed70541711a93c.jpg saved to cache
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c241f8d4-8b37-535c-9843-0f0efeb9d986
2026-03-28 18:45:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_54193bb9c5a1e4b9f321d8382379ae77.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_a65fe639e17aec38aa5a81804d241b45.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:20 [auto1.de] INFO: Found listing with ID: UJ32060
2026-03-28 18:45:20 [auto1.de] INFO: Found listing with ID: LR70378
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR70378%27 HTTP/1.1" 200 None
2026-03-28 18:45:20 [auto1.de] INFO: Scrape type for LR70378: 1
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc2%252F31c29182ff2258c3e5d10370eb345360%252Fpa%252FKD69831_b3b80a597cc181a3405851bf663a532f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_b3b80a597cc181a3405851bf663a532f.jpg not downloaded yet
2026-03-28 18:45:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855eb50>
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F55%252Fe555ee7391e381e6608444e8d71b1163%252Fpa%252FWU29396_da89f206b8c716b453727114a8438ed3.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_da89f206b8c716b453727114a8438ed3.jpg saved to cache
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e
2026-03-28 18:45:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5193fb67-ff68-5bf9-aae2-de74f3b7460e, skipping ID generation
2026-03-28 18:45:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e with scrape type 1
2026-03-28 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e sending to next pipeline
2026-03-28 18:45:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5193fb67-ff68-5bf9-aae2-de74f3b7460e, identifier: WU29396
2026-03-28 18:45:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_5c8eb95149972e4f12029cc1d6d8296a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5193fb67-ff68-5bf9-aae2-de74f3b7460e with identifier: WU29396
2026-03-28 18:45:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5193fb67-ff68-5bf9-aae2-de74f3b7460e with identifier: WU29396
2026-03-28 18:45:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5193fb67-ff68-5bf9-aae2-de74f3b7460e with identifier: WU29396 to the API
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_da89f206b8c716b453727114a8438ed3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:41:19Z',
 'fuel_type': 'petrol',
 'id': '5193fb67-ff68-5bf9-aae2-de74f3b7460e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU29396',
 'listing': 'auction',
 'location': 'DE, Geldern',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 30962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2101417,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_da89f206b8c716b453727114a8438ed3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1945578,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_be0056646687e9330d80b2f0a564077f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_3d95d6c8b3c726568e4074ec19e37562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_86491ad6b0e0045a8cedf61cc88fbd7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2196518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_666ddfaecd8764b9094c68de4504f2f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2103620,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_ad3e7239ad6a48a56a0ef147a751259b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_91b95d64be12d107462f08a4ee838b33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_bfec48cc2ae6b249caa88918e4f11ec2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2059917,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_20f404c7699b7fc999c15c129179bd30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193fb67-ff68-5bf9-aae2-de74f3b7460e/5193fb67-ff68-5bf9-aae2-de74f3b7460e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2262710,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/55/e555ee7391e381e6608444e8d71b1163/pa/WU29396_4c613fbb4f2eeffe53e2c04a02cbe192.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cabrio Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU29396%27 HTTP/1.1" 200 None
2026-03-28 18:45:21 [auto1.de] INFO: Saving data for WU29396: {'created_time': 1774723521.378207, 'last_price_update_time': 1774723521.378218, 'auction_closing_time': 1774885279.0}
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU29396') HTTP/1.1" 204 0
2026-03-28 18:45:21 [auto1.de] INFO: Found listing with ID: VX51529
2026-03-28 18:45:21 [auto1.de] INFO: Found listing with ID: ZX35580
2026-03-28 18:45:21 [auto1.de] INFO: Found listing with ID: MB10012
2026-03-28 18:45:21 [auto1.de] INFO: Found listing with ID: JB16135
2026-03-28 18:45:21 [auto1.de] INFO: Found listing with ID: WX88880
2026-03-28 18:45:21 [auto1.de] INFO: Found listing with ID: VG60095
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG60095%27 HTTP/1.1" 200 None
2026-03-28 18:45:21 [auto1.de] INFO: Scrape type for VG60095: 2
2026-03-28 18:45:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fad2625-0521-53bd-bd3e-9dc3b5acfef4 with identifier: VG60095
2026-03-28 18:45:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fad2625-0521-53bd-bd3e-9dc3b5acfef4 with scrape type 2
2026-03-28 18:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fad2625-0521-53bd-bd3e-9dc3b5acfef4 with scrape type 2
2026-03-28 18:45:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fad2625-0521-53bd-bd3e-9dc3b5acfef4, identifier: VG60095
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc2%252F31c29182ff2258c3e5d10370eb345360%252Fpa%252FKD69831_50d780a2d51c111e977b07d7f35a70a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_50d780a2d51c111e977b07d7f35a70a5.jpg not downloaded yet
2026-03-28 18:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_94bdfb3751eff0f29a3f76469e56a350.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fad2625-0521-53bd-bd3e-9dc3b5acfef4 with identifier: VG60095
2026-03-28 18:45:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fad2625-0521-53bd-bd3e-9dc3b5acfef4 with identifier: VG60095
2026-03-28 18:45:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fad2625-0521-53bd-bd3e-9dc3b5acfef4 with identifier: VG60095 to the API
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 295,
 'expiration_date': '2026-03-30T15:31:37Z',
 'fuel_type': 'petrol',
 'id': '3fad2625-0521-53bd-bd3e-9dc3b5acfef4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG60095',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Boxster',
 'odometer': 137804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-14',
 'seller_name': None,
 'title': 'Porsche Boxster S',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG60095%27 HTTP/1.1" 200 None
2026-03-28 18:45:21 [auto1.de] INFO: Saving data for VG60095: {'auction_closing_time': 1774884697.0, 'created_time': 1774552871.505448, 'last_price_update_time': 1774723521.842921}
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG60095') HTTP/1.1" 204 0
2026-03-28 18:45:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564add90>
2026-03-28 18:45:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_9c98912c9038a909f98b2c3f77bb96bd.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_9c98912c9038a909f98b2c3f77bb96bd.jpg saved to cache
2026-03-28 18:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 722f5647-615c-5667-9abd-4ffea2f2e371
2026-03-28 18:45:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245463ed50>
2026-03-28 18:45:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c/18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F14%252Fd5140e2ddbc33548540110373f426178%252Fpa%252FUT14776_54193bb9c5a1e4b9f321d8382379ae77.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_54193bb9c5a1e4b9f321d8382379ae77.jpg saved to cache
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c
2026-03-28 18:45:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245469cfd0>
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_a65fe639e17aec38aa5a81804d241b45.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_a65fe639e17aec38aa5a81804d241b45.jpg saved to cache
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67fe3d5d-bcec-5da0-967d-974bce60c94a
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_9235a6315813d9d619ee7d7d32f072dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [auto1.de] INFO: Found listing with ID: AL99999
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc2%252F31c29182ff2258c3e5d10370eb345360%252Fpa%252FKD69831_620f9f657ba9441a83eb9fea5f0ca5f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_620f9f657ba9441a83eb9fea5f0ca5f5.jpg not downloaded yet
2026-03-28 18:45:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456304090>
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_5c8eb95149972e4f12029cc1d6d8296a.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_5c8eb95149972e4f12029cc1d6d8296a.jpg saved to cache
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67fe3d5d-bcec-5da0-967d-974bce60c94a
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc2%252F31c29182ff2258c3e5d10370eb345360%252Fpa%252FKD69831_b3d4f47835f3c2f3737f82a50ae74c90.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_b3d4f47835f3c2f3737f82a50ae74c90.jpg not downloaded yet
2026-03-28 18:45:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546678d0>
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_94bdfb3751eff0f29a3f76469e56a350.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_94bdfb3751eff0f29a3f76469e56a350.jpg saved to cache
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 722f5647-615c-5667-9abd-4ffea2f2e371
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456466810>
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c/18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F14%252Fd5140e2ddbc33548540110373f426178%252Fpa%252FUT14776_9235a6315813d9d619ee7d7d32f072dc.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_9235a6315813d9d619ee7d7d32f072dc.jpg saved to cache
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_09a59be5beb6d4d4faa275e0fc5d4e75.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5850184a81e9fb322c689d7fc2c12ea1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_d763f39fe70674fc3f2131a8857236ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_5234d18410c002ec3d421360fe236360.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_fc7fd69a9904699b44bbffe9a385b08f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_87daacca0276771f136af3a7f9898c25.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_a80500eb1b40e6d1b9ff083cafddccdb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_eea6efce765046bec8a1d1eb3be83b37.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_620f9f657ba9441a83eb9fea5f0ca5f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_b3b80a597cc181a3405851bf663a532f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_50d780a2d51c111e977b07d7f35a70a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_24bf52f0d2e72c4607ebc4e581de8b62.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_b3d4f47835f3c2f3737f82a50ae74c90.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454690410>
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_09a59be5beb6d4d4faa275e0fc5d4e75.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_09a59be5beb6d4d4faa275e0fc5d4e75.jpg saved to cache
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 722f5647-615c-5667-9abd-4ffea2f2e371
2026-03-28 18:45:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563dbb10>
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_5850184a81e9fb322c689d7fc2c12ea1.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5850184a81e9fb322c689d7fc2c12ea1.jpg saved to cache
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456212710>
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_d763f39fe70674fc3f2131a8857236ae.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_d763f39fe70674fc3f2131a8857236ae.jpg saved to cache
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 722f5647-615c-5667-9abd-4ffea2f2e371
2026-03-28 18:45:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454776c50>
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_5234d18410c002ec3d421360fe236360.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_5234d18410c002ec3d421360fe236360.jpg saved to cache
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8
2026-03-28 18:45:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245634c410>
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_fc7fd69a9904699b44bbffe9a385b08f.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_fc7fd69a9904699b44bbffe9a385b08f.jpg saved to cache
2026-03-28 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 722f5647-615c-5667-9abd-4ffea2f2e371
2026-03-28 18:45:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456377290>
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_87daacca0276771f136af3a7f9898c25.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_87daacca0276771f136af3a7f9898c25.jpg saved to cache
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 722f5647-615c-5667-9abd-4ffea2f2e371
2026-03-28 18:45:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245634eb50>
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_a80500eb1b40e6d1b9ff083cafddccdb.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_a80500eb1b40e6d1b9ff083cafddccdb.jpg saved to cache
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 722f5647-615c-5667-9abd-4ffea2f2e371
2026-03-28 18:45:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454779e90>
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_eea6efce765046bec8a1d1eb3be83b37.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_eea6efce765046bec8a1d1eb3be83b37.jpg saved to cache
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 722f5647-615c-5667-9abd-4ffea2f2e371
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245627ccd0>
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afa2b31-3a15-567a-9846-ee6f74b02f7a/2afa2b31-3a15-567a-9846-ee6f74b02f7a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc2%252F31c29182ff2258c3e5d10370eb345360%252Fpa%252FKD69831_620f9f657ba9441a83eb9fea5f0ca5f5.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_620f9f657ba9441a83eb9fea5f0ca5f5.jpg saved to cache
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2afa2b31-3a15-567a-9846-ee6f74b02f7a
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245634ded0>
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afa2b31-3a15-567a-9846-ee6f74b02f7a/2afa2b31-3a15-567a-9846-ee6f74b02f7a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc2%252F31c29182ff2258c3e5d10370eb345360%252Fpa%252FKD69831_b3b80a597cc181a3405851bf663a532f.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_b3b80a597cc181a3405851bf663a532f.jpg saved to cache
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2afa2b31-3a15-567a-9846-ee6f74b02f7a
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456375b10>
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afa2b31-3a15-567a-9846-ee6f74b02f7a/2afa2b31-3a15-567a-9846-ee6f74b02f7a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc2%252F31c29182ff2258c3e5d10370eb345360%252Fpa%252FKD69831_50d780a2d51c111e977b07d7f35a70a5.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_50d780a2d51c111e977b07d7f35a70a5.jpg saved to cache
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2afa2b31-3a15-567a-9846-ee6f74b02f7a
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458a91910>
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afa2b31-3a15-567a-9846-ee6f74b02f7a/2afa2b31-3a15-567a-9846-ee6f74b02f7a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc2%252F31c29182ff2258c3e5d10370eb345360%252Fpa%252FKD69831_24bf52f0d2e72c4607ebc4e581de8b62.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_24bf52f0d2e72c4607ebc4e581de8b62.jpg saved to cache
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2afa2b31-3a15-567a-9846-ee6f74b02f7a
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547763d0>
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afa2b31-3a15-567a-9846-ee6f74b02f7a/2afa2b31-3a15-567a-9846-ee6f74b02f7a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fc2%252F31c29182ff2258c3e5d10370eb345360%252Fpa%252FKD69831_b3d4f47835f3c2f3737f82a50ae74c90.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_b3d4f47835f3c2f3737f82a50ae74c90.jpg saved to cache
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2afa2b31-3a15-567a-9846-ee6f74b02f7a
2026-03-28 18:45:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2afa2b31-3a15-567a-9846-ee6f74b02f7a, skipping ID generation
2026-03-28 18:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2afa2b31-3a15-567a-9846-ee6f74b02f7a with scrape type 1
2026-03-28 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2afa2b31-3a15-567a-9846-ee6f74b02f7a sending to next pipeline
2026-03-28 18:45:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2afa2b31-3a15-567a-9846-ee6f74b02f7a, identifier: KD69831
2026-03-28 18:45:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2afa2b31-3a15-567a-9846-ee6f74b02f7a with identifier: KD69831
2026-03-28 18:45:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2afa2b31-3a15-567a-9846-ee6f74b02f7a with identifier: KD69831
2026-03-28 18:45:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2afa2b31-3a15-567a-9846-ee6f74b02f7a with identifier: KD69831 to the API
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_b3d4f47835f3c2f3737f82a50ae74c90.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:57:02Z',
 'fuel_type': 'petrol',
 'id': '2afa2b31-3a15-567a-9846-ee6f74b02f7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD69831',
 'listing': 'auction',
 'location': 'DE, Hamburg-Billstedt',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 284070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2afa2b31-3a15-567a-9846-ee6f74b02f7a/2afa2b31-3a15-567a-9846-ee6f74b02f7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_24bf52f0d2e72c4607ebc4e581de8b62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2afa2b31-3a15-567a-9846-ee6f74b02f7a/2afa2b31-3a15-567a-9846-ee6f74b02f7a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_b3b80a597cc181a3405851bf663a532f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2afa2b31-3a15-567a-9846-ee6f74b02f7a/2afa2b31-3a15-567a-9846-ee6f74b02f7a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_50d780a2d51c111e977b07d7f35a70a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2afa2b31-3a15-567a-9846-ee6f74b02f7a/2afa2b31-3a15-567a-9846-ee6f74b02f7a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_620f9f657ba9441a83eb9fea5f0ca5f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2afa2b31-3a15-567a-9846-ee6f74b02f7a/2afa2b31-3a15-567a-9846-ee6f74b02f7a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/c2/31c29182ff2258c3e5d10370eb345360/pa/KD69831_b3d4f47835f3c2f3737f82a50ae74c90.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 2.0 TFSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2005}
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD69831%27 HTTP/1.1" 200 None
2026-03-28 18:45:24 [auto1.de] INFO: Saving data for KD69831: {'created_time': 1774723524.0761, 'last_price_update_time': 1774723524.076116, 'auction_closing_time': 1774886222.0}
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD69831') HTTP/1.1" 204 0
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR70378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB09378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV42561> (referer: https://www.auto1.com/v1/car-details-view/ZV42561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_3568fb67ca6dda9cedfac717b01814e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_504c6dec1739ea031241f103c3629ce0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_6003cb6761d5de4f984b46fd5d2cb2b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_715a0e40aab6f095a8cd939e58eda735.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cf7cd61-6e60-586e-a88d-5f0d3707707f with identifier: ZV42561
2026-03-28 18:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cf7cd61-6e60-586e-a88d-5f0d3707707f with scrape type 1
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9cf7cd61-6e60-586e-a88d-5f0d3707707f
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fbe%252Fd1becbe2fa92cc3893999d8f5ec1732d%252Fpa%252FZV42561_57ab45d02bc911f9d8eb3f63f53d9aa3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_57ab45d02bc911f9d8eb3f63f53d9aa3.jpg not downloaded yet
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_1e38ab541a3ef7afa499c1c25983881f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_9e9ebc7701013c7efe203bb27de3b0ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_cc1929f9dcb252df83eb48ef95ff81c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fbe%252Fd1becbe2fa92cc3893999d8f5ec1732d%252Fpa%252FZV42561_3e59543ffa14abaefe206cd1447a0b16.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_3e59543ffa14abaefe206cd1447a0b16.jpg not downloaded yet
2026-03-28 18:45:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_2a794a65ba02c3d25cbdf958a1858664.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_17370042642345e5a4a3be47e8e0afcc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fbe%252Fd1becbe2fa92cc3893999d8f5ec1732d%252Fpa%252FZV42561_8b64546db21cd0cd6008f753be7c5b29.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_8b64546db21cd0cd6008f753be7c5b29.jpg not downloaded yet
2026-03-28 18:45:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454793090>
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_3568fb67ca6dda9cedfac717b01814e4.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_3568fb67ca6dda9cedfac717b01814e4.jpg saved to cache
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 722f5647-615c-5667-9abd-4ffea2f2e371
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fbe%252Fd1becbe2fa92cc3893999d8f5ec1732d%252Fpa%252FZV42561_0e37c2010349543ac0b773ce3290c493.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_0e37c2010349543ac0b773ce3290c493.jpg not downloaded yet
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456055490>
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c/18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F14%252Fd5140e2ddbc33548540110373f426178%252Fpa%252FUT14776_504c6dec1739ea031241f103c3629ce0.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_504c6dec1739ea031241f103c3629ce0.jpg saved to cache
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454693210>
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c/18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F14%252Fd5140e2ddbc33548540110373f426178%252Fpa%252FUT14776_6003cb6761d5de4f984b46fd5d2cb2b7.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_6003cb6761d5de4f984b46fd5d2cb2b7.jpg saved to cache
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_57ab45d02bc911f9d8eb3f63f53d9aa3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_1277c04bc2cce8191307bef6de58564f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fbe%252Fd1becbe2fa92cc3893999d8f5ec1732d%252Fpa%252FZV42561_04f172fce6e70d1f3ef05c432bb30759.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_04f172fce6e70d1f3ef05c432bb30759.jpg not downloaded yet
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454655b50>
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_715a0e40aab6f095a8cd939e58eda735.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_715a0e40aab6f095a8cd939e58eda735.jpg saved to cache
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564afcd0>
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c241f8d4-8b37-535c-9843-0f0efeb9d986/c241f8d4-8b37-535c-9843-0f0efeb9d986_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F13%252Ff0139b444fb9bcd2e320c2ed54528b8d%252Fpa%252FFK29510_1e38ab541a3ef7afa499c1c25983881f.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_1e38ab541a3ef7afa499c1c25983881f.jpg saved to cache
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c241f8d4-8b37-535c-9843-0f0efeb9d986
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d0950>
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c/18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F14%252Fd5140e2ddbc33548540110373f426178%252Fpa%252FUT14776_9e9ebc7701013c7efe203bb27de3b0ea.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_9e9ebc7701013c7efe203bb27de3b0ea.jpg saved to cache
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c
2026-03-28 18:45:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c, skipping ID generation
2026-03-28 18:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c with scrape type 1
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c sending to next pipeline
2026-03-28 18:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c, identifier: UT14776
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245479f0d0>
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_cc1929f9dcb252df83eb48ef95ff81c3.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_cc1929f9dcb252df83eb48ef95ff81c3.jpg saved to cache
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546565d0>
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c241f8d4-8b37-535c-9843-0f0efeb9d986/c241f8d4-8b37-535c-9843-0f0efeb9d986_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F13%252Ff0139b444fb9bcd2e320c2ed54528b8d%252Fpa%252FFK29510_2a794a65ba02c3d25cbdf958a1858664.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_2a794a65ba02c3d25cbdf958a1858664.jpg saved to cache
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c241f8d4-8b37-535c-9843-0f0efeb9d986
2026-03-28 18:45:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c241f8d4-8b37-535c-9843-0f0efeb9d986, skipping ID generation
2026-03-28 18:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c241f8d4-8b37-535c-9843-0f0efeb9d986 with scrape type 1
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c241f8d4-8b37-535c-9843-0f0efeb9d986 sending to next pipeline
2026-03-28 18:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c241f8d4-8b37-535c-9843-0f0efeb9d986, identifier: FK29510
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456241a10>
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_17370042642345e5a4a3be47e8e0afcc.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_17370042642345e5a4a3be47e8e0afcc.jpg saved to cache
2026-03-28 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8
2026-03-28 18:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c with identifier: UT14776
2026-03-28 18:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c with identifier: UT14776
2026-03-28 18:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c with identifier: UT14776 to the API
2026-03-28 18:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_9e9ebc7701013c7efe203bb27de3b0ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 261,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '3.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:29:05Z',
 'fuel_type': 'petrol',
 'id': '18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT14776',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'BMW',
 'model': '5er',
 'odometer': 253504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c/18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_6003cb6761d5de4f984b46fd5d2cb2b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c/18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_54193bb9c5a1e4b9f321d8382379ae77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c/18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_504c6dec1739ea031241f103c3629ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c/18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_9e9ebc7701013c7efe203bb27de3b0ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c/18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/14/d5140e2ddbc33548540110373f426178/pa/UT14776_9235a6315813d9d619ee7d7d32f072dc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2000}
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT14776%27 HTTP/1.1" 200 None
2026-03-28 18:45:26 [auto1.de] INFO: Saving data for UT14776: {'created_time': 1774723526.311893, 'last_price_update_time': 1774723526.311905, 'auction_closing_time': 1774884545.0}
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT14776') HTTP/1.1" 204 0
2026-03-28 18:45:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c241f8d4-8b37-535c-9843-0f0efeb9d986 with identifier: FK29510
2026-03-28 18:45:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c241f8d4-8b37-535c-9843-0f0efeb9d986 with identifier: FK29510
2026-03-28 18:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c241f8d4-8b37-535c-9843-0f0efeb9d986 with identifier: FK29510 to the API
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_2a794a65ba02c3d25cbdf958a1858664.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:58:08Z',
 'fuel_type': 'petrol',
 'id': 'c241f8d4-8b37-535c-9843-0f0efeb9d986',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK29510',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 81180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c241f8d4-8b37-535c-9843-0f0efeb9d986/c241f8d4-8b37-535c-9843-0f0efeb9d986_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_1357cb6a3fa4e8ef625525c34e05bd99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c241f8d4-8b37-535c-9843-0f0efeb9d986/c241f8d4-8b37-535c-9843-0f0efeb9d986_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_50caffa48e0e1522a65ffa08f2b2192f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c241f8d4-8b37-535c-9843-0f0efeb9d986/c241f8d4-8b37-535c-9843-0f0efeb9d986_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_aebe9a42bc97d4b514ed70541711a93c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c241f8d4-8b37-535c-9843-0f0efeb9d986/c241f8d4-8b37-535c-9843-0f0efeb9d986_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_1e38ab541a3ef7afa499c1c25983881f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c241f8d4-8b37-535c-9843-0f0efeb9d986/c241f8d4-8b37-535c-9843-0f0efeb9d986_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/13/f0139b444fb9bcd2e320c2ed54528b8d/pa/FK29510_2a794a65ba02c3d25cbdf958a1858664.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK29510%27 HTTP/1.1" 200 None
2026-03-28 18:45:26 [auto1.de] INFO: Saving data for FK29510: {'created_time': 1774723526.69701, 'last_price_update_time': 1774723526.69702, 'auction_closing_time': 1774886288.0}
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK29510') HTTP/1.1" 204 0
2026-03-28 18:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX07210/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456110890>
2026-03-28 18:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cf7cd61-6e60-586e-a88d-5f0d3707707f/9cf7cd61-6e60-586e-a88d-5f0d3707707f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fbe%252Fd1becbe2fa92cc3893999d8f5ec1732d%252Fpa%252FZV42561_57ab45d02bc911f9d8eb3f63f53d9aa3.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_57ab45d02bc911f9d8eb3f63f53d9aa3.jpg saved to cache
2026-03-28 18:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9cf7cd61-6e60-586e-a88d-5f0d3707707f
2026-03-28 18:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456131e50>
2026-03-28 18:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_1277c04bc2cce8191307bef6de58564f.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_1277c04bc2cce8191307bef6de58564f.jpg saved to cache
2026-03-28 18:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-03-28 18:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_8b64546db21cd0cd6008f753be7c5b29.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW27042/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC98449> (referer: https://www.auto1.com/v1/car-details-view/YC98449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ70356/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW06849/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_a3754b0f9dd3fa42ed6bbdf31447393a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_0e37c2010349543ac0b773ce3290c493.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456329050>
2026-03-28 18:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cf7cd61-6e60-586e-a88d-5f0d3707707f/9cf7cd61-6e60-586e-a88d-5f0d3707707f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fbe%252Fd1becbe2fa92cc3893999d8f5ec1732d%252Fpa%252FZV42561_8b64546db21cd0cd6008f753be7c5b29.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_8b64546db21cd0cd6008f753be7c5b29.jpg saved to cache
2026-03-28 18:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9cf7cd61-6e60-586e-a88d-5f0d3707707f
2026-03-28 18:45:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b473a1e2-87c0-5b4e-b02b-2bdcc161edc4 with identifier: YC98449
2026-03-28 18:45:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b473a1e2-87c0-5b4e-b02b-2bdcc161edc4 with scrape type 1
2026-03-28 18:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b473a1e2-87c0-5b4e-b02b-2bdcc161edc4
2026-03-28 18:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F2a%252Fd52ac97416f7d6d7ea549b35cc822ca2%252Fpa%252FYC98449_277d6084c6ba40591cd03954a0c505af.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_277d6084c6ba40591cd03954a0c505af.jpg not downloaded yet
2026-03-28 18:45:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547d1a10>
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_a3754b0f9dd3fa42ed6bbdf31447393a.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_a3754b0f9dd3fa42ed6bbdf31447393a.jpg saved to cache
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8
2026-03-28 18:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_c5a81cb42745989a6b4aafa4cda7b30d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_f64b7c7330823b6f5c9f5122808f89c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_9a572ea36111b9cd3e7c8ae363016c30.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_837f9261eccd33715705bae16642e8ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F2a%252Fd52ac97416f7d6d7ea549b35cc822ca2%252Fpa%252FYC98449_afe21fa5cb7d3c9aeda5575e32657425.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_afe21fa5cb7d3c9aeda5575e32657425.jpg not downloaded yet
2026-03-28 18:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_d8280f0b0e3f0353e15ddf92e6b9a738.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_04f172fce6e70d1f3ef05c432bb30759.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_3e59543ffa14abaefe206cd1447a0b16.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_d5cce8205d35dc60a3a7a5c48492f0f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F2a%252Fd52ac97416f7d6d7ea549b35cc822ca2%252Fpa%252FYC98449_7729ca1deb6cdc853fba1218767cabdc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_7729ca1deb6cdc853fba1218767cabdc.jpg not downloaded yet
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245610cd50>
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cf7cd61-6e60-586e-a88d-5f0d3707707f/9cf7cd61-6e60-586e-a88d-5f0d3707707f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fbe%252Fd1becbe2fa92cc3893999d8f5ec1732d%252Fpa%252FZV42561_0e37c2010349543ac0b773ce3290c493.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_0e37c2010349543ac0b773ce3290c493.jpg saved to cache
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9cf7cd61-6e60-586e-a88d-5f0d3707707f
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F2a%252Fd52ac97416f7d6d7ea549b35cc822ca2%252Fpa%252FYC98449_058d3773e5093a40edebe59a82bf7106.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_058d3773e5093a40edebe59a82bf7106.jpg not downloaded yet
2026-03-28 18:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_590b8356ddbe0c6769f695fc5cf859e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5006d8a407a9d1826c79002ad340e446.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F2a%252Fd52ac97416f7d6d7ea549b35cc822ca2%252Fpa%252FYC98449_70bc3235be262b791941ed2148ebc1a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_70bc3235be262b791941ed2148ebc1a6.jpg not downloaded yet
2026-03-28 18:45:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456110310>
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F15%252F89155233a490792708ff6925e944ded9%252Fpa%252FLM12575_c5a81cb42745989a6b4aafa4cda7b30d.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_c5a81cb42745989a6b4aafa4cda7b30d.jpg saved to cache
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 722f5647-615c-5667-9abd-4ffea2f2e371
2026-03-28 18:45:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 722f5647-615c-5667-9abd-4ffea2f2e371, skipping ID generation
2026-03-28 18:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 722f5647-615c-5667-9abd-4ffea2f2e371 with scrape type 1
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 722f5647-615c-5667-9abd-4ffea2f2e371 sending to next pipeline
2026-03-28 18:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 722f5647-615c-5667-9abd-4ffea2f2e371, identifier: LM12575
2026-03-28 18:45:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456096590>
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_f64b7c7330823b6f5c9f5122808f89c8.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_f64b7c7330823b6f5c9f5122808f89c8.jpg saved to cache
2026-03-28 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-03-28 18:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_99ac7c685bbff340462cd7649283c9c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 722f5647-615c-5667-9abd-4ffea2f2e371 with identifier: LM12575
2026-03-28 18:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 722f5647-615c-5667-9abd-4ffea2f2e371 with identifier: LM12575
2026-03-28 18:45:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 722f5647-615c-5667-9abd-4ffea2f2e371 with identifier: LM12575 to the API
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_c5a81cb42745989a6b4aafa4cda7b30d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:43:51Z',
 'fuel_type': 'petrol',
 'id': '722f5647-615c-5667-9abd-4ffea2f2e371',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM12575',
 'listing': 'auction',
 'location': 'DE, Göppingen',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 72870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2928998,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_fc7fd69a9904699b44bbffe9a385b08f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_9c98912c9038a909f98b2c3f77bb96bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3075172,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_c5a81cb42745989a6b4aafa4cda7b30d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2983827,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_87daacca0276771f136af3a7f9898c25.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_94bdfb3751eff0f29a3f76469e56a350.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2879210,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_eea6efce765046bec8a1d1eb3be83b37.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2809703,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_a80500eb1b40e6d1b9ff083cafddccdb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_09a59be5beb6d4d4faa275e0fc5d4e75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_d763f39fe70674fc3f2131a8857236ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722f5647-615c-5667-9abd-4ffea2f2e371/722f5647-615c-5667-9abd-4ffea2f2e371_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3198414,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/15/89155233a490792708ff6925e944ded9/pa/LM12575_3568fb67ca6dda9cedfac717b01814e4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Waze',
 'transmission': 'manual',
 'trim': 'Waze',
 'year': 2018}
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM12575%27 HTTP/1.1" 200 None
2026-03-28 18:45:27 [auto1.de] INFO: Saving data for LM12575: {'created_time': 1774723527.962249, 'last_price_update_time': 1774723527.962262, 'auction_closing_time': 1774885431.0}
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM12575') HTTP/1.1" 204 0
2026-03-28 18:45:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456341950>
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_9a572ea36111b9cd3e7c8ae363016c30.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_9a572ea36111b9cd3e7c8ae363016c30.jpg saved to cache
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-03-28 18:45:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547a0150>
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_837f9261eccd33715705bae16642e8ef.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_837f9261eccd33715705bae16642e8ef.jpg saved to cache
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-03-28 18:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB09378> (referer: https://www.auto1.com/v1/car-details-view/ZB09378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR70378> (referer: https://www.auto1.com/v1/car-details-view/LR70378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454661c90>
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad9a6dd73bdf40d8c399c2a87e49f1%252Fpa%252FRT07537_d8280f0b0e3f0353e15ddf92e6b9a738.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_d8280f0b0e3f0353e15ddf92e6b9a738.jpg saved to cache
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8
2026-03-28 18:45:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c33fb704-1fc2-55a4-9533-ce027dc4c6c8, skipping ID generation
2026-03-28 18:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8 with scrape type 1
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8 sending to next pipeline
2026-03-28 18:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c33fb704-1fc2-55a4-9533-ce027dc4c6c8, identifier: RT07537
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454662dd0>
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cf7cd61-6e60-586e-a88d-5f0d3707707f/9cf7cd61-6e60-586e-a88d-5f0d3707707f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fbe%252Fd1becbe2fa92cc3893999d8f5ec1732d%252Fpa%252FZV42561_04f172fce6e70d1f3ef05c432bb30759.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_04f172fce6e70d1f3ef05c432bb30759.jpg saved to cache
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9cf7cd61-6e60-586e-a88d-5f0d3707707f
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456293850>
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cf7cd61-6e60-586e-a88d-5f0d3707707f/9cf7cd61-6e60-586e-a88d-5f0d3707707f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fbe%252Fd1becbe2fa92cc3893999d8f5ec1732d%252Fpa%252FZV42561_3e59543ffa14abaefe206cd1447a0b16.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_3e59543ffa14abaefe206cd1447a0b16.jpg saved to cache
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9cf7cd61-6e60-586e-a88d-5f0d3707707f
2026-03-28 18:45:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9cf7cd61-6e60-586e-a88d-5f0d3707707f, skipping ID generation
2026-03-28 18:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cf7cd61-6e60-586e-a88d-5f0d3707707f with scrape type 1
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9cf7cd61-6e60-586e-a88d-5f0d3707707f sending to next pipeline
2026-03-28 18:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9cf7cd61-6e60-586e-a88d-5f0d3707707f, identifier: ZV42561
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456305190>
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc03520f-1607-53a6-a31c-008677adb290/fc03520f-1607-53a6-a31c-008677adb290_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F9d%252F989de975c5ecd3111e46a12f64850f07%252Fpa%252FSC39619_d5cce8205d35dc60a3a7a5c48492f0f1.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_d5cce8205d35dc60a3a7a5c48492f0f1.jpg saved to cache
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc03520f-1607-53a6-a31c-008677adb290
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245640fb90>
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc03520f-1607-53a6-a31c-008677adb290/fc03520f-1607-53a6-a31c-008677adb290_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F9d%252F989de975c5ecd3111e46a12f64850f07%252Fpa%252FSC39619_590b8356ddbe0c6769f695fc5cf859e2.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_590b8356ddbe0c6769f695fc5cf859e2.jpg saved to cache
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc03520f-1607-53a6-a31c-008677adb290
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245627db50>
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_5006d8a407a9d1826c79002ad340e446.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5006d8a407a9d1826c79002ad340e446.jpg saved to cache
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564d11d0>
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc03520f-1607-53a6-a31c-008677adb290/fc03520f-1607-53a6-a31c-008677adb290_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F9d%252F989de975c5ecd3111e46a12f64850f07%252Fpa%252FSC39619_99ac7c685bbff340462cd7649283c9c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_99ac7c685bbff340462cd7649283c9c2.jpg saved to cache
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc03520f-1607-53a6-a31c-008677adb290
2026-03-28 18:45:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc03520f-1607-53a6-a31c-008677adb290, skipping ID generation
2026-03-28 18:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc03520f-1607-53a6-a31c-008677adb290 with scrape type 1
2026-03-28 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc03520f-1607-53a6-a31c-008677adb290 sending to next pipeline
2026-03-28 18:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc03520f-1607-53a6-a31c-008677adb290, identifier: SC39619
2026-03-28 18:45:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c33fb704-1fc2-55a4-9533-ce027dc4c6c8 with identifier: RT07537
2026-03-28 18:45:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c33fb704-1fc2-55a4-9533-ce027dc4c6c8 with identifier: RT07537
2026-03-28 18:45:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c33fb704-1fc2-55a4-9533-ce027dc4c6c8 with identifier: RT07537 to the API
2026-03-28 18:45:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_d8280f0b0e3f0353e15ddf92e6b9a738.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:24:00Z',
 'fuel_type': 'petrol',
 'id': 'c33fb704-1fc2-55a4-9533-ce027dc4c6c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT07537',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 18429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_6ad53d0c6f548a9c5a1fc5f82955b377.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3088530,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_5234d18410c002ec3d421360fe236360.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_eeea215a4c1c066db5b4d50a85561e24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2858016,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_d8280f0b0e3f0353e15ddf92e6b9a738.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_fc2db4f6fb7407968e88595d38d5adc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_7f41ba831360f186cad1ff21217121d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_bed9ea4088ba4646daa2071f5c1df580.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_17370042642345e5a4a3be47e8e0afcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_715a0e40aab6f095a8cd939e58eda735.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c33fb704-1fc2-55a4-9533-ce027dc4c6c8/c33fb704-1fc2-55a4-9533-ce027dc4c6c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3108592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad9a6dd73bdf40d8c399c2a87e49f1/pa/RT07537_a3754b0f9dd3fa42ed6bbdf31447393a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2022}
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT07537%27 HTTP/1.1" 200 None
2026-03-28 18:45:30 [auto1.de] INFO: Saving data for RT07537: {'created_time': 1774723530.132577, 'last_price_update_time': 1774723530.132587, 'auction_closing_time': 1774884240.0}
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT07537') HTTP/1.1" 204 0
2026-03-28 18:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9cf7cd61-6e60-586e-a88d-5f0d3707707f with identifier: ZV42561
2026-03-28 18:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9cf7cd61-6e60-586e-a88d-5f0d3707707f with identifier: ZV42561
2026-03-28 18:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9cf7cd61-6e60-586e-a88d-5f0d3707707f with identifier: ZV42561 to the API
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_3e59543ffa14abaefe206cd1447a0b16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:20:28Z',
 'fuel_type': 'petrol',
 'id': '9cf7cd61-6e60-586e-a88d-5f0d3707707f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV42561',
 'listing': 'auction',
 'location': 'DE, Donaueschingen',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 147751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cf7cd61-6e60-586e-a88d-5f0d3707707f/9cf7cd61-6e60-586e-a88d-5f0d3707707f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_57ab45d02bc911f9d8eb3f63f53d9aa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cf7cd61-6e60-586e-a88d-5f0d3707707f/9cf7cd61-6e60-586e-a88d-5f0d3707707f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_3e59543ffa14abaefe206cd1447a0b16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cf7cd61-6e60-586e-a88d-5f0d3707707f/9cf7cd61-6e60-586e-a88d-5f0d3707707f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_8b64546db21cd0cd6008f753be7c5b29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cf7cd61-6e60-586e-a88d-5f0d3707707f/9cf7cd61-6e60-586e-a88d-5f0d3707707f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_0e37c2010349543ac0b773ce3290c493.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cf7cd61-6e60-586e-a88d-5f0d3707707f/9cf7cd61-6e60-586e-a88d-5f0d3707707f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/be/d1becbe2fa92cc3893999d8f5ec1732d/pa/ZV42561_04f172fce6e70d1f3ef05c432bb30759.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2007}
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV42561%27 HTTP/1.1" 200 None
2026-03-28 18:45:30 [auto1.de] INFO: Saving data for ZV42561: {'created_time': 1774723530.501443, 'last_price_update_time': 1774723530.501455, 'auction_closing_time': 1774884028.0}
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV42561') HTTP/1.1" 204 0
2026-03-28 18:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc03520f-1607-53a6-a31c-008677adb290 with identifier: SC39619
2026-03-28 18:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc03520f-1607-53a6-a31c-008677adb290 with identifier: SC39619
2026-03-28 18:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc03520f-1607-53a6-a31c-008677adb290 with identifier: SC39619 to the API
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_99ac7c685bbff340462cd7649283c9c2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:37:15Z',
 'fuel_type': 'petrol',
 'id': 'fc03520f-1607-53a6-a31c-008677adb290',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC39619',
 'listing': 'auction',
 'location': 'DE, Singen',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 172638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc03520f-1607-53a6-a31c-008677adb290/fc03520f-1607-53a6-a31c-008677adb290_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_2097cfb2bc80e72f9b9295e10cc737a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc03520f-1607-53a6-a31c-008677adb290/fc03520f-1607-53a6-a31c-008677adb290_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_99ac7c685bbff340462cd7649283c9c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc03520f-1607-53a6-a31c-008677adb290/fc03520f-1607-53a6-a31c-008677adb290_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_590b8356ddbe0c6769f695fc5cf859e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc03520f-1607-53a6-a31c-008677adb290/fc03520f-1607-53a6-a31c-008677adb290_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_d5cce8205d35dc60a3a7a5c48492f0f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc03520f-1607-53a6-a31c-008677adb290/fc03520f-1607-53a6-a31c-008677adb290_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/9d/989de975c5ecd3111e46a12f64850f07/pa/SC39619_034f6b59ac18adb4ea2439ce66ebb8f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC39619%27 HTTP/1.1" 200 None
2026-03-28 18:45:30 [auto1.de] INFO: Saving data for SC39619: {'created_time': 1774723530.872395, 'last_price_update_time': 1774723530.872407, 'auction_closing_time': 1774885035.0}
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC39619') HTTP/1.1" 204 0
2026-03-28 18:45:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX07210> (referer: https://www.auto1.com/v1/car-details-view/NX07210/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99765fec-567f-56f4-8f1d-a2ea5e2c6c72 with identifier: ZB09378
2026-03-28 18:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72 with scrape type 1
2026-03-28 18:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_79743332c66b4d8d05466a61fb822f14.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_79743332c66b4d8d05466a61fb822f14.jpg not downloaded yet
2026-03-28 18:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e09ba225-9cf8-5545-a095-84e7df17ffc9 with identifier: LR70378
2026-03-28 18:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e09ba225-9cf8-5545-a095-84e7df17ffc9 with scrape type 1
2026-03-28 18:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e09ba225-9cf8-5545-a095-84e7df17ffc9
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F95%252F5f95b1a5717f63f4e7e9c349bd384455%252Fpa%252FLR70378_d20ccc6d2e8e6a9fa22d6c99071da364.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_d20ccc6d2e8e6a9fa22d6c99071da364.jpg already downloaded
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F95%252F5f95b1a5717f63f4e7e9c349bd384455%252Fpa%252FLR70378_5cedc62c83eafac386f33eec29efc33f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_5cedc62c83eafac386f33eec29efc33f.jpg already downloaded
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F95%252F5f95b1a5717f63f4e7e9c349bd384455%252Fpa%252FLR70378_119ef5920120d3e679d61970add3dc43.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_119ef5920120d3e679d61970add3dc43.jpg already downloaded
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F95%252F5f95b1a5717f63f4e7e9c349bd384455%252Fpa%252FLR70378_87a1fa3be697adc813a4dc6be2354e4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_87a1fa3be697adc813a4dc6be2354e4d.jpg already downloaded
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F95%252F5f95b1a5717f63f4e7e9c349bd384455%252Fpa%252FLR70378_52d4e038833e715edd1510b19024e9b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_52d4e038833e715edd1510b19024e9b7.jpg already downloaded
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F95%252F5f95b1a5717f63f4e7e9c349bd384455%252Fpa%252FLR70378_b5c23bb4a5b45ffc508ed7e91ea00e53.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_b5c23bb4a5b45ffc508ed7e91ea00e53.jpg already downloaded
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F95%252F5f95b1a5717f63f4e7e9c349bd384455%252Fpa%252FLR70378_28070714693adf5c06a1862958ed8de3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_28070714693adf5c06a1862958ed8de3.jpg already downloaded
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F95%252F5f95b1a5717f63f4e7e9c349bd384455%252Fpa%252FLR70378_3abb0ca36e1189a5a35e7883808695c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_3abb0ca36e1189a5a35e7883808695c7.jpg already downloaded
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F95%252F5f95b1a5717f63f4e7e9c349bd384455%252Fpa%252FLR70378_2347e967a843bcb1d2986f673c10c1fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_2347e967a843bcb1d2986f673c10c1fd.jpg already downloaded
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F95%252F5f95b1a5717f63f4e7e9c349bd384455%252Fpa%252FLR70378_aa07c315982ef561f3d54b42e271e1da.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_aa07c315982ef561f3d54b42e271e1da.jpg already downloaded
2026-03-28 18:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e09ba225-9cf8-5545-a095-84e7df17ffc9, identifier: LR70378
2026-03-28 18:45:31 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 6014 | hits on page: 40
2026-03-28 18:45:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e09ba225-9cf8-5545-a095-84e7df17ffc9 with identifier: LR70378
2026-03-28 18:45:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e09ba225-9cf8-5545-a095-84e7df17ffc9 with identifier: LR70378
2026-03-28 18:45:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e09ba225-9cf8-5545-a095-84e7df17ffc9 with identifier: LR70378 to the API
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LR70378>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:51:03Z',
 'fuel_type': 'diesel',
 'id': 'e09ba225-9cf8-5545-a095-84e7df17ffc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR70378',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Nissan',
 'model': 'NP300 Pick-up',
 'odometer': 25301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_d20ccc6d2e8e6a9fa22d6c99071da364.jpg',
                'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_5cedc62c83eafac386f33eec29efc33f.jpg',
                'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_119ef5920120d3e679d61970add3dc43.jpg',
                'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_87a1fa3be697adc813a4dc6be2354e4d.jpg',
                'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_52d4e038833e715edd1510b19024e9b7.jpg',
                'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_b5c23bb4a5b45ffc508ed7e91ea00e53.jpg',
                'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_28070714693adf5c06a1862958ed8de3.jpg',
                'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_3abb0ca36e1189a5a35e7883808695c7.jpg',
                'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_2347e967a843bcb1d2986f673c10c1fd.jpg',
                'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_aa07c315982ef561f3d54b42e271e1da.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09ba225-9cf8-5545-a095-84e7df17ffc9/e09ba225-9cf8-5545-a095-84e7df17ffc9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3036224,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_d20ccc6d2e8e6a9fa22d6c99071da364.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09ba225-9cf8-5545-a095-84e7df17ffc9/e09ba225-9cf8-5545-a095-84e7df17ffc9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_5cedc62c83eafac386f33eec29efc33f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09ba225-9cf8-5545-a095-84e7df17ffc9/e09ba225-9cf8-5545-a095-84e7df17ffc9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2763113,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_119ef5920120d3e679d61970add3dc43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09ba225-9cf8-5545-a095-84e7df17ffc9/e09ba225-9cf8-5545-a095-84e7df17ffc9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2720532,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_87a1fa3be697adc813a4dc6be2354e4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09ba225-9cf8-5545-a095-84e7df17ffc9/e09ba225-9cf8-5545-a095-84e7df17ffc9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3008447,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_52d4e038833e715edd1510b19024e9b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09ba225-9cf8-5545-a095-84e7df17ffc9/e09ba225-9cf8-5545-a095-84e7df17ffc9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2694454,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_b5c23bb4a5b45ffc508ed7e91ea00e53.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09ba225-9cf8-5545-a095-84e7df17ffc9/e09ba225-9cf8-5545-a095-84e7df17ffc9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_28070714693adf5c06a1862958ed8de3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09ba225-9cf8-5545-a095-84e7df17ffc9/e09ba225-9cf8-5545-a095-84e7df17ffc9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2778806,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_3abb0ca36e1189a5a35e7883808695c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09ba225-9cf8-5545-a095-84e7df17ffc9/e09ba225-9cf8-5545-a095-84e7df17ffc9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3012265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_2347e967a843bcb1d2986f673c10c1fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09ba225-9cf8-5545-a095-84e7df17ffc9/e09ba225-9cf8-5545-a095-84e7df17ffc9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3174987,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/95/5f95b1a5717f63f4e7e9c349bd384455/pa/LR70378_aa07c315982ef561f3d54b42e271e1da.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Nissan NP300 Pick-up 2.3 dCi Acenta King Cab 4x4',
 'transmission': 'manual',
 'trim': 'Acenta King Cab 4x4',
 'year': 2019}
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR70378%27 HTTP/1.1" 200 None
2026-03-28 18:45:31 [auto1.de] INFO: Saving data for LR70378: {'created_time': 1774723531.863706, 'last_price_update_time': 1774723531.863719, 'auction_closing_time': 1774885863.0}
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR70378') HTTP/1.1" 204 0
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_1a9b7593fdac6efdd9afef581d6ad57e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_1a9b7593fdac6efdd9afef581d6ad57e.jpg not downloaded yet
2026-03-28 18:45:31 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW19977%27 HTTP/1.1" 200 None
2026-03-28 18:45:31 [auto1.de] INFO: Scrape type for NW19977: 2
2026-03-28 18:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27b63275-aa4b-5033-bf85-4b567902570c with identifier: NW19977
2026-03-28 18:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b63275-aa4b-5033-bf85-4b567902570c with scrape type 2
2026-03-28 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27b63275-aa4b-5033-bf85-4b567902570c with scrape type 2
2026-03-28 18:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27b63275-aa4b-5033-bf85-4b567902570c, identifier: NW19977
2026-03-28 18:45:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_7729ca1deb6cdc853fba1218767cabdc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_277d6084c6ba40591cd03954a0c505af.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_058d3773e5093a40edebe59a82bf7106.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_afe21fa5cb7d3c9aeda5575e32657425.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27b63275-aa4b-5033-bf85-4b567902570c with identifier: NW19977
2026-03-28 18:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27b63275-aa4b-5033-bf85-4b567902570c with identifier: NW19977
2026-03-28 18:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27b63275-aa4b-5033-bf85-4b567902570c with identifier: NW19977 to the API
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-30T15:00:15Z',
 'fuel_type': 'petrol',
 'id': '27b63275-aa4b-5033-bf85-4b567902570c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW19977',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 59663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-26',
 'seller_name': None,
 'title': 'Renault Koleos 1.3 TCe Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2022}
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW19977%27 HTTP/1.1" 200 None
2026-03-28 18:45:32 [auto1.de] INFO: Saving data for NW19977: {'auction_closing_time': 1774882815.0, 'created_time': 1774552879.78697, 'last_price_update_time': 1774723532.323958}
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW19977') HTTP/1.1" 204 0
2026-03-28 18:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_70bc3235be262b791941ed2148ebc1a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_ee746219ae17ef22ab31235042b967bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_ee746219ae17ef22ab31235042b967bc.jpg not downloaded yet
2026-03-28 18:45:32 [auto1.de] INFO: Found listing with ID: LD20816
2026-03-28 18:45:32 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-28 18:45:32 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND45572%27 HTTP/1.1" 200 None
2026-03-28 18:45:32 [auto1.de] INFO: Scrape type for ND45572: 2
2026-03-28 18:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 553db04f-1f1d-54ba-9a79-789c3febf6e2 with identifier: ND45572
2026-03-28 18:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553db04f-1f1d-54ba-9a79-789c3febf6e2 with scrape type 2
2026-03-28 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 553db04f-1f1d-54ba-9a79-789c3febf6e2 with scrape type 2
2026-03-28 18:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 553db04f-1f1d-54ba-9a79-789c3febf6e2, identifier: ND45572
2026-03-28 18:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 126893cc-3fd9-55fd-83b5-98d7375075ed with identifier: NX07210
2026-03-28 18:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 126893cc-3fd9-55fd-83b5-98d7375075ed with scrape type 1
2026-03-28 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 126893cc-3fd9-55fd-83b5-98d7375075ed
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F27%252Fb927e8d20a49dd99e6908ab0423e6ee8%252Fpa%252FNX07210_53bff92956ee966c1178621ecd552874.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_53bff92956ee966c1178621ecd552874.jpg already downloaded
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F27%252Fb927e8d20a49dd99e6908ab0423e6ee8%252Fpa%252FNX07210_c019d8bcc1ca4d3899b36cf8d405074e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_c019d8bcc1ca4d3899b36cf8d405074e.jpg already downloaded
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F27%252Fb927e8d20a49dd99e6908ab0423e6ee8%252Fpa%252FNX07210_ab34af9a7cca2157b1b4b1bf058a01cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_ab34af9a7cca2157b1b4b1bf058a01cb.jpg already downloaded
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F27%252Fb927e8d20a49dd99e6908ab0423e6ee8%252Fpa%252FNX07210_bd612eb8edea1ec7a30965fcdb6db0d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_bd612eb8edea1ec7a30965fcdb6db0d4.jpg already downloaded
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F27%252Fb927e8d20a49dd99e6908ab0423e6ee8%252Fpa%252FNX07210_b84fda32385c963504f689db499dcb43.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_b84fda32385c963504f689db499dcb43.jpg already downloaded
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F27%252Fb927e8d20a49dd99e6908ab0423e6ee8%252Fpa%252FNX07210_f447b702c34b75b38c98cbb5ee190a6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_f447b702c34b75b38c98cbb5ee190a6a.jpg already downloaded
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F27%252Fb927e8d20a49dd99e6908ab0423e6ee8%252Fpa%252FNX07210_61386c61744789d5418fa1331b8ff8d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_61386c61744789d5418fa1331b8ff8d0.jpg already downloaded
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F27%252Fb927e8d20a49dd99e6908ab0423e6ee8%252Fpa%252FNX07210_1d27fd35d6283d5c2836d3f93993f609.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_1d27fd35d6283d5c2836d3f93993f609.jpg already downloaded
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F27%252Fb927e8d20a49dd99e6908ab0423e6ee8%252Fpa%252FNX07210_8aa0fdbdfe6eaad056bc03fa90ec5d54.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_8aa0fdbdfe6eaad056bc03fa90ec5d54.jpg already downloaded
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F27%252Fb927e8d20a49dd99e6908ab0423e6ee8%252Fpa%252FNX07210_54a6b34eac5e34d121221982c31eeabc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_54a6b34eac5e34d121221982c31eeabc.jpg already downloaded
2026-03-28 18:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 126893cc-3fd9-55fd-83b5-98d7375075ed, identifier: NX07210
2026-03-28 18:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 553db04f-1f1d-54ba-9a79-789c3febf6e2 with identifier: ND45572
2026-03-28 18:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 553db04f-1f1d-54ba-9a79-789c3febf6e2 with identifier: ND45572
2026-03-28 18:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 553db04f-1f1d-54ba-9a79-789c3febf6e2 with identifier: ND45572 to the API
2026-03-28 18:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:42:40Z',
 'fuel_type': 'diesel',
 'id': '553db04f-1f1d-54ba-9a79-789c3febf6e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND45572',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 56598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-03',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 112 CDI PRO',
 'transmission': 'manual',
 'trim': 'PRO',
 'year': 2022}
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND45572%27 HTTP/1.1" 200 None
2026-03-28 18:45:33 [auto1.de] INFO: Saving data for ND45572: {'auction_closing_time': 1774885360.0, 'created_time': 1774350532.43982, 'last_price_update_time': 1774723533.122053}
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND45572') HTTP/1.1" 204 0
2026-03-28 18:45:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 126893cc-3fd9-55fd-83b5-98d7375075ed with identifier: NX07210
2026-03-28 18:45:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 126893cc-3fd9-55fd-83b5-98d7375075ed with identifier: NX07210
2026-03-28 18:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 126893cc-3fd9-55fd-83b5-98d7375075ed with identifier: NX07210 to the API
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NX07210>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:28:07Z',
 'fuel_type': 'petrol',
 'id': '126893cc-3fd9-55fd-83b5-98d7375075ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX07210',
 'listing': 'auction',
 'location': 'DE, Sulz am Neckar',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 83791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_53bff92956ee966c1178621ecd552874.jpg',
                'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_c019d8bcc1ca4d3899b36cf8d405074e.jpg',
                'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_ab34af9a7cca2157b1b4b1bf058a01cb.jpg',
                'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_bd612eb8edea1ec7a30965fcdb6db0d4.jpg',
                'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_b84fda32385c963504f689db499dcb43.jpg',
                'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_f447b702c34b75b38c98cbb5ee190a6a.jpg',
                'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_61386c61744789d5418fa1331b8ff8d0.jpg',
                'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_1d27fd35d6283d5c2836d3f93993f609.jpg',
                'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_8aa0fdbdfe6eaad056bc03fa90ec5d54.jpg',
                'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_54a6b34eac5e34d121221982c31eeabc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126893cc-3fd9-55fd-83b5-98d7375075ed/126893cc-3fd9-55fd-83b5-98d7375075ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2611329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_53bff92956ee966c1178621ecd552874.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126893cc-3fd9-55fd-83b5-98d7375075ed/126893cc-3fd9-55fd-83b5-98d7375075ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_c019d8bcc1ca4d3899b36cf8d405074e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126893cc-3fd9-55fd-83b5-98d7375075ed/126893cc-3fd9-55fd-83b5-98d7375075ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2590260,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_ab34af9a7cca2157b1b4b1bf058a01cb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126893cc-3fd9-55fd-83b5-98d7375075ed/126893cc-3fd9-55fd-83b5-98d7375075ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2445799,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_bd612eb8edea1ec7a30965fcdb6db0d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126893cc-3fd9-55fd-83b5-98d7375075ed/126893cc-3fd9-55fd-83b5-98d7375075ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_b84fda32385c963504f689db499dcb43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126893cc-3fd9-55fd-83b5-98d7375075ed/126893cc-3fd9-55fd-83b5-98d7375075ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2600128,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_f447b702c34b75b38c98cbb5ee190a6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126893cc-3fd9-55fd-83b5-98d7375075ed/126893cc-3fd9-55fd-83b5-98d7375075ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2425868,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_61386c61744789d5418fa1331b8ff8d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126893cc-3fd9-55fd-83b5-98d7375075ed/126893cc-3fd9-55fd-83b5-98d7375075ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561349,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_1d27fd35d6283d5c2836d3f93993f609.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126893cc-3fd9-55fd-83b5-98d7375075ed/126893cc-3fd9-55fd-83b5-98d7375075ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2487041,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_8aa0fdbdfe6eaad056bc03fa90ec5d54.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_126893cc-3fd9-55fd-83b5-98d7375075ed/126893cc-3fd9-55fd-83b5-98d7375075ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/27/b927e8d20a49dd99e6908ab0423e6ee8/pa/NX07210_54a6b34eac5e34d121221982c31eeabc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2014}
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX07210%27 HTTP/1.1" 200 None
2026-03-28 18:45:33 [auto1.de] INFO: Saving data for NX07210: {'created_time': 1774723533.456502, 'last_price_update_time': 1774723533.456513, 'auction_closing_time': 1774884487.0}
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX07210') HTTP/1.1" 204 0
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_f366fc836cce25ec5d77286c57ac14ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_f366fc836cce25ec5d77286c57ac14ce.jpg not downloaded yet
2026-03-28 18:45:33 [auto1.de] INFO: Found listing with ID: XK76650
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK76650%27 HTTP/1.1" 200 None
2026-03-28 18:45:33 [auto1.de] INFO: Scrape type for XK76650: 2
2026-03-28 18:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432 with identifier: XK76650
2026-03-28 18:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432 with scrape type 2
2026-03-28 18:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432 with scrape type 2
2026-03-28 18:45:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432, identifier: XK76650
2026-03-28 18:45:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432 with identifier: XK76650
2026-03-28 18:45:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432 with identifier: XK76650
2026-03-28 18:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432 with identifier: XK76650 to the API
2026-03-28 18:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:02:53Z',
 'fuel_type': 'petrol',
 'id': '819f4262-d4d9-5cd8-ba6c-dbc7abc4a432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK76650',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 116899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-31',
 'seller_name': None,
 'title': 'Honda Jazz 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK76650%27 HTTP/1.1" 200 None
2026-03-28 18:45:34 [auto1.de] INFO: Saving data for XK76650: {'auction_closing_time': 1774882973.0, 'created_time': 1773399135.452384, 'last_price_update_time': 1774723534.627693}
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK76650') HTTP/1.1" 204 0
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456305190>
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b473a1e2-87c0-5b4e-b02b-2bdcc161edc4/b473a1e2-87c0-5b4e-b02b-2bdcc161edc4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F2a%252Fd52ac97416f7d6d7ea549b35cc822ca2%252Fpa%252FYC98449_7729ca1deb6cdc853fba1218767cabdc.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_7729ca1deb6cdc853fba1218767cabdc.jpg saved to cache
2026-03-28 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b473a1e2-87c0-5b4e-b02b-2bdcc161edc4
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562e15d0>
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b473a1e2-87c0-5b4e-b02b-2bdcc161edc4/b473a1e2-87c0-5b4e-b02b-2bdcc161edc4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F2a%252Fd52ac97416f7d6d7ea549b35cc822ca2%252Fpa%252FYC98449_277d6084c6ba40591cd03954a0c505af.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_277d6084c6ba40591cd03954a0c505af.jpg saved to cache
2026-03-28 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b473a1e2-87c0-5b4e-b02b-2bdcc161edc4
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562c9450>
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b473a1e2-87c0-5b4e-b02b-2bdcc161edc4/b473a1e2-87c0-5b4e-b02b-2bdcc161edc4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F2a%252Fd52ac97416f7d6d7ea549b35cc822ca2%252Fpa%252FYC98449_058d3773e5093a40edebe59a82bf7106.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_058d3773e5093a40edebe59a82bf7106.jpg saved to cache
2026-03-28 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b473a1e2-87c0-5b4e-b02b-2bdcc161edc4
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245629bd90>
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b473a1e2-87c0-5b4e-b02b-2bdcc161edc4/b473a1e2-87c0-5b4e-b02b-2bdcc161edc4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F2a%252Fd52ac97416f7d6d7ea549b35cc822ca2%252Fpa%252FYC98449_afe21fa5cb7d3c9aeda5575e32657425.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_afe21fa5cb7d3c9aeda5575e32657425.jpg saved to cache
2026-03-28 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b473a1e2-87c0-5b4e-b02b-2bdcc161edc4
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547d06d0>
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b473a1e2-87c0-5b4e-b02b-2bdcc161edc4/b473a1e2-87c0-5b4e-b02b-2bdcc161edc4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F2a%252Fd52ac97416f7d6d7ea549b35cc822ca2%252Fpa%252FYC98449_70bc3235be262b791941ed2148ebc1a6.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_70bc3235be262b791941ed2148ebc1a6.jpg saved to cache
2026-03-28 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b473a1e2-87c0-5b4e-b02b-2bdcc161edc4
2026-03-28 18:45:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b473a1e2-87c0-5b4e-b02b-2bdcc161edc4, skipping ID generation
2026-03-28 18:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b473a1e2-87c0-5b4e-b02b-2bdcc161edc4 with scrape type 1
2026-03-28 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b473a1e2-87c0-5b4e-b02b-2bdcc161edc4 sending to next pipeline
2026-03-28 18:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b473a1e2-87c0-5b4e-b02b-2bdcc161edc4, identifier: YC98449
2026-03-28 18:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_12f0db4e83950dac10d1627662fd9603.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_f0d54cd307c6be015a13b7fe1cc3a379.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_f0d54cd307c6be015a13b7fe1cc3a379.jpg not downloaded yet
2026-03-28 18:45:34 [auto1.de] INFO: Found listing with ID: CL01053
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL01053%27 HTTP/1.1" 200 None
2026-03-28 18:45:34 [auto1.de] INFO: Scrape type for CL01053: 1
2026-03-28 18:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b473a1e2-87c0-5b4e-b02b-2bdcc161edc4 with identifier: YC98449
2026-03-28 18:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b473a1e2-87c0-5b4e-b02b-2bdcc161edc4 with identifier: YC98449
2026-03-28 18:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b473a1e2-87c0-5b4e-b02b-2bdcc161edc4 with identifier: YC98449 to the API
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_70bc3235be262b791941ed2148ebc1a6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:09:13Z',
 'fuel_type': 'petrol',
 'id': 'b473a1e2-87c0-5b4e-b02b-2bdcc161edc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC98449',
 'listing': 'auction',
 'location': 'DE, Potsdam',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 237389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b473a1e2-87c0-5b4e-b02b-2bdcc161edc4/b473a1e2-87c0-5b4e-b02b-2bdcc161edc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_277d6084c6ba40591cd03954a0c505af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b473a1e2-87c0-5b4e-b02b-2bdcc161edc4/b473a1e2-87c0-5b4e-b02b-2bdcc161edc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_afe21fa5cb7d3c9aeda5575e32657425.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b473a1e2-87c0-5b4e-b02b-2bdcc161edc4/b473a1e2-87c0-5b4e-b02b-2bdcc161edc4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_7729ca1deb6cdc853fba1218767cabdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b473a1e2-87c0-5b4e-b02b-2bdcc161edc4/b473a1e2-87c0-5b4e-b02b-2bdcc161edc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_058d3773e5093a40edebe59a82bf7106.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b473a1e2-87c0-5b4e-b02b-2bdcc161edc4/b473a1e2-87c0-5b4e-b02b-2bdcc161edc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/2a/d52ac97416f7d6d7ea549b35cc822ca2/pa/YC98449_70bc3235be262b791941ed2148ebc1a6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 Conceptline',
 'transmission': 'manual',
 'trim': 'Conceptline',
 'year': 2009}
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC98449%27 HTTP/1.1" 200 None
2026-03-28 18:45:35 [auto1.de] INFO: Saving data for YC98449: {'created_time': 1774723535.332573, 'last_price_update_time': 1774723535.332586, 'auction_closing_time': 1774883353.0}
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC98449') HTTP/1.1" 204 0
2026-03-28 18:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_1a9b7593fdac6efdd9afef581d6ad57e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_d54754ddc918b9bb92cdd7bdc0c78964.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_d54754ddc918b9bb92cdd7bdc0c78964.jpg not downloaded yet
2026-03-28 18:45:35 [auto1.de] INFO: Found listing with ID: PB68045
2026-03-28 18:45:35 [auto1.de] INFO: Found listing with ID: TD36353
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD36353%27 HTTP/1.1" 200 None
2026-03-28 18:45:35 [auto1.de] INFO: Scrape type for TD36353: 2
2026-03-28 18:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86 with identifier: TD36353
2026-03-28 18:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86 with scrape type 2
2026-03-28 18:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86 with scrape type 2
2026-03-28 18:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86, identifier: TD36353
2026-03-28 18:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86 with identifier: TD36353
2026-03-28 18:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86 with identifier: TD36353
2026-03-28 18:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86 with identifier: TD36353 to the API
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:38:02Z',
 'fuel_type': 'petrol',
 'id': '21f4d8c2-5f55-5e8b-adfe-21a0860bfc86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD36353',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 130920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-27',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD36353%27 HTTP/1.1" 200 None
2026-03-28 18:45:35 [auto1.de] INFO: Saving data for TD36353: {'auction_closing_time': 1774885082.0, 'created_time': 1774002212.216731, 'last_price_update_time': 1774723535.795397}
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD36353') HTTP/1.1" 204 0
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_26eba132e20920f7e7b3cb4aa5a202fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_26eba132e20920f7e7b3cb4aa5a202fc.jpg not downloaded yet
2026-03-28 18:45:35 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX88157%27 HTTP/1.1" 200 None
2026-03-28 18:45:35 [auto1.de] INFO: Scrape type for UX88157: 1
2026-03-28 18:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456180e10>
2026-03-28 18:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_12f0db4e83950dac10d1627662fd9603.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_12f0db4e83950dac10d1627662fd9603.jpg saved to cache
2026-03-28 18:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512
2026-03-28 18:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_ee746219ae17ef22ab31235042b967bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_c927da1bac80f86b5d75ea7c6d9c5f33.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_c927da1bac80f86b5d75ea7c6d9c5f33.jpg not downloaded yet
2026-03-28 18:45:35 [auto1.de] INFO: Found listing with ID: PS96436
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96436%27 HTTP/1.1" 200 None
2026-03-28 18:45:35 [auto1.de] INFO: Scrape type for PS96436: 2
2026-03-28 18:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4b61e75-3e7f-5f29-8231-9b5e24136a77 with identifier: PS96436
2026-03-28 18:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4b61e75-3e7f-5f29-8231-9b5e24136a77 with scrape type 2
2026-03-28 18:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4b61e75-3e7f-5f29-8231-9b5e24136a77 with scrape type 2
2026-03-28 18:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4b61e75-3e7f-5f29-8231-9b5e24136a77, identifier: PS96436
2026-03-28 18:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245629b6d0>
2026-03-28 18:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_1a9b7593fdac6efdd9afef581d6ad57e.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_1a9b7593fdac6efdd9afef581d6ad57e.jpg saved to cache
2026-03-28 18:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72
2026-03-28 18:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4b61e75-3e7f-5f29-8231-9b5e24136a77 with identifier: PS96436
2026-03-28 18:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4b61e75-3e7f-5f29-8231-9b5e24136a77 with identifier: PS96436
2026-03-28 18:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4b61e75-3e7f-5f29-8231-9b5e24136a77 with identifier: PS96436 to the API
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:50Z',
 'fuel_type': 'diesel',
 'id': 'b4b61e75-3e7f-5f29-8231-9b5e24136a77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS96436',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 192550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-16',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2018}
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96436%27 HTTP/1.1" 200 None
2026-03-28 18:45:36 [auto1.de] INFO: Saving data for PS96436: {'auction_closing_time': 1774882970.0, 'created_time': 1774350731.327676, 'last_price_update_time': 1774723536.422567}
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS96436') HTTP/1.1" 204 0
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_8a8e4dd3a3822f64c85ad9ac1327a0ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_8a8e4dd3a3822f64c85ad9ac1327a0ce.jpg not downloaded yet
2026-03-28 18:45:36 [auto1.de] INFO: Found listing with ID: CA26041
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA26041%27 HTTP/1.1" 200 None
2026-03-28 18:45:36 [auto1.de] INFO: Scrape type for CA26041: 2
2026-03-28 18:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6ddb400-0a69-51a3-ace4-0de89fb10947 with identifier: CA26041
2026-03-28 18:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6ddb400-0a69-51a3-ace4-0de89fb10947 with scrape type 2
2026-03-28 18:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6ddb400-0a69-51a3-ace4-0de89fb10947 with scrape type 2
2026-03-28 18:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6ddb400-0a69-51a3-ace4-0de89fb10947, identifier: CA26041
2026-03-28 18:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6ddb400-0a69-51a3-ace4-0de89fb10947 with identifier: CA26041
2026-03-28 18:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6ddb400-0a69-51a3-ace4-0de89fb10947 with identifier: CA26041
2026-03-28 18:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6ddb400-0a69-51a3-ace4-0de89fb10947 with identifier: CA26041 to the API
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:28Z',
 'fuel_type': 'diesel',
 'id': 'e6ddb400-0a69-51a3-ace4-0de89fb10947',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA26041',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 221214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-02',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 2WD',
 'transmission': 'automatic',
 'trim': '2WD',
 'year': 2019}
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA26041%27 HTTP/1.1" 200 None
2026-03-28 18:45:36 [auto1.de] INFO: Saving data for CA26041: {'auction_closing_time': 1774886368.0, 'created_time': 1774002224.956563, 'last_price_update_time': 1774723536.972844}
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA26041') HTTP/1.1" 204 0
2026-03-28 18:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX61417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b6ad0>
2026-03-28 18:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_ee746219ae17ef22ab31235042b967bc.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_ee746219ae17ef22ab31235042b967bc.jpg saved to cache
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_a857de352bee4f189daa329234fd2050.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_a857de352bee4f189daa329234fd2050.jpg not downloaded yet
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: FK87134
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: AC64408
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: MS92853
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: HJ08295
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ08295%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [auto1.de] INFO: Scrape type for HJ08295: 1
2026-03-28 18:45:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW06849> (referer: https://www.auto1.com/v1/car-details-view/SW06849/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW30345/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW27042> (referer: https://www.auto1.com/v1/car-details-view/MW27042/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ70356> (referer: https://www.auto1.com/v1/car-details-view/GZ70356/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX82336> (referer: https://www.auto1.com/v1/car-details-view/RX82336/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF03546> (referer: https://www.auto1.com/v1/car-details-view/UF03546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: KJ96076
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: AL40501
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL40501%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [auto1.de] INFO: Scrape type for AL40501: 1
2026-03-28 18:45:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: US66744
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: WF58596
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF58596%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [auto1.de] INFO: Scrape type for WF58596: 1
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: HP30052
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP30052%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [auto1.de] INFO: Scrape type for HP30052: 1
2026-03-28 18:45:37 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 6014 | hits on page: 40
2026-03-28 18:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_8a8e4dd3a3822f64c85ad9ac1327a0ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_c927da1bac80f86b5d75ea7c6d9c5f33.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: RT47702
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47702%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [auto1.de] INFO: Scrape type for RT47702: 1
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: YD01023
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: GJ73585
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: VA37364
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA37364%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [auto1.de] INFO: Scrape type for VA37364: 2
2026-03-28 18:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90b17a01-899b-5bcf-bb76-8fa88f6ec06e with identifier: VA37364
2026-03-28 18:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b17a01-899b-5bcf-bb76-8fa88f6ec06e with scrape type 2
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90b17a01-899b-5bcf-bb76-8fa88f6ec06e with scrape type 2
2026-03-28 18:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90b17a01-899b-5bcf-bb76-8fa88f6ec06e, identifier: VA37364
2026-03-28 18:45:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: GB90564
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: RL85498
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: NV50024
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: WB83413
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: NX27502
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: BY26931
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26931%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [auto1.de] INFO: Scrape type for BY26931: 1
2026-03-28 18:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90b17a01-899b-5bcf-bb76-8fa88f6ec06e with identifier: VA37364
2026-03-28 18:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90b17a01-899b-5bcf-bb76-8fa88f6ec06e with identifier: VA37364
2026-03-28 18:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90b17a01-899b-5bcf-bb76-8fa88f6ec06e with identifier: VA37364 to the API
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:46:55Z',
 'fuel_type': 'petrol',
 'id': '90b17a01-899b-5bcf-bb76-8fa88f6ec06e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA37364',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 192955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'BMW 3er 330i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2015}
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA37364%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [auto1.de] INFO: Saving data for VA37364: {'auction_closing_time': 1774885615.0, 'created_time': 1774035024.781025, 'last_price_update_time': 1774723537.629574}
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA37364') HTTP/1.1" 204 0
2026-03-28 18:45:37 [auto1.de] INFO: Found listing with ID: CA66668
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA66668%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [auto1.de] INFO: Scrape type for CA66668: 2
2026-03-28 18:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c66bce0f-a39d-5a84-858e-ef07d2de88da with identifier: CA66668
2026-03-28 18:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c66bce0f-a39d-5a84-858e-ef07d2de88da with scrape type 2
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c66bce0f-a39d-5a84-858e-ef07d2de88da with scrape type 2
2026-03-28 18:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c66bce0f-a39d-5a84-858e-ef07d2de88da, identifier: CA66668
2026-03-28 18:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 315139cd-e1eb-531c-81f3-4945d09fa18f with identifier: SW06849
2026-03-28 18:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 315139cd-e1eb-531c-81f3-4945d09fa18f with scrape type 1
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 315139cd-e1eb-531c-81f3-4945d09fa18f
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F96%252Fef9695725ca48ac2480e8c9c4218071e%252Fpa%252FSW06849_b2a31e99ecfa8ea72a2d43971ebe7bda.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_b2a31e99ecfa8ea72a2d43971ebe7bda.jpg already downloaded
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F96%252Fef9695725ca48ac2480e8c9c4218071e%252Fpa%252FSW06849_9e4b68b81219969b23e26f2813385656.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_9e4b68b81219969b23e26f2813385656.jpg already downloaded
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F96%252Fef9695725ca48ac2480e8c9c4218071e%252Fpa%252FSW06849_ac7b56c3801daaa128a17e69211d1288.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_ac7b56c3801daaa128a17e69211d1288.jpg already downloaded
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F96%252Fef9695725ca48ac2480e8c9c4218071e%252Fpa%252FSW06849_3ed4cdfe90b3fff9bfe73c5ec573138d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_3ed4cdfe90b3fff9bfe73c5ec573138d.jpg already downloaded
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F96%252Fef9695725ca48ac2480e8c9c4218071e%252Fpa%252FSW06849_4875bd9feaa40d3530a3327eb6fe1229.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_4875bd9feaa40d3530a3327eb6fe1229.jpg already downloaded
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F96%252Fef9695725ca48ac2480e8c9c4218071e%252Fpa%252FSW06849_0c350f2a140a8c6fee7fe7b06206aa30.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_0c350f2a140a8c6fee7fe7b06206aa30.jpg already downloaded
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F96%252Fef9695725ca48ac2480e8c9c4218071e%252Fpa%252FSW06849_047152a449c4b2623936477b6b178dea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_047152a449c4b2623936477b6b178dea.jpg already downloaded
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F96%252Fef9695725ca48ac2480e8c9c4218071e%252Fpa%252FSW06849_9812df7043b59fc2af9a2bdb932120ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_9812df7043b59fc2af9a2bdb932120ab.jpg already downloaded
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F96%252Fef9695725ca48ac2480e8c9c4218071e%252Fpa%252FSW06849_cae943dea298d200786efa23c88b66f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_cae943dea298d200786efa23c88b66f1.jpg already downloaded
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F96%252Fef9695725ca48ac2480e8c9c4218071e%252Fpa%252FSW06849_f9c3a2b3d0f7e3b0084fd9418bbb1c9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_f9c3a2b3d0f7e3b0084fd9418bbb1c9c.jpg already downloaded
2026-03-28 18:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 315139cd-e1eb-531c-81f3-4945d09fa18f, identifier: SW06849
2026-03-28 18:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_26eba132e20920f7e7b3cb4aa5a202fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_a857de352bee4f189daa329234fd2050.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:38 [auto1.de] INFO: Found listing with ID: MF21991
2026-03-28 18:45:38 [auto1.de] INFO: Found listing with ID: MV86263
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV86263%27 HTTP/1.1" 200 None
2026-03-28 18:45:38 [auto1.de] INFO: Scrape type for MV86263: 2
2026-03-28 18:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e91f2a0-6c81-5c36-beb2-0671751650dc with identifier: MV86263
2026-03-28 18:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e91f2a0-6c81-5c36-beb2-0671751650dc with scrape type 2
2026-03-28 18:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e91f2a0-6c81-5c36-beb2-0671751650dc with scrape type 2
2026-03-28 18:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e91f2a0-6c81-5c36-beb2-0671751650dc, identifier: MV86263
2026-03-28 18:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c66bce0f-a39d-5a84-858e-ef07d2de88da with identifier: CA66668
2026-03-28 18:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c66bce0f-a39d-5a84-858e-ef07d2de88da with identifier: CA66668
2026-03-28 18:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c66bce0f-a39d-5a84-858e-ef07d2de88da with identifier: CA66668 to the API
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:10:31Z',
 'fuel_type': 'diesel',
 'id': 'c66bce0f-a39d-5a84-858e-ef07d2de88da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA66668',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 155472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-25',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang BlueTEC Edition',
 'transmission': 'automatic',
 'trim': 'lang BlueTEC Edition',
 'year': 2017}
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA66668%27 HTTP/1.1" 200 None
2026-03-28 18:45:38 [auto1.de] INFO: Saving data for CA66668: {'auction_closing_time': 1774883431.0, 'created_time': 1774350797.248195, 'last_price_update_time': 1774723538.547547}
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA66668') HTTP/1.1" 204 0
2026-03-28 18:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 315139cd-e1eb-531c-81f3-4945d09fa18f with identifier: SW06849
2026-03-28 18:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 315139cd-e1eb-531c-81f3-4945d09fa18f with identifier: SW06849
2026-03-28 18:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 315139cd-e1eb-531c-81f3-4945d09fa18f with identifier: SW06849 to the API
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SW06849>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:05:55Z',
 'fuel_type': 'petrol',
 'id': '315139cd-e1eb-531c-81f3-4945d09fa18f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW06849',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 1297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_b2a31e99ecfa8ea72a2d43971ebe7bda.jpg',
                'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_9e4b68b81219969b23e26f2813385656.jpg',
                'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_ac7b56c3801daaa128a17e69211d1288.jpg',
                'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_3ed4cdfe90b3fff9bfe73c5ec573138d.jpg',
                'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_4875bd9feaa40d3530a3327eb6fe1229.jpg',
                'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_0c350f2a140a8c6fee7fe7b06206aa30.jpg',
                'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_047152a449c4b2623936477b6b178dea.jpg',
                'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_9812df7043b59fc2af9a2bdb932120ab.jpg',
                'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_cae943dea298d200786efa23c88b66f1.jpg',
                'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_f9c3a2b3d0f7e3b0084fd9418bbb1c9c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315139cd-e1eb-531c-81f3-4945d09fa18f/315139cd-e1eb-531c-81f3-4945d09fa18f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_b2a31e99ecfa8ea72a2d43971ebe7bda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315139cd-e1eb-531c-81f3-4945d09fa18f/315139cd-e1eb-531c-81f3-4945d09fa18f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_9e4b68b81219969b23e26f2813385656.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315139cd-e1eb-531c-81f3-4945d09fa18f/315139cd-e1eb-531c-81f3-4945d09fa18f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_ac7b56c3801daaa128a17e69211d1288.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315139cd-e1eb-531c-81f3-4945d09fa18f/315139cd-e1eb-531c-81f3-4945d09fa18f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_3ed4cdfe90b3fff9bfe73c5ec573138d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315139cd-e1eb-531c-81f3-4945d09fa18f/315139cd-e1eb-531c-81f3-4945d09fa18f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_4875bd9feaa40d3530a3327eb6fe1229.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315139cd-e1eb-531c-81f3-4945d09fa18f/315139cd-e1eb-531c-81f3-4945d09fa18f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2208798,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_0c350f2a140a8c6fee7fe7b06206aa30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315139cd-e1eb-531c-81f3-4945d09fa18f/315139cd-e1eb-531c-81f3-4945d09fa18f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_047152a449c4b2623936477b6b178dea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315139cd-e1eb-531c-81f3-4945d09fa18f/315139cd-e1eb-531c-81f3-4945d09fa18f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2201381,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_9812df7043b59fc2af9a2bdb932120ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315139cd-e1eb-531c-81f3-4945d09fa18f/315139cd-e1eb-531c-81f3-4945d09fa18f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_cae943dea298d200786efa23c88b66f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315139cd-e1eb-531c-81f3-4945d09fa18f/315139cd-e1eb-531c-81f3-4945d09fa18f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/96/ef9695725ca48ac2480e8c9c4218071e/pa/SW06849_f9c3a2b3d0f7e3b0084fd9418bbb1c9c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kangoo 1.3 TCe Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2025}
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW06849%27 HTTP/1.1" 200 None
2026-03-28 18:45:38 [auto1.de] INFO: Saving data for SW06849: {'created_time': 1774723538.913981, 'last_price_update_time': 1774723538.913991, 'auction_closing_time': 1774883155.0}
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW06849') HTTP/1.1" 204 0
2026-03-28 18:45:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e91f2a0-6c81-5c36-beb2-0671751650dc with identifier: MV86263
2026-03-28 18:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e91f2a0-6c81-5c36-beb2-0671751650dc with identifier: MV86263
2026-03-28 18:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e91f2a0-6c81-5c36-beb2-0671751650dc with identifier: MV86263 to the API
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:39:15Z',
 'fuel_type': 'diesel',
 'id': '6e91f2a0-6c81-5c36-beb2-0671751650dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV86263',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 170303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-30',
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV86263%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [auto1.de] INFO: Saving data for MV86263: {'auction_closing_time': 1774885155.0, 'created_time': 1773401365.117446, 'last_price_update_time': 1774723539.253701}
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV86263') HTTP/1.1" 204 0
2026-03-28 18:45:39 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ98006%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [auto1.de] INFO: Scrape type for NZ98006: 1
2026-03-28 18:45:39 [auto1.de] INFO: Found listing with ID: XR92513
2026-03-28 18:45:39 [auto1.de] INFO: Found listing with ID: GZ82101
2026-03-28 18:45:39 [auto1.de] INFO: Found listing with ID: MH61351
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH61351%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [auto1.de] INFO: Scrape type for MH61351: 2
2026-03-28 18:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dead19f4-b700-5b02-92a7-c6b43f572150 with identifier: MH61351
2026-03-28 18:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dead19f4-b700-5b02-92a7-c6b43f572150 with scrape type 2
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dead19f4-b700-5b02-92a7-c6b43f572150 with scrape type 2
2026-03-28 18:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dead19f4-b700-5b02-92a7-c6b43f572150, identifier: MH61351
2026-03-28 18:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bf4fea5-e2d7-52bb-89fc-178af414a85f with identifier: MW27042
2026-03-28 18:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bf4fea5-e2d7-52bb-89fc-178af414a85f with scrape type 1
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bf4fea5-e2d7-52bb-89fc-178af414a85f
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fd0%252F40d043e1958426368907a1b4d4e78ad3%252Fpa%252FMW27042_b93bf51672219ec54524d26183cbe7d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_b93bf51672219ec54524d26183cbe7d5.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fd0%252F40d043e1958426368907a1b4d4e78ad3%252Fpa%252FMW27042_1f0b12efce9988947e9604224db6ade5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_1f0b12efce9988947e9604224db6ade5.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fd0%252F40d043e1958426368907a1b4d4e78ad3%252Fpa%252FMW27042_ac47466c6e3e92a972ee2f728966dd2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_ac47466c6e3e92a972ee2f728966dd2c.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fd0%252F40d043e1958426368907a1b4d4e78ad3%252Fpa%252FMW27042_c1cfa4e5614fc1a972c1c7971ec9c440.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_c1cfa4e5614fc1a972c1c7971ec9c440.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fd0%252F40d043e1958426368907a1b4d4e78ad3%252Fpa%252FMW27042_2daefa6c203e32d723513292d3adfad1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_2daefa6c203e32d723513292d3adfad1.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fd0%252F40d043e1958426368907a1b4d4e78ad3%252Fpa%252FMW27042_c9c8cd4bbff145feec61a476b5fabd75.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_c9c8cd4bbff145feec61a476b5fabd75.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fd0%252F40d043e1958426368907a1b4d4e78ad3%252Fpa%252FMW27042_a66390ebaf447bdb09d0f799afaba11e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_a66390ebaf447bdb09d0f799afaba11e.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fd0%252F40d043e1958426368907a1b4d4e78ad3%252Fpa%252FMW27042_9884b5c9ee6444c8ee92b9d493bd75b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_9884b5c9ee6444c8ee92b9d493bd75b8.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fd0%252F40d043e1958426368907a1b4d4e78ad3%252Fpa%252FMW27042_9dfb45098417d1b07b69e6e115f50718.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_9dfb45098417d1b07b69e6e115f50718.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fd0%252F40d043e1958426368907a1b4d4e78ad3%252Fpa%252FMW27042_860da670089504fd080acbdfccea0281.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_860da670089504fd080acbdfccea0281.jpg already downloaded
2026-03-28 18:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bf4fea5-e2d7-52bb-89fc-178af414a85f, identifier: MW27042
2026-03-28 18:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48827fb7-37ff-5368-b412-b99f8a5b3774 with identifier: GZ70356
2026-03-28 18:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48827fb7-37ff-5368-b412-b99f8a5b3774 with scrape type 1
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 48827fb7-37ff-5368-b412-b99f8a5b3774
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F6d%252Fdf6d810b6b2d3664ec0d1089cfcef4de%252Fpa%252FGZ70356_e987588b92647a3c7416eaaf4c5e71ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_e987588b92647a3c7416eaaf4c5e71ba.jpg not downloaded yet
2026-03-28 18:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 543adbdb-a892-5452-8308-8c50f14bfe76 with identifier: RX82336
2026-03-28 18:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 543adbdb-a892-5452-8308-8c50f14bfe76 with scrape type 1
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 543adbdb-a892-5452-8308-8c50f14bfe76
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fed%252F88ed499a6ac533abd609caa99c22183c%252Fpa%252FRX82336_4b431d0bc931e247b26ffde3bddc5491.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_4b431d0bc931e247b26ffde3bddc5491.jpg not downloaded yet
2026-03-28 18:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660208e9-4689-58fc-8fb6-8d813a0ddfdd with identifier: UF03546
2026-03-28 18:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660208e9-4689-58fc-8fb6-8d813a0ddfdd with scrape type 1
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 660208e9-4689-58fc-8fb6-8d813a0ddfdd
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F24%252Fe524b500b6f904618a0e1d0a3410a085%252Fpa%252FUF03546_7018b010a0019fb7d02dd71c99a6dc74.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_7018b010a0019fb7d02dd71c99a6dc74.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F24%252Fe524b500b6f904618a0e1d0a3410a085%252Fpa%252FUF03546_759ebfd2e28043d8f842d42473534f79.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_759ebfd2e28043d8f842d42473534f79.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F24%252Fe524b500b6f904618a0e1d0a3410a085%252Fpa%252FUF03546_a4102a1fdd421a3f1150307ac6f9f08a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_a4102a1fdd421a3f1150307ac6f9f08a.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F24%252Fe524b500b6f904618a0e1d0a3410a085%252Fpa%252FUF03546_ff010a987ad611e2dd2896d798a6d1ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_ff010a987ad611e2dd2896d798a6d1ea.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F24%252Fe524b500b6f904618a0e1d0a3410a085%252Fpa%252FUF03546_13586747c58607be3663462b69f0ac4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_13586747c58607be3663462b69f0ac4e.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F24%252Fe524b500b6f904618a0e1d0a3410a085%252Fpa%252FUF03546_571074f5e5dd27b79ec2566dce8399b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_571074f5e5dd27b79ec2566dce8399b2.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F24%252Fe524b500b6f904618a0e1d0a3410a085%252Fpa%252FUF03546_017c62d487c0cfd0f6c6005f7019d00b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_017c62d487c0cfd0f6c6005f7019d00b.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F24%252Fe524b500b6f904618a0e1d0a3410a085%252Fpa%252FUF03546_6bc97f1bab2ae26c5b1af82dd73e69ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_6bc97f1bab2ae26c5b1af82dd73e69ee.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F24%252Fe524b500b6f904618a0e1d0a3410a085%252Fpa%252FUF03546_c247e4181f03062960f8e9be559bc584.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_c247e4181f03062960f8e9be559bc584.jpg already downloaded
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F24%252Fe524b500b6f904618a0e1d0a3410a085%252Fpa%252FUF03546_eb0fb38e7ee0bd55b7d6cd62dcf927f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_eb0fb38e7ee0bd55b7d6cd62dcf927f7.jpg already downloaded
2026-03-28 18:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 660208e9-4689-58fc-8fb6-8d813a0ddfdd, identifier: UF03546
2026-03-28 18:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456327290>
2026-03-28 18:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_8a8e4dd3a3822f64c85ad9ac1327a0ce.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_8a8e4dd3a3822f64c85ad9ac1327a0ce.jpg saved to cache
2026-03-28 18:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72
2026-03-28 18:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245630fcd0>
2026-03-28 18:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_c927da1bac80f86b5d75ea7c6d9c5f33.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_c927da1bac80f86b5d75ea7c6d9c5f33.jpg saved to cache
2026-03-28 18:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72
2026-03-28 18:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_d54754ddc918b9bb92cdd7bdc0c78964.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_f0d54cd307c6be015a13b7fe1cc3a379.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dead19f4-b700-5b02-92a7-c6b43f572150 with identifier: MH61351
2026-03-28 18:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dead19f4-b700-5b02-92a7-c6b43f572150 with identifier: MH61351
2026-03-28 18:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dead19f4-b700-5b02-92a7-c6b43f572150 with identifier: MH61351 to the API
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-30T15:41:48Z',
 'fuel_type': 'petrol',
 'id': 'dead19f4-b700-5b02-92a7-c6b43f572150',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH61351',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 91474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-01',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2016}
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH61351%27 HTTP/1.1" 200 None
2026-03-28 18:45:40 [auto1.de] INFO: Saving data for MH61351: {'auction_closing_time': 1774885308.0, 'created_time': 1774350647.02296, 'last_price_update_time': 1774723540.425855}
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH61351') HTTP/1.1" 204 0
2026-03-28 18:45:40 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP14986%27 HTTP/1.1" 200 None
2026-03-28 18:45:40 [auto1.de] INFO: Scrape type for MP14986: 1
2026-03-28 18:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bf4fea5-e2d7-52bb-89fc-178af414a85f with identifier: MW27042
2026-03-28 18:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bf4fea5-e2d7-52bb-89fc-178af414a85f with identifier: MW27042
2026-03-28 18:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bf4fea5-e2d7-52bb-89fc-178af414a85f with identifier: MW27042 to the API
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MW27042>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:13:13Z',
 'fuel_type': 'petrol',
 'id': '6bf4fea5-e2d7-52bb-89fc-178af414a85f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW27042',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 117185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_b93bf51672219ec54524d26183cbe7d5.jpg',
                'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_1f0b12efce9988947e9604224db6ade5.jpg',
                'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_ac47466c6e3e92a972ee2f728966dd2c.jpg',
                'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_c1cfa4e5614fc1a972c1c7971ec9c440.jpg',
                'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_2daefa6c203e32d723513292d3adfad1.jpg',
                'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_c9c8cd4bbff145feec61a476b5fabd75.jpg',
                'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_a66390ebaf447bdb09d0f799afaba11e.jpg',
                'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_9884b5c9ee6444c8ee92b9d493bd75b8.jpg',
                'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_9dfb45098417d1b07b69e6e115f50718.jpg',
                'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_860da670089504fd080acbdfccea0281.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf4fea5-e2d7-52bb-89fc-178af414a85f/6bf4fea5-e2d7-52bb-89fc-178af414a85f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_b93bf51672219ec54524d26183cbe7d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf4fea5-e2d7-52bb-89fc-178af414a85f/6bf4fea5-e2d7-52bb-89fc-178af414a85f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_1f0b12efce9988947e9604224db6ade5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf4fea5-e2d7-52bb-89fc-178af414a85f/6bf4fea5-e2d7-52bb-89fc-178af414a85f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_ac47466c6e3e92a972ee2f728966dd2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf4fea5-e2d7-52bb-89fc-178af414a85f/6bf4fea5-e2d7-52bb-89fc-178af414a85f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_c1cfa4e5614fc1a972c1c7971ec9c440.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf4fea5-e2d7-52bb-89fc-178af414a85f/6bf4fea5-e2d7-52bb-89fc-178af414a85f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_2daefa6c203e32d723513292d3adfad1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf4fea5-e2d7-52bb-89fc-178af414a85f/6bf4fea5-e2d7-52bb-89fc-178af414a85f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_c9c8cd4bbff145feec61a476b5fabd75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf4fea5-e2d7-52bb-89fc-178af414a85f/6bf4fea5-e2d7-52bb-89fc-178af414a85f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_a66390ebaf447bdb09d0f799afaba11e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf4fea5-e2d7-52bb-89fc-178af414a85f/6bf4fea5-e2d7-52bb-89fc-178af414a85f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_9884b5c9ee6444c8ee92b9d493bd75b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf4fea5-e2d7-52bb-89fc-178af414a85f/6bf4fea5-e2d7-52bb-89fc-178af414a85f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_9dfb45098417d1b07b69e6e115f50718.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bf4fea5-e2d7-52bb-89fc-178af414a85f/6bf4fea5-e2d7-52bb-89fc-178af414a85f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/d0/40d043e1958426368907a1b4d4e78ad3/pa/MW27042_860da670089504fd080acbdfccea0281.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW27042%27 HTTP/1.1" 200 None
2026-03-28 18:45:40 [auto1.de] INFO: Saving data for MW27042: {'created_time': 1774723540.774214, 'last_price_update_time': 1774723540.774227, 'auction_closing_time': 1774883593.0}
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW27042') HTTP/1.1" 204 0
2026-03-28 18:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 660208e9-4689-58fc-8fb6-8d813a0ddfdd with identifier: UF03546
2026-03-28 18:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 660208e9-4689-58fc-8fb6-8d813a0ddfdd with identifier: UF03546
2026-03-28 18:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 660208e9-4689-58fc-8fb6-8d813a0ddfdd with identifier: UF03546 to the API
2026-03-28 18:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UF03546>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:51:09Z',
 'fuel_type': 'petrol',
 'id': '660208e9-4689-58fc-8fb6-8d813a0ddfdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF03546',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 39726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_7018b010a0019fb7d02dd71c99a6dc74.jpg',
                'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_759ebfd2e28043d8f842d42473534f79.jpg',
                'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_a4102a1fdd421a3f1150307ac6f9f08a.jpg',
                'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_ff010a987ad611e2dd2896d798a6d1ea.jpg',
                'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_13586747c58607be3663462b69f0ac4e.jpg',
                'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_571074f5e5dd27b79ec2566dce8399b2.jpg',
                'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_017c62d487c0cfd0f6c6005f7019d00b.jpg',
                'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_6bc97f1bab2ae26c5b1af82dd73e69ee.jpg',
                'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_c247e4181f03062960f8e9be559bc584.jpg',
                'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_eb0fb38e7ee0bd55b7d6cd62dcf927f7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660208e9-4689-58fc-8fb6-8d813a0ddfdd/660208e9-4689-58fc-8fb6-8d813a0ddfdd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_7018b010a0019fb7d02dd71c99a6dc74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660208e9-4689-58fc-8fb6-8d813a0ddfdd/660208e9-4689-58fc-8fb6-8d813a0ddfdd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_759ebfd2e28043d8f842d42473534f79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660208e9-4689-58fc-8fb6-8d813a0ddfdd/660208e9-4689-58fc-8fb6-8d813a0ddfdd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_a4102a1fdd421a3f1150307ac6f9f08a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660208e9-4689-58fc-8fb6-8d813a0ddfdd/660208e9-4689-58fc-8fb6-8d813a0ddfdd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_ff010a987ad611e2dd2896d798a6d1ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660208e9-4689-58fc-8fb6-8d813a0ddfdd/660208e9-4689-58fc-8fb6-8d813a0ddfdd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_13586747c58607be3663462b69f0ac4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660208e9-4689-58fc-8fb6-8d813a0ddfdd/660208e9-4689-58fc-8fb6-8d813a0ddfdd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_571074f5e5dd27b79ec2566dce8399b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660208e9-4689-58fc-8fb6-8d813a0ddfdd/660208e9-4689-58fc-8fb6-8d813a0ddfdd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_017c62d487c0cfd0f6c6005f7019d00b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660208e9-4689-58fc-8fb6-8d813a0ddfdd/660208e9-4689-58fc-8fb6-8d813a0ddfdd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_6bc97f1bab2ae26c5b1af82dd73e69ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660208e9-4689-58fc-8fb6-8d813a0ddfdd/660208e9-4689-58fc-8fb6-8d813a0ddfdd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_c247e4181f03062960f8e9be559bc584.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660208e9-4689-58fc-8fb6-8d813a0ddfdd/660208e9-4689-58fc-8fb6-8d813a0ddfdd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/24/e524b500b6f904618a0e1d0a3410a085/pa/UF03546_eb0fb38e7ee0bd55b7d6cd62dcf927f7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF03546%27 HTTP/1.1" 200 None
2026-03-28 18:45:41 [auto1.de] INFO: Saving data for UF03546: {'created_time': 1774723541.127051, 'last_price_update_time': 1774723541.127064, 'auction_closing_time': 1774885869.0}
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF03546') HTTP/1.1" 204 0
2026-03-28 18:45:41 [auto1.de] INFO: Found listing with ID: FT59815
2026-03-28 18:45:41 [auto1.de] INFO: Found listing with ID: TT73177
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT73177%27 HTTP/1.1" 200 None
2026-03-28 18:45:41 [auto1.de] INFO: Scrape type for TT73177: 2
2026-03-28 18:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a91cd726-46a4-5c15-9a4b-eb452846b8e2 with identifier: TT73177
2026-03-28 18:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91cd726-46a4-5c15-9a4b-eb452846b8e2 with scrape type 2
2026-03-28 18:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a91cd726-46a4-5c15-9a4b-eb452846b8e2 with scrape type 2
2026-03-28 18:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a91cd726-46a4-5c15-9a4b-eb452846b8e2, identifier: TT73177
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F6d%252Fdf6d810b6b2d3664ec0d1089cfcef4de%252Fpa%252FGZ70356_a35a5e56672be19f712decd7bfc820d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_a35a5e56672be19f712decd7bfc820d9.jpg not downloaded yet
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fed%252F88ed499a6ac533abd609caa99c22183c%252Fpa%252FRX82336_24e6a4d0fba8168ccc9b240d753e3918.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_24e6a4d0fba8168ccc9b240d753e3918.jpg not downloaded yet
2026-03-28 18:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b1090>
2026-03-28 18:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_26eba132e20920f7e7b3cb4aa5a202fc.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_26eba132e20920f7e7b3cb4aa5a202fc.jpg saved to cache
2026-03-28 18:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72
2026-03-28 18:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245481dd90>
2026-03-28 18:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_a857de352bee4f189daa329234fd2050.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_a857de352bee4f189daa329234fd2050.jpg saved to cache
2026-03-28 18:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72
2026-03-28 18:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a91cd726-46a4-5c15-9a4b-eb452846b8e2 with identifier: TT73177
2026-03-28 18:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a91cd726-46a4-5c15-9a4b-eb452846b8e2 with identifier: TT73177
2026-03-28 18:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a91cd726-46a4-5c15-9a4b-eb452846b8e2 with identifier: TT73177 to the API
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:51Z',
 'fuel_type': 'petrol',
 'id': 'a91cd726-46a4-5c15-9a4b-eb452846b8e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT73177',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 181912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-01',
 'seller_name': None,
 'title': 'Mazda 5 1.8 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2009}
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT73177%27 HTTP/1.1" 200 None
2026-03-28 18:45:41 [auto1.de] INFO: Saving data for TT73177: {'auction_closing_time': 1774884591.0, 'created_time': 1773429008.956638, 'last_price_update_time': 1774723541.684204}
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT73177') HTTP/1.1" 204 0
2026-03-28 18:45:41 [auto1.de] INFO: Found listing with ID: YC95910
2026-03-28 18:45:41 [auto1.de] INFO: Found listing with ID: KU30255
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU30255%27 HTTP/1.1" 200 None
2026-03-28 18:45:41 [auto1.de] INFO: Scrape type for KU30255: 2
2026-03-28 18:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84a50185-5451-56a3-9f06-f298d2ef3895 with identifier: KU30255
2026-03-28 18:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84a50185-5451-56a3-9f06-f298d2ef3895 with scrape type 2
2026-03-28 18:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84a50185-5451-56a3-9f06-f298d2ef3895 with scrape type 2
2026-03-28 18:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84a50185-5451-56a3-9f06-f298d2ef3895, identifier: KU30255
2026-03-28 18:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL01053/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:41 [auto1.de] INFO: Found listing with ID: TN55271
2026-03-28 18:45:41 [auto1.de] INFO: Found listing with ID: DZ73228
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ73228%27 HTTP/1.1" 200 None
2026-03-28 18:45:41 [auto1.de] INFO: Scrape type for DZ73228: 1
2026-03-28 18:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84a50185-5451-56a3-9f06-f298d2ef3895 with identifier: KU30255
2026-03-28 18:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84a50185-5451-56a3-9f06-f298d2ef3895 with identifier: KU30255
2026-03-28 18:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84a50185-5451-56a3-9f06-f298d2ef3895 with identifier: KU30255 to the API
2026-03-28 18:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:43:53Z',
 'fuel_type': 'petrol',
 'id': '84a50185-5451-56a3-9f06-f298d2ef3895',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU30255',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 78242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-27',
 'seller_name': None,
 'title': 'BMW 3er 318i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2019}
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU30255%27 HTTP/1.1" 200 None
2026-03-28 18:45:42 [auto1.de] INFO: Saving data for KU30255: {'auction_closing_time': 1774885433.0, 'created_time': 1774119113.137145, 'last_price_update_time': 1774723542.171126}
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU30255') HTTP/1.1" 204 0
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F6d%252Fdf6d810b6b2d3664ec0d1089cfcef4de%252Fpa%252FGZ70356_356d209b97fc4a63dbf35ec3e22a864c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_356d209b97fc4a63dbf35ec3e22a864c.jpg not downloaded yet
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fed%252F88ed499a6ac533abd609caa99c22183c%252Fpa%252FRX82336_e8560d13c75da55fcfe6736077fa9459.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_e8560d13c75da55fcfe6736077fa9459.jpg not downloaded yet
2026-03-28 18:45:42 [auto1.de] INFO: Found listing with ID: HE47734
2026-03-28 18:45:42 [auto1.de] INFO: Found listing with ID: JR52179
2026-03-28 18:45:42 [auto1.de] INFO: Found listing with ID: LD23223
2026-03-28 18:45:42 [auto1.de] INFO: Found listing with ID: LM31898
2026-03-28 18:45:42 [auto1.de] INFO: Found listing with ID: HL01555
2026-03-28 18:45:42 [auto1.de] INFO: Found listing with ID: WJ67055
2026-03-28 18:45:42 [auto1.de] INFO: Found listing with ID: EJ09183
2026-03-28 18:45:42 [auto1.de] INFO: Found listing with ID: TM08126
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM08126%27 HTTP/1.1" 200 None
2026-03-28 18:45:42 [auto1.de] INFO: Scrape type for TM08126: 2
2026-03-28 18:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d81404-a69a-5e91-a69e-19f501055c15 with identifier: TM08126
2026-03-28 18:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d81404-a69a-5e91-a69e-19f501055c15 with scrape type 2
2026-03-28 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8d81404-a69a-5e91-a69e-19f501055c15 with scrape type 2
2026-03-28 18:45:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8d81404-a69a-5e91-a69e-19f501055c15, identifier: TM08126
2026-03-28 18:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX88157/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b90d0>
2026-03-28 18:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_d54754ddc918b9bb92cdd7bdc0c78964.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_d54754ddc918b9bb92cdd7bdc0c78964.jpg saved to cache
2026-03-28 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72
2026-03-28 18:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456236310>
2026-03-28 18:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_f0d54cd307c6be015a13b7fe1cc3a379.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_f0d54cd307c6be015a13b7fe1cc3a379.jpg saved to cache
2026-03-28 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72
2026-03-28 18:45:42 [auto1.de] INFO: Found listing with ID: ZA78506
2026-03-28 18:45:42 [auto1.de] INFO: Found listing with ID: BT55955
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT55955%27 HTTP/1.1" 200 None
2026-03-28 18:45:42 [auto1.de] INFO: Scrape type for BT55955: 1
2026-03-28 18:45:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8d81404-a69a-5e91-a69e-19f501055c15 with identifier: TM08126
2026-03-28 18:45:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8d81404-a69a-5e91-a69e-19f501055c15 with identifier: TM08126
2026-03-28 18:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8d81404-a69a-5e91-a69e-19f501055c15 with identifier: TM08126 to the API
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:48:33Z',
 'fuel_type': 'diesel',
 'id': 'f8d81404-a69a-5e91-a69e-19f501055c15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM08126',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 127279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-21',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM08126%27 HTTP/1.1" 200 None
2026-03-28 18:45:42 [auto1.de] INFO: Saving data for TM08126: {'auction_closing_time': 1774885713.0, 'created_time': 1773429456.033002, 'last_price_update_time': 1774723542.860139}
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM08126') HTTP/1.1" 204 0
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F6d%252Fdf6d810b6b2d3664ec0d1089cfcef4de%252Fpa%252FGZ70356_d80afa0c7c0b4fd969768656fdadcd2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_d80afa0c7c0b4fd969768656fdadcd2c.jpg not downloaded yet
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fed%252F88ed499a6ac533abd609caa99c22183c%252Fpa%252FRX82336_e834d285df9274eb950116669320826b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_e834d285df9274eb950116669320826b.jpg not downloaded yet
2026-03-28 18:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN29475/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HJ08295/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_4b431d0bc931e247b26ffde3bddc5491.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_e987588b92647a3c7416eaaf4c5e71ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:42 [auto1.de] INFO: Found listing with ID: GZ17275
2026-03-28 18:45:42 [auto1.de] INFO: Found listing with ID: JG89144
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG89144%27 HTTP/1.1" 200 None
2026-03-28 18:45:42 [auto1.de] INFO: Scrape type for JG89144: 2
2026-03-28 18:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b with identifier: JG89144
2026-03-28 18:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b with scrape type 2
2026-03-28 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b with scrape type 2
2026-03-28 18:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b, identifier: JG89144
2026-03-28 18:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_56e2701068e8b191b70c22593062ed35.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:43 [auto1.de] INFO: Found listing with ID: XT21551
2026-03-28 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT21551%27 HTTP/1.1" 200 None
2026-03-28 18:45:43 [auto1.de] INFO: Scrape type for XT21551: 2
2026-03-28 18:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd with identifier: XT21551
2026-03-28 18:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd with scrape type 2
2026-03-28 18:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd with scrape type 2
2026-03-28 18:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd, identifier: XT21551
2026-03-28 18:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b with identifier: JG89144
2026-03-28 18:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b with identifier: JG89144
2026-03-28 18:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b with identifier: JG89144 to the API
2026-03-28 18:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 188,
 'expiration_date': '2026-03-30T15:12:19Z',
 'fuel_type': 'hybrid',
 'id': '54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG89144',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 74429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-18',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Plus 4WD',
 'transmission': 'automatic',
 'trim': 'Plus 4WD',
 'year': 2022}
2026-03-28 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG89144%27 HTTP/1.1" 200 None
2026-03-28 18:45:43 [auto1.de] INFO: Saving data for JG89144: {'auction_closing_time': 1774883539.0, 'created_time': 1774350514.422468, 'last_price_update_time': 1774723543.492747}
2026-03-28 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG89144') HTTP/1.1" 204 0
2026-03-28 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F6d%252Fdf6d810b6b2d3664ec0d1089cfcef4de%252Fpa%252FGZ70356_c298be218fb9cd0849154896d5a4d22d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_c298be218fb9cd0849154896d5a4d22d.jpg not downloaded yet
2026-03-28 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fed%252F88ed499a6ac533abd609caa99c22183c%252Fpa%252FRX82336_6c02703cdb23decb9d594df68e0780ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_6c02703cdb23decb9d594df68e0780ed.jpg not downloaded yet
2026-03-28 18:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX61417> (referer: https://www.auto1.com/v1/car-details-view/FX61417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd with identifier: XT21551
2026-03-28 18:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd with identifier: XT21551
2026-03-28 18:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd with identifier: XT21551 to the API
2026-03-28 18:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:54:23Z',
 'fuel_type': 'diesel',
 'id': '7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT21551',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 198712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-03-19',
 'seller_name': None,
 'title': 'Renault Master 2.2 Diesel L1H1 Basis Kasten RS 3078',
 'transmission': 'manual',
 'trim': 'L1H1 Basis Kasten RS 3078',
 'year': 2001}
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT21551%27 HTTP/1.1" 200 None
2026-03-28 18:45:44 [auto1.de] INFO: Saving data for XT21551: {'auction_closing_time': 1774886063.0, 'created_time': 1774033653.9239, 'last_price_update_time': 1774723544.666936}
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT21551') HTTP/1.1" 204 0
2026-03-28 18:45:44 [auto1.de] INFO: Found listing with ID: GY04691
2026-03-28 18:45:44 [auto1.de] INFO: Found listing with ID: WD20973
2026-03-28 18:45:44 [auto1.de] INFO: Found listing with ID: JD07645
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD07645%27 HTTP/1.1" 200 None
2026-03-28 18:45:44 [auto1.de] INFO: Scrape type for JD07645: 1
2026-03-28 18:45:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_d1f24d2621ad3c27c6d07878e69c036d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:44 [auto1.de] INFO: Found listing with ID: KB45443
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB45443%27 HTTP/1.1" 200 None
2026-03-28 18:45:44 [auto1.de] INFO: Scrape type for KB45443: 1
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F6d%252Fdf6d810b6b2d3664ec0d1089cfcef4de%252Fpa%252FGZ70356_89361981a73dc712e6890085328e3551.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_89361981a73dc712e6890085328e3551.jpg not downloaded yet
2026-03-28 18:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_0925acdc788b5d2782a5215b7554c39a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_e8560d13c75da55fcfe6736077fa9459.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:44 [auto1.de] INFO: Found listing with ID: RN07993
2026-03-28 18:45:44 [auto1.de] INFO: Found listing with ID: NT23997
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT23997%27 HTTP/1.1" 200 None
2026-03-28 18:45:44 [auto1.de] INFO: Scrape type for NT23997: 2
2026-03-28 18:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 373fad9d-b29b-5c67-a972-8aaf4a831613 with identifier: NT23997
2026-03-28 18:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 373fad9d-b29b-5c67-a972-8aaf4a831613 with scrape type 2
2026-03-28 18:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 373fad9d-b29b-5c67-a972-8aaf4a831613 with scrape type 2
2026-03-28 18:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 373fad9d-b29b-5c67-a972-8aaf4a831613, identifier: NT23997
2026-03-28 18:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT47702/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY26931/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546a85d0>
2026-03-28 18:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_543adbdb-a892-5452-8308-8c50f14bfe76/543adbdb-a892-5452-8308-8c50f14bfe76_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fed%252F88ed499a6ac533abd609caa99c22183c%252Fpa%252FRX82336_4b431d0bc931e247b26ffde3bddc5491.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_4b431d0bc931e247b26ffde3bddc5491.jpg saved to cache
2026-03-28 18:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 543adbdb-a892-5452-8308-8c50f14bfe76
2026-03-28 18:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561181d0>
2026-03-28 18:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48827fb7-37ff-5368-b412-b99f8a5b3774/48827fb7-37ff-5368-b412-b99f8a5b3774_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F6d%252Fdf6d810b6b2d3664ec0d1089cfcef4de%252Fpa%252FGZ70356_e987588b92647a3c7416eaaf4c5e71ba.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_e987588b92647a3c7416eaaf4c5e71ba.jpg saved to cache
2026-03-28 18:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48827fb7-37ff-5368-b412-b99f8a5b3774
2026-03-28 18:45:45 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 6014 | hits on page: 40
2026-03-28 18:45:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546de910>
2026-03-28 18:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fd0%252F3dd0d7f60ca1179afcf650cb978ae940%252Fpa%252FKV10415_56e2701068e8b191b70c22593062ed35.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_56e2701068e8b191b70c22593062ed35.jpg saved to cache
2026-03-28 18:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f
2026-03-28 18:45:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a54a8d50-57a9-5560-8e0b-7c12214f2c1f, skipping ID generation
2026-03-28 18:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f with scrape type 1
2026-03-28 18:45:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f sending to next pipeline
2026-03-28 18:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a54a8d50-57a9-5560-8e0b-7c12214f2c1f, identifier: KV10415
2026-03-28 18:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_24e6a4d0fba8168ccc9b240d753e3918.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 373fad9d-b29b-5c67-a972-8aaf4a831613 with identifier: NT23997
2026-03-28 18:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 373fad9d-b29b-5c67-a972-8aaf4a831613 with identifier: NT23997
2026-03-28 18:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 373fad9d-b29b-5c67-a972-8aaf4a831613 with identifier: NT23997 to the API
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:07Z',
 'fuel_type': 'petrol',
 'id': '373fad9d-b29b-5c67-a972-8aaf4a831613',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT23997',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 31835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT23997%27 HTTP/1.1" 200 None
2026-03-28 18:45:45 [auto1.de] INFO: Saving data for NT23997: {'auction_closing_time': 1774882987.0, 'created_time': 1774034818.10009, 'last_price_update_time': 1774723545.580588}
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT23997') HTTP/1.1" 204 0
2026-03-28 18:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a54a8d50-57a9-5560-8e0b-7c12214f2c1f with identifier: KV10415
2026-03-28 18:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a54a8d50-57a9-5560-8e0b-7c12214f2c1f with identifier: KV10415
2026-03-28 18:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a54a8d50-57a9-5560-8e0b-7c12214f2c1f with identifier: KV10415 to the API
2026-03-28 18:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_56e2701068e8b191b70c22593062ed35.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 252,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '4.2L',
 'engine_horse_power': 450,
 'expiration_date': '2026-03-30T15:19:48Z',
 'fuel_type': 'petrol',
 'id': 'a54a8d50-57a9-5560-8e0b-7c12214f2c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV10415',
 'listing': 'auction',
 'location': 'DE, Mainz',
 'make': 'Audi',
 'model': 'RS 5',
 'odometer': 110580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2937063,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5850184a81e9fb322c689d7fc2c12ea1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3120358,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_56e2701068e8b191b70c22593062ed35.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_5006d8a407a9d1826c79002ad340e446.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_1277c04bc2cce8191307bef6de58564f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_4c1712b69a967eab3218550f438f986e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893958,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_837f9261eccd33715705bae16642e8ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_a544aada3e490f08fa6e305212057860.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857656,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_f64b7c7330823b6f5c9f5122808f89c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_cc1929f9dcb252df83eb48ef95ff81c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54a8d50-57a9-5560-8e0b-7c12214f2c1f/a54a8d50-57a9-5560-8e0b-7c12214f2c1f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3390965,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/d0/3dd0d7f60ca1179afcf650cb978ae940/pa/KV10415_9a572ea36111b9cd3e7c8ae363016c30.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi RS 5 4.2 V8 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV10415%27 HTTP/1.1" 200 None
2026-03-28 18:45:46 [auto1.de] INFO: Saving data for KV10415: {'created_time': 1774723546.716694, 'last_price_update_time': 1774723546.716705, 'auction_closing_time': 1774883988.0}
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV10415') HTTP/1.1" 204 0
2026-03-28 18:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_e834d285df9274eb950116669320826b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:46 [auto1.de] INFO: Found listing with ID: EC99072
2026-03-28 18:45:46 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-28 18:45:46 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-28 18:45:46 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX07481%27 HTTP/1.1" 200 None
2026-03-28 18:45:46 [auto1.de] INFO: Scrape type for LX07481: 1
2026-03-28 18:45:46 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-28 18:45:46 [auto1.de] INFO: Found listing with ID: XX47236
2026-03-28 18:45:46 [auto1.de] INFO: Found listing with ID: MA20139
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20139%27 HTTP/1.1" 200 None
2026-03-28 18:45:46 [auto1.de] INFO: Scrape type for MA20139: 1
2026-03-28 18:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fabdf982-017c-5aae-96c8-a83a54311941 with identifier: FX61417
2026-03-28 18:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fabdf982-017c-5aae-96c8-a83a54311941 with scrape type 1
2026-03-28 18:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fabdf982-017c-5aae-96c8-a83a54311941
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F2d%252F592d2bedbe8fadc073de73c588193532%252Fpa%252FFX61417_79fd1f0d1c1668c5d36abff687a0b6a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_79fd1f0d1c1668c5d36abff687a0b6a8.jpg not downloaded yet
2026-03-28 18:45:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454712a10>
2026-03-28 18:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_d1f24d2621ad3c27c6d07878e69c036d.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_d1f24d2621ad3c27c6d07878e69c036d.jpg saved to cache
2026-03-28 18:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67fe3d5d-bcec-5da0-967d-974bce60c94a
2026-03-28 18:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_356d209b97fc4a63dbf35ec3e22a864c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_d80afa0c7c0b4fd969768656fdadcd2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_a35a5e56672be19f712decd7bfc820d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:46 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-28 18:45:46 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-28 18:45:46 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-28 18:45:46 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE09172%27 HTTP/1.1" 200 None
2026-03-28 18:45:46 [auto1.de] INFO: Scrape type for XE09172: 1
2026-03-28 18:45:46 [auto1.de] INFO: Found listing with ID: GK17224
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK17224%27 HTTP/1.1" 200 None
2026-03-28 18:45:46 [auto1.de] INFO: Scrape type for GK17224: 1
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F2d%252F592d2bedbe8fadc073de73c588193532%252Fpa%252FFX61417_edef34b58182fcebd2afe3909f6c6b45.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_edef34b58182fcebd2afe3909f6c6b45.jpg not downloaded yet
2026-03-28 18:45:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563be990>
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9a%252Fec9af22d906740d2954658092c88f892%252Fpa%252FUA53111_0925acdc788b5d2782a5215b7554c39a.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_0925acdc788b5d2782a5215b7554c39a.jpg saved to cache
2026-03-28 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67fe3d5d-bcec-5da0-967d-974bce60c94a
2026-03-28 18:45:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67fe3d5d-bcec-5da0-967d-974bce60c94a, skipping ID generation
2026-03-28 18:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67fe3d5d-bcec-5da0-967d-974bce60c94a with scrape type 1
2026-03-28 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67fe3d5d-bcec-5da0-967d-974bce60c94a sending to next pipeline
2026-03-28 18:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67fe3d5d-bcec-5da0-967d-974bce60c94a, identifier: UA53111
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245605e550>
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_543adbdb-a892-5452-8308-8c50f14bfe76/543adbdb-a892-5452-8308-8c50f14bfe76_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fed%252F88ed499a6ac533abd609caa99c22183c%252Fpa%252FRX82336_e8560d13c75da55fcfe6736077fa9459.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_e8560d13c75da55fcfe6736077fa9459.jpg saved to cache
2026-03-28 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 543adbdb-a892-5452-8308-8c50f14bfe76
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454823110>
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_543adbdb-a892-5452-8308-8c50f14bfe76/543adbdb-a892-5452-8308-8c50f14bfe76_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fed%252F88ed499a6ac533abd609caa99c22183c%252Fpa%252FRX82336_24e6a4d0fba8168ccc9b240d753e3918.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_24e6a4d0fba8168ccc9b240d753e3918.jpg saved to cache
2026-03-28 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 543adbdb-a892-5452-8308-8c50f14bfe76
2026-03-28 18:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67fe3d5d-bcec-5da0-967d-974bce60c94a with identifier: UA53111
2026-03-28 18:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67fe3d5d-bcec-5da0-967d-974bce60c94a with identifier: UA53111
2026-03-28 18:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67fe3d5d-bcec-5da0-967d-974bce60c94a with identifier: UA53111 to the API
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_0925acdc788b5d2782a5215b7554c39a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:41:50Z',
 'fuel_type': 'petrol',
 'id': '67fe3d5d-bcec-5da0-967d-974bce60c94a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA53111',
 'listing': 'auction',
 'location': 'DE, Neufahrn',
 'make': 'Fiat',
 'model': '500',
 'odometer': 98141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2718205,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_0925acdc788b5d2782a5215b7554c39a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_0f21d8d29352ba111ac6ba356843bab0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2806302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_f8bec1bcc4ca5240fe82351091bf92fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2951580,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_a4dbfc354d13fe53491c195bf88c8108.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2677946,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_d1f24d2621ad3c27c6d07878e69c036d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2375965,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_a65fe639e17aec38aa5a81804d241b45.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421777,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_5c8eb95149972e4f12029cc1d6d8296a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2388752,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_7662bd5534e7fb604e2be885f2a0c1e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2592018,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_0e9ac38e7464135143370d9772227b70.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67fe3d5d-bcec-5da0-967d-974bce60c94a/67fe3d5d-bcec-5da0-967d-974bce60c94a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9a/ec9af22d906740d2954658092c88f892/pa/UA53111_c2cc300a567e4750525f5308b4f40477.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2018}
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53111%27 HTTP/1.1" 200 None
2026-03-28 18:45:47 [auto1.de] INFO: Saving data for UA53111: {'created_time': 1774723547.684878, 'last_price_update_time': 1774723547.684888, 'auction_closing_time': 1774885310.0}
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA53111') HTTP/1.1" 204 0
2026-03-28 18:45:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456286690>
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_543adbdb-a892-5452-8308-8c50f14bfe76/543adbdb-a892-5452-8308-8c50f14bfe76_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fed%252F88ed499a6ac533abd609caa99c22183c%252Fpa%252FRX82336_e834d285df9274eb950116669320826b.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_e834d285df9274eb950116669320826b.jpg saved to cache
2026-03-28 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 543adbdb-a892-5452-8308-8c50f14bfe76
2026-03-28 18:45:47 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78231%27 HTTP/1.1" 200 None
2026-03-28 18:45:47 [auto1.de] INFO: Scrape type for ST78231: 1
2026-03-28 18:45:47 [auto1.de] INFO: Found listing with ID: AY24824
2026-03-28 18:45:47 [auto1.de] INFO: Found listing with ID: CE16613
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE16613%27 HTTP/1.1" 200 None
2026-03-28 18:45:47 [auto1.de] INFO: Scrape type for CE16613: 2
2026-03-28 18:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7b4f369-22a1-51b8-afe7-f5c9e85f95b9 with identifier: CE16613
2026-03-28 18:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7b4f369-22a1-51b8-afe7-f5c9e85f95b9 with scrape type 2
2026-03-28 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7b4f369-22a1-51b8-afe7-f5c9e85f95b9 with scrape type 2
2026-03-28 18:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7b4f369-22a1-51b8-afe7-f5c9e85f95b9, identifier: CE16613
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F2d%252F592d2bedbe8fadc073de73c588193532%252Fpa%252FFX61417_f10de48dc1ecb90760cfc0edd24601fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_f10de48dc1ecb90760cfc0edd24601fd.jpg not downloaded yet
2026-03-28 18:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_79743332c66b4d8d05466a61fb822f14.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7b4f369-22a1-51b8-afe7-f5c9e85f95b9 with identifier: CE16613
2026-03-28 18:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7b4f369-22a1-51b8-afe7-f5c9e85f95b9 with identifier: CE16613
2026-03-28 18:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7b4f369-22a1-51b8-afe7-f5c9e85f95b9 with identifier: CE16613 to the API
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:17:45Z',
 'fuel_type': 'diesel',
 'id': 'e7b4f369-22a1-51b8-afe7-f5c9e85f95b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE16613',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 180848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-30',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Pure 2WD',
 'transmission': 'automatic',
 'trim': 'Pure 2WD',
 'year': 2018}
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE16613%27 HTTP/1.1" 200 None
2026-03-28 18:45:48 [auto1.de] INFO: Saving data for CE16613: {'auction_closing_time': 1774883865.0, 'created_time': 1773382196.307138, 'last_price_update_time': 1774723548.680903}
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE16613') HTTP/1.1" 204 0
2026-03-28 18:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546c2e10>
2026-03-28 18:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48827fb7-37ff-5368-b412-b99f8a5b3774/48827fb7-37ff-5368-b412-b99f8a5b3774_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F6d%252Fdf6d810b6b2d3664ec0d1089cfcef4de%252Fpa%252FGZ70356_356d209b97fc4a63dbf35ec3e22a864c.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_356d209b97fc4a63dbf35ec3e22a864c.jpg saved to cache
2026-03-28 18:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48827fb7-37ff-5368-b412-b99f8a5b3774
2026-03-28 18:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454820410>
2026-03-28 18:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48827fb7-37ff-5368-b412-b99f8a5b3774/48827fb7-37ff-5368-b412-b99f8a5b3774_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F6d%252Fdf6d810b6b2d3664ec0d1089cfcef4de%252Fpa%252FGZ70356_d80afa0c7c0b4fd969768656fdadcd2c.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_d80afa0c7c0b4fd969768656fdadcd2c.jpg saved to cache
2026-03-28 18:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48827fb7-37ff-5368-b412-b99f8a5b3774
2026-03-28 18:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b9f10>
2026-03-28 18:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48827fb7-37ff-5368-b412-b99f8a5b3774/48827fb7-37ff-5368-b412-b99f8a5b3774_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F6d%252Fdf6d810b6b2d3664ec0d1089cfcef4de%252Fpa%252FGZ70356_a35a5e56672be19f712decd7bfc820d9.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_a35a5e56672be19f712decd7bfc820d9.jpg saved to cache
2026-03-28 18:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48827fb7-37ff-5368-b412-b99f8a5b3774
2026-03-28 18:45:48 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-28 18:45:48 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-28 18:45:48 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85358%27 HTTP/1.1" 200 None
2026-03-28 18:45:48 [auto1.de] INFO: Scrape type for XX85358: 2
2026-03-28 18:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb189dbb-f026-52c1-9eb2-6b9a78a2e9af with identifier: XX85358
2026-03-28 18:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb189dbb-f026-52c1-9eb2-6b9a78a2e9af with scrape type 2
2026-03-28 18:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb189dbb-f026-52c1-9eb2-6b9a78a2e9af with scrape type 2
2026-03-28 18:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb189dbb-f026-52c1-9eb2-6b9a78a2e9af, identifier: XX85358
2026-03-28 18:45:48 [auto1.de] INFO: Found listing with ID: AK16963
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK16963%27 HTTP/1.1" 200 None
2026-03-28 18:45:48 [auto1.de] INFO: Scrape type for AK16963: 1
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F2d%252F592d2bedbe8fadc073de73c588193532%252Fpa%252FFX61417_f877bd6945e33d490ddc20ee11fb573c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_f877bd6945e33d490ddc20ee11fb573c.jpg not downloaded yet
2026-03-28 18:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_89361981a73dc712e6890085328e3551.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb189dbb-f026-52c1-9eb2-6b9a78a2e9af with identifier: XX85358
2026-03-28 18:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb189dbb-f026-52c1-9eb2-6b9a78a2e9af with identifier: XX85358
2026-03-28 18:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb189dbb-f026-52c1-9eb2-6b9a78a2e9af with identifier: XX85358 to the API
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-30T15:34:47Z',
 'fuel_type': 'diesel',
 'id': 'bb189dbb-f026-52c1-9eb2-6b9a78a2e9af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX85358',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 117753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-02',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 300 d 4MATIC EDITION lang',
 'transmission': 'automatic',
 'trim': '4MATIC EDITION lang',
 'year': 2019}
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85358%27 HTTP/1.1" 200 None
2026-03-28 18:45:49 [auto1.de] INFO: Saving data for XX85358: {'auction_closing_time': 1774884887.0, 'created_time': 1773134522.714017, 'last_price_update_time': 1774723549.299966}
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX85358') HTTP/1.1" 204 0
2026-03-28 18:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_79fd1f0d1c1668c5d36abff687a0b6a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:49 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-28 18:45:49 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY40403%27 HTTP/1.1" 200 None
2026-03-28 18:45:49 [auto1.de] INFO: Scrape type for NY40403: 2
2026-03-28 18:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ff7838-b2a4-5758-8a06-5e2839ec489e with identifier: NY40403
2026-03-28 18:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ff7838-b2a4-5758-8a06-5e2839ec489e with scrape type 2
2026-03-28 18:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72ff7838-b2a4-5758-8a06-5e2839ec489e with scrape type 2
2026-03-28 18:45:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72ff7838-b2a4-5758-8a06-5e2839ec489e, identifier: NY40403
2026-03-28 18:45:49 [auto1.de] INFO: Found listing with ID: PG11291
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG11291%27 HTTP/1.1" 200 None
2026-03-28 18:45:49 [auto1.de] INFO: Scrape type for PG11291: 2
2026-03-28 18:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f00cec89-06e9-5cfd-9204-0cecaa1d8f3f with identifier: PG11291
2026-03-28 18:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f00cec89-06e9-5cfd-9204-0cecaa1d8f3f with scrape type 2
2026-03-28 18:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f00cec89-06e9-5cfd-9204-0cecaa1d8f3f with scrape type 2
2026-03-28 18:45:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f00cec89-06e9-5cfd-9204-0cecaa1d8f3f, identifier: PG11291
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F2d%252F592d2bedbe8fadc073de73c588193532%252Fpa%252FFX61417_d86e91436ccaf4a1500d406712e6713c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_d86e91436ccaf4a1500d406712e6713c.jpg not downloaded yet
2026-03-28 18:45:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b8990>
2026-03-28 18:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_79743332c66b4d8d05466a61fb822f14.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_79743332c66b4d8d05466a61fb822f14.jpg saved to cache
2026-03-28 18:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72
2026-03-28 18:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72ff7838-b2a4-5758-8a06-5e2839ec489e with identifier: NY40403
2026-03-28 18:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72ff7838-b2a4-5758-8a06-5e2839ec489e with identifier: NY40403
2026-03-28 18:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72ff7838-b2a4-5758-8a06-5e2839ec489e with identifier: NY40403 to the API
2026-03-28 18:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:01:21Z',
 'fuel_type': 'petrol',
 'id': '72ff7838-b2a4-5758-8a06-5e2839ec489e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY40403',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 164338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-18',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2011}
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY40403%27 HTTP/1.1" 200 None
2026-03-28 18:45:50 [auto1.de] INFO: Saving data for NY40403: {'auction_closing_time': 1774882881.0, 'created_time': 1773429629.778053, 'last_price_update_time': 1774723550.206925}
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY40403') HTTP/1.1" 204 0
2026-03-28 18:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f00cec89-06e9-5cfd-9204-0cecaa1d8f3f with identifier: PG11291
2026-03-28 18:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f00cec89-06e9-5cfd-9204-0cecaa1d8f3f with identifier: PG11291
2026-03-28 18:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f00cec89-06e9-5cfd-9204-0cecaa1d8f3f with identifier: PG11291 to the API
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:49:27Z',
 'fuel_type': 'diesel',
 'id': 'f00cec89-06e9-5cfd-9204-0cecaa1d8f3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG11291',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 240549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-06',
 'seller_name': None,
 'title': 'Audi Q5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG11291%27 HTTP/1.1" 200 None
2026-03-28 18:45:50 [auto1.de] INFO: Saving data for PG11291: {'auction_closing_time': 1774885767.0, 'created_time': 1773382957.371469, 'last_price_update_time': 1774723550.556442}
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG11291') HTTP/1.1" 204 0
2026-03-28 18:45:50 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY99626%27 HTTP/1.1" 200 None
2026-03-28 18:45:50 [auto1.de] INFO: Scrape type for JY99626: 1
2026-03-28 18:45:50 [auto1.de] INFO: Found listing with ID: HE64708
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE64708%27 HTTP/1.1" 200 None
2026-03-28 18:45:50 [auto1.de] INFO: Scrape type for HE64708: 1
2026-03-28 18:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_f366fc836cce25ec5d77286c57ac14ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245636dd10>
2026-03-28 18:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48827fb7-37ff-5368-b412-b99f8a5b3774/48827fb7-37ff-5368-b412-b99f8a5b3774_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F6d%252Fdf6d810b6b2d3664ec0d1089cfcef4de%252Fpa%252FGZ70356_89361981a73dc712e6890085328e3551.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_89361981a73dc712e6890085328e3551.jpg saved to cache
2026-03-28 18:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48827fb7-37ff-5368-b412-b99f8a5b3774
2026-03-28 18:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b8bd0>
2026-03-28 18:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fabdf982-017c-5aae-96c8-a83a54311941/fabdf982-017c-5aae-96c8-a83a54311941_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F2d%252F592d2bedbe8fadc073de73c588193532%252Fpa%252FFX61417_79fd1f0d1c1668c5d36abff687a0b6a8.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_79fd1f0d1c1668c5d36abff687a0b6a8.jpg saved to cache
2026-03-28 18:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fabdf982-017c-5aae-96c8-a83a54311941
2026-03-28 18:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_e8eab9b86bae44ad0f9396522c4f3ce9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_f10de48dc1ecb90760cfc0edd24601fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:50 [auto1.de] INFO: Found listing with ID: ZK51432
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK51432%27 HTTP/1.1" 200 None
2026-03-28 18:45:50 [auto1.de] INFO: Scrape type for ZK51432: 2
2026-03-28 18:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28b6992e-5985-5e4d-acaf-b4adf17967a3 with identifier: ZK51432
2026-03-28 18:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b6992e-5985-5e4d-acaf-b4adf17967a3 with scrape type 2
2026-03-28 18:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28b6992e-5985-5e4d-acaf-b4adf17967a3 with scrape type 2
2026-03-28 18:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28b6992e-5985-5e4d-acaf-b4adf17967a3, identifier: ZK51432
2026-03-28 18:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28b6992e-5985-5e4d-acaf-b4adf17967a3 with identifier: ZK51432
2026-03-28 18:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28b6992e-5985-5e4d-acaf-b4adf17967a3 with identifier: ZK51432
2026-03-28 18:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28b6992e-5985-5e4d-acaf-b4adf17967a3 with identifier: ZK51432 to the API
2026-03-28 18:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:03:40Z',
 'fuel_type': 'diesel',
 'id': '28b6992e-5985-5e4d-acaf-b4adf17967a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK51432',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 278791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-01',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2015}
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK51432%27 HTTP/1.1" 200 None
2026-03-28 18:45:51 [auto1.de] INFO: Saving data for ZK51432: {'auction_closing_time': 1774883020.0, 'created_time': 1773429036.749465, 'last_price_update_time': 1774723551.137328}
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK51432') HTTP/1.1" 204 0
2026-03-28 18:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_f877bd6945e33d490ddc20ee11fb573c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:51 [auto1.de] INFO: Found listing with ID: JR48888
2026-03-28 18:45:51 [auto1.de] INFO: Found listing with ID: JU28029
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU28029%27 HTTP/1.1" 200 None
2026-03-28 18:45:51 [auto1.de] INFO: Scrape type for JU28029: 1
2026-03-28 18:45:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245603f5d0>
2026-03-28 18:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F37%252F6e37b1221b578c8a1d029d22866bbe99%252Fpa%252FZB09378_f366fc836cce25ec5d77286c57ac14ce.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_f366fc836cce25ec5d77286c57ac14ce.jpg saved to cache
2026-03-28 18:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72
2026-03-28 18:45:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99765fec-567f-56f4-8f1d-a2ea5e2c6c72, skipping ID generation
2026-03-28 18:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72 with scrape type 1
2026-03-28 18:45:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72 sending to next pipeline
2026-03-28 18:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99765fec-567f-56f4-8f1d-a2ea5e2c6c72, identifier: ZB09378
2026-03-28 18:45:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454773f90>
2026-03-28 18:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_e8eab9b86bae44ad0f9396522c4f3ce9.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_e8eab9b86bae44ad0f9396522c4f3ce9.jpg saved to cache
2026-03-28 18:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512
2026-03-28 18:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245476d250>
2026-03-28 18:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fabdf982-017c-5aae-96c8-a83a54311941/fabdf982-017c-5aae-96c8-a83a54311941_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F2d%252F592d2bedbe8fadc073de73c588193532%252Fpa%252FFX61417_f10de48dc1ecb90760cfc0edd24601fd.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_f10de48dc1ecb90760cfc0edd24601fd.jpg saved to cache
2026-03-28 18:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fabdf982-017c-5aae-96c8-a83a54311941
2026-03-28 18:45:51 [auto1.de] INFO: Found listing with ID: WX17645
2026-03-28 18:45:51 [auto1.de] INFO: Found listing with ID: BE75867
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE75867%27 HTTP/1.1" 200 None
2026-03-28 18:45:51 [auto1.de] INFO: Scrape type for BE75867: 1
2026-03-28 18:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA20139/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99765fec-567f-56f4-8f1d-a2ea5e2c6c72 with identifier: ZB09378
2026-03-28 18:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99765fec-567f-56f4-8f1d-a2ea5e2c6c72 with identifier: ZB09378
2026-03-28 18:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99765fec-567f-56f4-8f1d-a2ea5e2c6c72 with identifier: ZB09378 to the API
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_f366fc836cce25ec5d77286c57ac14ce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:17:27Z',
 'fuel_type': 'petrol',
 'id': '99765fec-567f-56f4-8f1d-a2ea5e2c6c72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB09378',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 115383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2836495,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_79743332c66b4d8d05466a61fb822f14.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_1a9b7593fdac6efdd9afef581d6ad57e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_ee746219ae17ef22ab31235042b967bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2840673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_f366fc836cce25ec5d77286c57ac14ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_f0d54cd307c6be015a13b7fe1cc3a379.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_d54754ddc918b9bb92cdd7bdc0c78964.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_26eba132e20920f7e7b3cb4aa5a202fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_c927da1bac80f86b5d75ea7c6d9c5f33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_8a8e4dd3a3822f64c85ad9ac1327a0ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99765fec-567f-56f4-8f1d-a2ea5e2c6c72/99765fec-567f-56f4-8f1d-a2ea5e2c6c72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/37/6e37b1221b578c8a1d029d22866bbe99/pa/ZB09378_a857de352bee4f189daa329234fd2050.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman One',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB09378%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [auto1.de] INFO: Saving data for ZB09378: {'created_time': 1774723552.017932, 'last_price_update_time': 1774723552.017944, 'auction_closing_time': 1774883847.0}
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB09378') HTTP/1.1" 204 0
2026-03-28 18:45:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:52 [auto1.de] INFO: Found listing with ID: FP27721
2026-03-28 18:45:52 [auto1.de] INFO: Found listing with ID: KV56642
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56642%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [auto1.de] INFO: Scrape type for KV56642: 1
2026-03-28 18:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP14986/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT55955/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN29475> (referer: https://www.auto1.com/v1/car-details-view/HN29475/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HJ08295> (referer: https://www.auto1.com/v1/car-details-view/HJ08295/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b6b10>
2026-03-28 18:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fabdf982-017c-5aae-96c8-a83a54311941/fabdf982-017c-5aae-96c8-a83a54311941_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F2d%252F592d2bedbe8fadc073de73c588193532%252Fpa%252FFX61417_f877bd6945e33d490ddc20ee11fb573c.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_f877bd6945e33d490ddc20ee11fb573c.jpg saved to cache
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fabdf982-017c-5aae-96c8-a83a54311941
2026-03-28 18:45:52 [auto1.de] INFO: Found listing with ID: KC60426
2026-03-28 18:45:52 [auto1.de] INFO: Found listing with ID: ZU41188
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU41188%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [auto1.de] INFO: Scrape type for ZU41188: 2
2026-03-28 18:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd0b8bf2-ccaa-5116-9216-647e1db47f82 with identifier: ZU41188
2026-03-28 18:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd0b8bf2-ccaa-5116-9216-647e1db47f82 with scrape type 2
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd0b8bf2-ccaa-5116-9216-647e1db47f82 with scrape type 2
2026-03-28 18:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd0b8bf2-ccaa-5116-9216-647e1db47f82, identifier: ZU41188
2026-03-28 18:45:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd0b8bf2-ccaa-5116-9216-647e1db47f82 with identifier: ZU41188
2026-03-28 18:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd0b8bf2-ccaa-5116-9216-647e1db47f82 with identifier: ZU41188
2026-03-28 18:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd0b8bf2-ccaa-5116-9216-647e1db47f82 with identifier: ZU41188 to the API
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:49:05Z',
 'fuel_type': 'petrol',
 'id': 'cd0b8bf2-ccaa-5116-9216-647e1db47f82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU41188',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 272567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU41188%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [auto1.de] INFO: Saving data for ZU41188: {'auction_closing_time': 1774885745.0, 'created_time': 1773429336.954809, 'last_price_update_time': 1774723552.566733}
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU41188') HTTP/1.1" 204 0
2026-03-28 18:45:52 [auto1.de] INFO: Found listing with ID: VD40849
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD40849%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [auto1.de] INFO: Scrape type for VD40849: 1
2026-03-28 18:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_edef34b58182fcebd2afe3909f6c6b45.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_d86e91436ccaf4a1500d406712e6713c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:52 [auto1.de] INFO: Found listing with ID: EL78604
2026-03-28 18:45:52 [auto1.de] INFO: Found listing with ID: ZA94641
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA94641%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [auto1.de] INFO: Scrape type for ZA94641: 1
2026-03-28 18:45:52 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 6014 | hits on page: 40
2026-03-28 18:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 306d745b-ac05-5f2c-a67f-64b41a8efc39 with identifier: HN29475
2026-03-28 18:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306d745b-ac05-5f2c-a67f-64b41a8efc39 with scrape type 1
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 306d745b-ac05-5f2c-a67f-64b41a8efc39
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5a7c13c2c61b9471ac7dee5a28f0f2%252Fpa%252FHN29475_cc637508070fe649f4be8e4698b87092.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_cc637508070fe649f4be8e4698b87092.jpg not downloaded yet
2026-03-28 18:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dc64e49-56b2-53bd-88c6-a84311c425b1 with identifier: HJ08295
2026-03-28 18:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dc64e49-56b2-53bd-88c6-a84311c425b1 with scrape type 1
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4dc64e49-56b2-53bd-88c6-a84311c425b1
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_f0e182d347ba1dd3069740f9f287b9d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_f0e182d347ba1dd3069740f9f287b9d9.jpg not downloaded yet
2026-03-28 18:45:52 [auto1.de] INFO: Found listing with ID: YL33228
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL33228%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [auto1.de] INFO: Scrape type for YL33228: 1
2026-03-28 18:45:52 [auto1.de] INFO: Found listing with ID: AX34662
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34662%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [auto1.de] INFO: Scrape type for AX34662: 1
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5a7c13c2c61b9471ac7dee5a28f0f2%252Fpa%252FHN29475_685e0c954c3588755e6b9b60467cc713.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_685e0c954c3588755e6b9b60467cc713.jpg not downloaded yet
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_7f074354e1f4001da2397845bd68e7e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_7f074354e1f4001da2397845bd68e7e9.jpg not downloaded yet
2026-03-28 18:45:52 [auto1.de] INFO: Found listing with ID: XU87047
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU87047%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [auto1.de] INFO: Scrape type for XU87047: 1
2026-03-28 18:45:52 [auto1.de] INFO: Found listing with ID: VP32069
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP32069%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [auto1.de] INFO: Scrape type for VP32069: 1
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5a7c13c2c61b9471ac7dee5a28f0f2%252Fpa%252FHN29475_52702d5498dcd9afb7db1c727383e2ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_52702d5498dcd9afb7db1c727383e2ff.jpg not downloaded yet
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_6ce86f5d4643b130069ac837a65ed50b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_6ce86f5d4643b130069ac837a65ed50b.jpg not downloaded yet
2026-03-28 18:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245481de50>
2026-03-28 18:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fabdf982-017c-5aae-96c8-a83a54311941/fabdf982-017c-5aae-96c8-a83a54311941_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F2d%252F592d2bedbe8fadc073de73c588193532%252Fpa%252FFX61417_edef34b58182fcebd2afe3909f6c6b45.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_edef34b58182fcebd2afe3909f6c6b45.jpg saved to cache
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fabdf982-017c-5aae-96c8-a83a54311941
2026-03-28 18:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563eaf50>
2026-03-28 18:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fabdf982-017c-5aae-96c8-a83a54311941/fabdf982-017c-5aae-96c8-a83a54311941_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F2d%252F592d2bedbe8fadc073de73c588193532%252Fpa%252FFX61417_d86e91436ccaf4a1500d406712e6713c.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_d86e91436ccaf4a1500d406712e6713c.jpg saved to cache
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fabdf982-017c-5aae-96c8-a83a54311941
2026-03-28 18:45:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fabdf982-017c-5aae-96c8-a83a54311941, skipping ID generation
2026-03-28 18:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fabdf982-017c-5aae-96c8-a83a54311941 with scrape type 1
2026-03-28 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fabdf982-017c-5aae-96c8-a83a54311941 sending to next pipeline
2026-03-28 18:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fabdf982-017c-5aae-96c8-a83a54311941, identifier: FX61417
2026-03-28 18:45:53 [auto1.de] INFO: Found listing with ID: KP52427
2026-03-28 18:45:53 [auto1.de] INFO: Found listing with ID: GW71090
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW71090%27 HTTP/1.1" 200 None
2026-03-28 18:45:53 [auto1.de] INFO: Scrape type for GW71090: 2
2026-03-28 18:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58c3be50-9bc5-5850-b8d4-19b00c019d78 with identifier: GW71090
2026-03-28 18:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58c3be50-9bc5-5850-b8d4-19b00c019d78 with scrape type 2
2026-03-28 18:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58c3be50-9bc5-5850-b8d4-19b00c019d78 with scrape type 2
2026-03-28 18:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58c3be50-9bc5-5850-b8d4-19b00c019d78, identifier: GW71090
2026-03-28 18:45:53 [auto1.de] INFO: Found listing with ID: ZU11253
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU11253%27 HTTP/1.1" 200 None
2026-03-28 18:45:53 [auto1.de] INFO: Scrape type for ZU11253: 1
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5a7c13c2c61b9471ac7dee5a28f0f2%252Fpa%252FHN29475_42a3a16de2fd5f01a91dcc1ede86a76c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_42a3a16de2fd5f01a91dcc1ede86a76c.jpg not downloaded yet
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_f21c09b1c565661180fe71a777509405.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_f21c09b1c565661180fe71a777509405.jpg not downloaded yet
2026-03-28 18:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fabdf982-017c-5aae-96c8-a83a54311941 with identifier: FX61417
2026-03-28 18:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fabdf982-017c-5aae-96c8-a83a54311941 with identifier: FX61417
2026-03-28 18:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fabdf982-017c-5aae-96c8-a83a54311941 with identifier: FX61417 to the API
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_d86e91436ccaf4a1500d406712e6713c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:27:30Z',
 'fuel_type': 'petrol',
 'id': 'fabdf982-017c-5aae-96c8-a83a54311941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX61417',
 'listing': 'auction',
 'location': 'DE, Bocholt',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 153832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fabdf982-017c-5aae-96c8-a83a54311941/fabdf982-017c-5aae-96c8-a83a54311941_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_79fd1f0d1c1668c5d36abff687a0b6a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fabdf982-017c-5aae-96c8-a83a54311941/fabdf982-017c-5aae-96c8-a83a54311941_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_edef34b58182fcebd2afe3909f6c6b45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fabdf982-017c-5aae-96c8-a83a54311941/fabdf982-017c-5aae-96c8-a83a54311941_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_f10de48dc1ecb90760cfc0edd24601fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fabdf982-017c-5aae-96c8-a83a54311941/fabdf982-017c-5aae-96c8-a83a54311941_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_f877bd6945e33d490ddc20ee11fb573c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fabdf982-017c-5aae-96c8-a83a54311941/fabdf982-017c-5aae-96c8-a83a54311941_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/2d/592d2bedbe8fadc073de73c588193532/pa/FX61417_d86e91436ccaf4a1500d406712e6713c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Style Edition',
 'transmission': 'manual',
 'trim': 'Style Edition',
 'year': 2009}
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX61417%27 HTTP/1.1" 200 None
2026-03-28 18:45:53 [auto1.de] INFO: Saving data for FX61417: {'created_time': 1774723553.561912, 'last_price_update_time': 1774723553.561923, 'auction_closing_time': 1774884450.0}
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX61417') HTTP/1.1" 204 0
2026-03-28 18:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58c3be50-9bc5-5850-b8d4-19b00c019d78 with identifier: GW71090
2026-03-28 18:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58c3be50-9bc5-5850-b8d4-19b00c019d78 with identifier: GW71090
2026-03-28 18:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58c3be50-9bc5-5850-b8d4-19b00c019d78 with identifier: GW71090 to the API
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:51:01Z',
 'fuel_type': 'petrol',
 'id': '58c3be50-9bc5-5850-b8d4-19b00c019d78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW71090',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 138088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CGI T BlueEfficiency Elegance',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Elegance',
 'year': 2012}
2026-03-28 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW71090%27 HTTP/1.1" 200 None
2026-03-28 18:45:54 [auto1.de] INFO: Saving data for GW71090: {'auction_closing_time': 1774885861.0, 'created_time': 1774033896.424223, 'last_price_update_time': 1774723554.001921}
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW71090') HTTP/1.1" 204 0
2026-03-28 18:45:54 [auto1.de] INFO: Found listing with ID: UZ60031
2026-03-28 18:45:54 [auto1.de] INFO: Found listing with ID: FD59666
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD59666%27 HTTP/1.1" 200 None
2026-03-28 18:45:54 [auto1.de] INFO: Scrape type for FD59666: 1
2026-03-28 18:45:54 [auto1.de] INFO: Found listing with ID: ZN38550
2026-03-28 18:45:54 [auto1.de] INFO: Found listing with ID: TR40985
2026-03-28 18:45:54 [auto1.de] INFO: Found listing with ID: BW25069
2026-03-28 18:45:54 [auto1.de] INFO: Found listing with ID: UH14714
2026-03-28 18:45:54 [auto1.de] INFO: Found listing with ID: WR70011
2026-03-28 18:45:54 [auto1.de] INFO: Found listing with ID: FL42692
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL42692%27 HTTP/1.1" 200 None
2026-03-28 18:45:54 [auto1.de] INFO: Scrape type for FL42692: 2
2026-03-28 18:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324 with identifier: FL42692
2026-03-28 18:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324 with scrape type 2
2026-03-28 18:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324 with scrape type 2
2026-03-28 18:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324, identifier: FL42692
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5a7c13c2c61b9471ac7dee5a28f0f2%252Fpa%252FHN29475_e2392162e516dd8f61f69b954c2afd96.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_e2392162e516dd8f61f69b954c2afd96.jpg not downloaded yet
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_70ccf782d51eb06a77ddaf05ae587df2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_70ccf782d51eb06a77ddaf05ae587df2.jpg not downloaded yet
2026-03-28 18:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST78231/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE75867/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB45443/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324 with identifier: FL42692
2026-03-28 18:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324 with identifier: FL42692
2026-03-28 18:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324 with identifier: FL42692 to the API
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:18:44Z',
 'fuel_type': 'petrol',
 'id': '1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL42692',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 111710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-20',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2011}
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL42692%27 HTTP/1.1" 200 None
2026-03-28 18:45:54 [auto1.de] INFO: Saving data for FL42692: {'auction_closing_time': 1774883924.0, 'created_time': 1774034207.713334, 'last_price_update_time': 1774723554.567046}
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL42692') HTTP/1.1" 204 0
2026-03-28 18:45:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:54 [auto1.de] INFO: Found listing with ID: YP26052
2026-03-28 18:45:54 [auto1.de] INFO: Found listing with ID: UW39915
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39915%27 HTTP/1.1" 200 None
2026-03-28 18:45:54 [auto1.de] INFO: Scrape type for UW39915: 1
2026-03-28 18:45:54 [auto1.de] INFO: Found listing with ID: UP55636
2026-03-28 18:45:54 [auto1.de] INFO: Found listing with ID: EP24311
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP24311%27 HTTP/1.1" 200 None
2026-03-28 18:45:54 [auto1.de] INFO: Scrape type for EP24311: 2
2026-03-28 18:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25c17e22-9a09-5f02-90bf-bca8d077c6f1 with identifier: EP24311
2026-03-28 18:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25c17e22-9a09-5f02-90bf-bca8d077c6f1 with scrape type 2
2026-03-28 18:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25c17e22-9a09-5f02-90bf-bca8d077c6f1 with scrape type 2
2026-03-28 18:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25c17e22-9a09-5f02-90bf-bca8d077c6f1, identifier: EP24311
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5a7c13c2c61b9471ac7dee5a28f0f2%252Fpa%252FHN29475_8e4ce6e74b9b2e2e6973581777b30403.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_8e4ce6e74b9b2e2e6973581777b30403.jpg not downloaded yet
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_b2ec3042ad7a4b247932a294410d8dd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_b2ec3042ad7a4b247932a294410d8dd0.jpg not downloaded yet
2026-03-28 18:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX88157> (referer: https://www.auto1.com/v1/car-details-view/UX88157/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD07645/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25c17e22-9a09-5f02-90bf-bca8d077c6f1 with identifier: EP24311
2026-03-28 18:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25c17e22-9a09-5f02-90bf-bca8d077c6f1 with identifier: EP24311
2026-03-28 18:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25c17e22-9a09-5f02-90bf-bca8d077c6f1 with identifier: EP24311 to the API
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:55:09Z',
 'fuel_type': 'diesel',
 'id': '25c17e22-9a09-5f02-90bf-bca8d077c6f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP24311',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 191034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-17',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP24311%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [auto1.de] INFO: Saving data for EP24311: {'auction_closing_time': 1774886109.0, 'created_time': 1774034541.280974, 'last_price_update_time': 1774723555.089428}
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP24311') HTTP/1.1" 204 0
2026-03-28 18:45:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: GC53202
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC53202%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [auto1.de] INFO: Scrape type for GC53202: 1
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: ZT83144
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: UY91981
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: AX05001
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX05001%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [auto1.de] INFO: Scrape type for AX05001: 2
2026-03-28 18:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6a9820-49df-551e-95cf-ca254012fb68 with identifier: AX05001
2026-03-28 18:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6a9820-49df-551e-95cf-ca254012fb68 with scrape type 2
2026-03-28 18:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6a9820-49df-551e-95cf-ca254012fb68 with scrape type 2
2026-03-28 18:45:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc6a9820-49df-551e-95cf-ca254012fb68, identifier: AX05001
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_df9ef822de5d93fe3551566095bbfad3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_df9ef822de5d93fe3551566095bbfad3.jpg not downloaded yet
2026-03-28 18:45:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc6a9820-49df-551e-95cf-ca254012fb68 with identifier: AX05001
2026-03-28 18:45:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc6a9820-49df-551e-95cf-ca254012fb68 with identifier: AX05001
2026-03-28 18:45:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc6a9820-49df-551e-95cf-ca254012fb68 with identifier: AX05001 to the API
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:18:49Z',
 'fuel_type': 'diesel',
 'id': 'bc6a9820-49df-551e-95cf-ca254012fb68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX05001',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 251476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-14',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency Classic',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Classic',
 'year': 2013}
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX05001%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [auto1.de] INFO: Saving data for AX05001: {'auction_closing_time': 1774883929.0, 'created_time': 1774350033.185443, 'last_price_update_time': 1774723555.681459}
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX05001') HTTP/1.1" 204 0
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: RF84100
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF84100%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [auto1.de] INFO: Scrape type for RF84100: 1
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: LT27218
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT27218%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [auto1.de] INFO: Scrape type for LT27218: 1
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_8404ff1b96eb424fd7f1961e0bd296e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_8404ff1b96eb424fd7f1961e0bd296e3.jpg not downloaded yet
2026-03-28 18:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU28029/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_42a3a16de2fd5f01a91dcc1ede86a76c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88930ba8-f3d1-5c62-81dc-0c30afb5557a with identifier: UX88157
2026-03-28 18:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a with scrape type 1
2026-03-28 18:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_60d3fc7e5796e43c551fe38b378c95a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_60d3fc7e5796e43c551fe38b378c95a5.jpg not downloaded yet
2026-03-28 18:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_e2392162e516dd8f61f69b954c2afd96.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: BW84058
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW84058%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [auto1.de] INFO: Scrape type for BW84058: 1
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: TG23617
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG23617%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [auto1.de] INFO: Scrape type for TG23617: 1
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_ca1cfce9aac167ada7775b7e08cd9261.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_ca1cfce9aac167ada7775b7e08cd9261.jpg not downloaded yet
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_09c0a6e66820eb1a5833d932fab4c68e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_09c0a6e66820eb1a5833d932fab4c68e.jpg not downloaded yet
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: WJ96014
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ96014%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [auto1.de] INFO: Scrape type for WJ96014: 1
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: DL01383
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL01383%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [auto1.de] INFO: Scrape type for DL01383: 1
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_bfaa74e3fac0fa6bac124dba4bff8ef8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_bfaa74e3fac0fa6bac124dba4bff8ef8.jpg not downloaded yet
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_c5348fc30f9738cfae88fd5943c54814.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_c5348fc30f9738cfae88fd5943c54814.jpg not downloaded yet
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: UX04638
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: XT42092
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: ER27214
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: VK18000
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK18000%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [auto1.de] INFO: Scrape type for VK18000: 1
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: VR01975
2026-03-28 18:45:55 [auto1.de] INFO: Found listing with ID: BC68366
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC68366%27 HTTP/1.1" 200 None
2026-03-28 18:45:55 [auto1.de] INFO: Scrape type for BC68366: 1
2026-03-28 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_5365864a9c6d6de217154cc1fc5ba0d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_5365864a9c6d6de217154cc1fc5ba0d6.jpg not downloaded yet
2026-03-28 18:45:56 [auto1.de] INFO: Found listing with ID: ZJ88951
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ88951%27 HTTP/1.1" 200 None
2026-03-28 18:45:56 [auto1.de] INFO: Scrape type for ZJ88951: 1
2026-03-28 18:45:56 [auto1.de] INFO: Found listing with ID: UW30616
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW30616%27 HTTP/1.1" 200 None
2026-03-28 18:45:56 [auto1.de] INFO: Scrape type for UW30616: 2
2026-03-28 18:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8918ef92-fdc9-502b-a6bc-bd5891d02749 with identifier: UW30616
2026-03-28 18:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8918ef92-fdc9-502b-a6bc-bd5891d02749 with scrape type 2
2026-03-28 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8918ef92-fdc9-502b-a6bc-bd5891d02749 with scrape type 2
2026-03-28 18:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8918ef92-fdc9-502b-a6bc-bd5891d02749, identifier: UW30616
2026-03-28 18:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245463c4d0>
2026-03-28 18:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d745b-ac05-5f2c-a67f-64b41a8efc39/306d745b-ac05-5f2c-a67f-64b41a8efc39_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5a7c13c2c61b9471ac7dee5a28f0f2%252Fpa%252FHN29475_42a3a16de2fd5f01a91dcc1ede86a76c.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_42a3a16de2fd5f01a91dcc1ede86a76c.jpg saved to cache
2026-03-28 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 306d745b-ac05-5f2c-a67f-64b41a8efc39
2026-03-28 18:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855a550>
2026-03-28 18:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d745b-ac05-5f2c-a67f-64b41a8efc39/306d745b-ac05-5f2c-a67f-64b41a8efc39_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5a7c13c2c61b9471ac7dee5a28f0f2%252Fpa%252FHN29475_e2392162e516dd8f61f69b954c2afd96.jpg') HTTP/1.1" 204 0
2026-03-28 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_e2392162e516dd8f61f69b954c2afd96.jpg saved to cache
2026-03-28 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 306d745b-ac05-5f2c-a67f-64b41a8efc39
2026-03-28 18:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8918ef92-fdc9-502b-a6bc-bd5891d02749 with identifier: UW30616
2026-03-28 18:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8918ef92-fdc9-502b-a6bc-bd5891d02749 with identifier: UW30616
2026-03-28 18:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8918ef92-fdc9-502b-a6bc-bd5891d02749 with identifier: UW30616 to the API
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:14:47Z',
 'fuel_type': 'petrol',
 'id': '8918ef92-fdc9-502b-a6bc-bd5891d02749',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW30616',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 51995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-26',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2019}
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW30616%27 HTTP/1.1" 200 None
2026-03-28 18:45:56 [auto1.de] INFO: Saving data for UW30616: {'auction_closing_time': 1774883687.0, 'created_time': 1774035517.045109, 'last_price_update_time': 1774723556.529231}
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW30616') HTTP/1.1" 204 0
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_bde3eb9e4761cd5a9ecd4f83987cef27.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_bde3eb9e4761cd5a9ecd4f83987cef27.jpg not downloaded yet
2026-03-28 18:45:56 [auto1.de] INFO: Found listing with ID: DS51520
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS51520%27 HTTP/1.1" 200 None
2026-03-28 18:45:56 [auto1.de] INFO: Scrape type for DS51520: 1
2026-03-28 18:45:56 [auto1.de] INFO: Found listing with ID: RT08508
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT08508%27 HTTP/1.1" 200 None
2026-03-28 18:45:56 [auto1.de] INFO: Scrape type for RT08508: 1
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_cc9fb8a2187b1b225c1472e822d9a75c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_cc9fb8a2187b1b225c1472e822d9a75c.jpg not downloaded yet
2026-03-28 18:45:56 [auto1.de] INFO: Found listing with ID: DU68074
2026-03-28 18:45:56 [auto1.de] INFO: Found listing with ID: HL66974
2026-03-28 18:45:56 [auto1.de] INFO: Found listing with ID: CJ73141
2026-03-28 18:45:56 [auto1.de] INFO: Found listing with ID: LT88740
2026-03-28 18:45:56 [auto1.de] INFO: Found listing with ID: FE36611
2026-03-28 18:45:56 [auto1.de] INFO: Found listing with ID: MY97693
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97693%27 HTTP/1.1" 200 None
2026-03-28 18:45:56 [auto1.de] INFO: Scrape type for MY97693: 2
2026-03-28 18:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8af4f20-92eb-53f6-834a-887f17c7cdc6 with identifier: MY97693
2026-03-28 18:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8af4f20-92eb-53f6-834a-887f17c7cdc6 with scrape type 2
2026-03-28 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8af4f20-92eb-53f6-834a-887f17c7cdc6 with scrape type 2
2026-03-28 18:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8af4f20-92eb-53f6-834a-887f17c7cdc6, identifier: MY97693
2026-03-28 18:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE64708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY99626/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK16963/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8af4f20-92eb-53f6-834a-887f17c7cdc6 with identifier: MY97693
2026-03-28 18:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8af4f20-92eb-53f6-834a-887f17c7cdc6 with identifier: MY97693
2026-03-28 18:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8af4f20-92eb-53f6-834a-887f17c7cdc6 with identifier: MY97693 to the API
2026-03-28 18:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:40:48Z',
 'fuel_type': 'petrol',
 'id': 'f8af4f20-92eb-53f6-834a-887f17c7cdc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY97693',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 153806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-22',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 1.5 T-MIVEC Intro Edition 2WD',
 'transmission': 'automatic',
 'trim': 'Intro Edition 2WD',
 'year': 2018}
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97693%27 HTTP/1.1" 200 None
2026-03-28 18:45:57 [auto1.de] INFO: Saving data for MY97693: {'auction_closing_time': 1774885248.0, 'created_time': 1774118741.763671, 'last_price_update_time': 1774723557.172911}
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY97693') HTTP/1.1" 204 0
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_9d151a138a9e4ad5d99a5abf641a3b2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_9d151a138a9e4ad5d99a5abf641a3b2c.jpg not downloaded yet
2026-03-28 18:45:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:57 [auto1.de] INFO: Found listing with ID: VH99628
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH99628%27 HTTP/1.1" 200 None
2026-03-28 18:45:57 [auto1.de] INFO: Scrape type for VH99628: 2
2026-03-28 18:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5616018b-c486-5e20-816b-33a80e3313dc with identifier: VH99628
2026-03-28 18:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5616018b-c486-5e20-816b-33a80e3313dc with scrape type 2
2026-03-28 18:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5616018b-c486-5e20-816b-33a80e3313dc with scrape type 2
2026-03-28 18:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5616018b-c486-5e20-816b-33a80e3313dc, identifier: VH99628
2026-03-28 18:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5616018b-c486-5e20-816b-33a80e3313dc with identifier: VH99628
2026-03-28 18:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5616018b-c486-5e20-816b-33a80e3313dc with identifier: VH99628
2026-03-28 18:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5616018b-c486-5e20-816b-33a80e3313dc with identifier: VH99628 to the API
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:30:13Z',
 'fuel_type': 'petrol',
 'id': '5616018b-c486-5e20-816b-33a80e3313dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH99628',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 154229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-10',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH99628%27 HTTP/1.1" 200 None
2026-03-28 18:45:57 [auto1.de] INFO: Saving data for VH99628: {'auction_closing_time': 1774884613.0, 'created_time': 1774002008.320632, 'last_price_update_time': 1774723557.659828}
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH99628') HTTP/1.1" 204 0
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_9d1f6c466f9117642b6302e273b6e855.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_9d1f6c466f9117642b6302e273b6e855.jpg not downloaded yet
2026-03-28 18:45:57 [auto1.de] INFO: Found listing with ID: ST78057
2026-03-28 18:45:57 [auto1.de] INFO: Found listing with ID: HD58306
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD58306%27 HTTP/1.1" 200 None
2026-03-28 18:45:57 [auto1.de] INFO: Scrape type for HD58306: 2
2026-03-28 18:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34849c93-8de4-58cc-b981-ea09fe9827ab with identifier: HD58306
2026-03-28 18:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34849c93-8de4-58cc-b981-ea09fe9827ab with scrape type 2
2026-03-28 18:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34849c93-8de4-58cc-b981-ea09fe9827ab with scrape type 2
2026-03-28 18:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34849c93-8de4-58cc-b981-ea09fe9827ab, identifier: HD58306
2026-03-28 18:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY26931> (referer: https://www.auto1.com/v1/car-details-view/BY26931/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34849c93-8de4-58cc-b981-ea09fe9827ab with identifier: HD58306
2026-03-28 18:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34849c93-8de4-58cc-b981-ea09fe9827ab with identifier: HD58306
2026-03-28 18:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34849c93-8de4-58cc-b981-ea09fe9827ab with identifier: HD58306 to the API
2026-03-28 18:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:58Z',
 'fuel_type': 'petrol',
 'id': '34849c93-8de4-58cc-b981-ea09fe9827ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD58306',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 127420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-25',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD58306%27 HTTP/1.1" 200 None
2026-03-28 18:45:58 [auto1.de] INFO: Saving data for HD58306: {'auction_closing_time': 1774885978.0, 'created_time': 1773399368.953574, 'last_price_update_time': 1774723558.141792}
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD58306') HTTP/1.1" 204 0
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_1940a9b0eaea1b30e37d05e807550c17.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_1940a9b0eaea1b30e37d05e807550c17.jpg not downloaded yet
2026-03-28 18:45:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:58 [auto1.de] INFO: Found listing with ID: PV80087
2026-03-28 18:45:58 [auto1.de] INFO: Found listing with ID: KY32435
2026-03-28 18:45:58 [auto1.de] INFO: Found listing with ID: BE46966
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE46966%27 HTTP/1.1" 200 None
2026-03-28 18:45:58 [auto1.de] INFO: Scrape type for BE46966: 1
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_0e05d4cc12f178763b105a9b99f197d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_0e05d4cc12f178763b105a9b99f197d0.jpg not downloaded yet
2026-03-28 18:45:58 [auto1.de] INFO: Found listing with ID: ZZ46464
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ46464%27 HTTP/1.1" 200 None
2026-03-28 18:45:58 [auto1.de] INFO: Scrape type for ZZ46464: 1
2026-03-28 18:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3e17ed1-4c2d-5272-b421-ecf43bfb7a25 with identifier: BY26931
2026-03-28 18:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25 with scrape type 1
2026-03-28 18:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_93b385d788a4649ddf5508c4e941521b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_93b385d788a4649ddf5508c4e941521b.jpg not downloaded yet
2026-03-28 18:45:58 [auto1.de] INFO: Found listing with ID: PY07739
2026-03-28 18:45:58 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH73061%27 HTTP/1.1" 200 None
2026-03-28 18:45:58 [auto1.de] INFO: Scrape type for TH73061: 2
2026-03-28 18:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec9407b9-28aa-5667-b9c2-d15ba7e6e75e with identifier: TH73061
2026-03-28 18:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec9407b9-28aa-5667-b9c2-d15ba7e6e75e with scrape type 2
2026-03-28 18:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec9407b9-28aa-5667-b9c2-d15ba7e6e75e with scrape type 2
2026-03-28 18:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec9407b9-28aa-5667-b9c2-d15ba7e6e75e, identifier: TH73061
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_1069aa0e5c63bdb04f613dcb7a7faddb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_1069aa0e5c63bdb04f613dcb7a7faddb.jpg not downloaded yet
2026-03-28 18:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV56642/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec9407b9-28aa-5667-b9c2-d15ba7e6e75e with identifier: TH73061
2026-03-28 18:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec9407b9-28aa-5667-b9c2-d15ba7e6e75e with identifier: TH73061
2026-03-28 18:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec9407b9-28aa-5667-b9c2-d15ba7e6e75e with identifier: TH73061 to the API
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:07:49Z',
 'fuel_type': 'diesel',
 'id': 'ec9407b9-28aa-5667-b9c2-d15ba7e6e75e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH73061',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 164844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-03',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH73061%27 HTTP/1.1" 200 None
2026-03-28 18:45:58 [auto1.de] INFO: Saving data for TH73061: {'auction_closing_time': 1774883269.0, 'created_time': 1773380693.590947, 'last_price_update_time': 1774723558.879282}
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH73061') HTTP/1.1" 204 0
2026-03-28 18:45:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:45:58 [auto1.de] INFO: Found listing with ID: NX87227
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX87227%27 HTTP/1.1" 200 None
2026-03-28 18:45:58 [auto1.de] INFO: Scrape type for NX87227: 2
2026-03-28 18:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a611312a-6fea-53ae-95c2-8c7e2fffb355 with identifier: NX87227
2026-03-28 18:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a611312a-6fea-53ae-95c2-8c7e2fffb355 with scrape type 2
2026-03-28 18:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a611312a-6fea-53ae-95c2-8c7e2fffb355 with scrape type 2
2026-03-28 18:45:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a611312a-6fea-53ae-95c2-8c7e2fffb355, identifier: NX87227
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_91f1c72a20f0796d9f03fd69515f4c7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_91f1c72a20f0796d9f03fd69515f4c7c.jpg not downloaded yet
2026-03-28 18:45:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a611312a-6fea-53ae-95c2-8c7e2fffb355 with identifier: NX87227
2026-03-28 18:45:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a611312a-6fea-53ae-95c2-8c7e2fffb355 with identifier: NX87227
2026-03-28 18:45:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a611312a-6fea-53ae-95c2-8c7e2fffb355 with identifier: NX87227 to the API
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:59:55Z',
 'fuel_type': 'petrol',
 'id': 'a611312a-6fea-53ae-95c2-8c7e2fffb355',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX87227',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 157273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-26',
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 Classic Style',
 'transmission': 'manual',
 'trim': 'Classic Style',
 'year': 2013}
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX87227%27 HTTP/1.1" 200 None
2026-03-28 18:45:59 [auto1.de] INFO: Saving data for NX87227: {'auction_closing_time': 1774886395.0, 'created_time': 1773383484.851309, 'last_price_update_time': 1774723559.360015}
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX87227') HTTP/1.1" 204 0
2026-03-28 18:45:59 [auto1.de] INFO: Found listing with ID: YK83419
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK83419%27 HTTP/1.1" 200 None
2026-03-28 18:45:59 [auto1.de] INFO: Scrape type for YK83419: 1
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_74094fe5c2136b3e312c90209ee2c401.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_74094fe5c2136b3e312c90209ee2c401.jpg not downloaded yet
2026-03-28 18:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_93b385d788a4649ddf5508c4e941521b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:45:59 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-28 18:45:59 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-28 18:45:59 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS10948%27 HTTP/1.1" 200 None
2026-03-28 18:45:59 [auto1.de] INFO: Scrape type for PS10948: 2
2026-03-28 18:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d with identifier: PS10948
2026-03-28 18:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d with scrape type 2
2026-03-28 18:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d with scrape type 2
2026-03-28 18:45:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d, identifier: PS10948
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_a335077190223df004aafa87be348947.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_a335077190223df004aafa87be348947.jpg not downloaded yet
2026-03-28 18:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VD40849/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA20139> (referer: https://www.auto1.com/v1/car-details-view/MA20139/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD59666/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:45:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d with identifier: PS10948
2026-03-28 18:45:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d with identifier: PS10948
2026-03-28 18:45:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d with identifier: PS10948 to the API
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:10:10Z',
 'fuel_type': 'petrol',
 'id': '02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS10948',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 85921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-03',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2019}
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS10948%27 HTTP/1.1" 200 None
2026-03-28 18:45:59 [auto1.de] INFO: Saving data for PS10948: {'auction_closing_time': 1774883410.0, 'created_time': 1774553227.767187, 'last_price_update_time': 1774723559.865145}
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS10948') HTTP/1.1" 204 0
2026-03-28 18:46:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_75e44e5676665a695bf520df1fa62ba0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_75e44e5676665a695bf520df1fa62ba0.jpg not downloaded yet
2026-03-28 18:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ73228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_2534fc778867dd0b9c8fed373f8b32fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_2534fc778867dd0b9c8fed373f8b32fb.jpg not downloaded yet
2026-03-28 18:46:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454811fd0>
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_93b385d788a4649ddf5508c4e941521b.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_93b385d788a4649ddf5508c4e941521b.jpg saved to cache
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25
2026-03-28 18:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1 with identifier: MA20139
2026-03-28 18:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1 with scrape type 1
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_97899b22920d561b22b6762963023122.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_97899b22920d561b22b6762963023122.jpg not downloaded yet
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_a8c65c4e422b44feac5218e55e82746f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_a8c65c4e422b44feac5218e55e82746f.jpg not downloaded yet
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_273d4a0b2a790e0de65bf2bd715064a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_273d4a0b2a790e0de65bf2bd715064a0.jpg not downloaded yet
2026-03-28 18:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB45443> (referer: https://www.auto1.com/v1/car-details-view/KB45443/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_404fccb75e28ac7af953a19daa5b52bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_404fccb75e28ac7af953a19daa5b52bb.jpg not downloaded yet
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_224e6c49fc778506307b61257e81233a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_224e6c49fc778506307b61257e81233a.jpg not downloaded yet
2026-03-28 18:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_91f1c72a20f0796d9f03fd69515f4c7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_91fd1a5f0bbc67023a6727da51e6af8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_91fd1a5f0bbc67023a6727da51e6af8c.jpg not downloaded yet
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_d11fa33db6072be82e188f4a52a18194.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_d11fa33db6072be82e188f4a52a18194.jpg not downloaded yet
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_7078f0c6f9edfb6c01efe04f1b14f183.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_7078f0c6f9edfb6c01efe04f1b14f183.jpg not downloaded yet
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_b1a922479d7bc26a50af61f65cd1d81f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_b1a922479d7bc26a50af61f65cd1d81f.jpg not downloaded yet
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_cd8751331028aba6fb7866230bf073e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_cd8751331028aba6fb7866230bf073e7.jpg not downloaded yet
2026-03-28 18:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17028070-e842-560a-84aa-3abdb5c90cb8 with identifier: KB45443
2026-03-28 18:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17028070-e842-560a-84aa-3abdb5c90cb8 with scrape type 1
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17028070-e842-560a-84aa-3abdb5c90cb8
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_9251ecec2ace505f8ba9411fddb4a4c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_9251ecec2ace505f8ba9411fddb4a4c7.jpg not downloaded yet
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_92d36514df6cc4acf6a57f7415c18e9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_92d36514df6cc4acf6a57f7415c18e9c.jpg not downloaded yet
2026-03-28 18:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_75e44e5676665a695bf520df1fa62ba0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_767dc1f9478e726830eb15f16e9a69da.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_767dc1f9478e726830eb15f16e9a69da.jpg not downloaded yet
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855ed50>
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_91f1c72a20f0796d9f03fd69515f4c7c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_91f1c72a20f0796d9f03fd69515f4c7c.jpg saved to cache
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25
2026-03-28 18:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_70ccf782d51eb06a77ddaf05ae587df2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_f1354b10d4775d3f16d4b6b36de93a83.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_f1354b10d4775d3f16d4b6b36de93a83.jpg not downloaded yet
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_30f28992c36193124c68fbf2dd0b9a65.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_30f28992c36193124c68fbf2dd0b9a65.jpg not downloaded yet
2026-03-28 18:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_f21c09b1c565661180fe71a777509405.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_8fd23356bceda6e3ca867615c7c723ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_8fd23356bceda6e3ca867615c7c723ff.jpg not downloaded yet
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_cb22407a4e4ea49a483bbc8521d6ccd1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_cb22407a4e4ea49a483bbc8521d6ccd1.jpg not downloaded yet
2026-03-28 18:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_273d4a0b2a790e0de65bf2bd715064a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_a49f688b7fbc89f3e86f59f2a3896d63.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_a49f688b7fbc89f3e86f59f2a3896d63.jpg not downloaded yet
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454705d10>
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_75e44e5676665a695bf520df1fa62ba0.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_75e44e5676665a695bf520df1fa62ba0.jpg saved to cache
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_8ab0c43d460196ff0af82005277d03f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_8ab0c43d460196ff0af82005277d03f3.jpg not downloaded yet
2026-03-28 18:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_8404ff1b96eb424fd7f1961e0bd296e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_fbbeac003d57790b1cadba494a3e8d1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_fbbeac003d57790b1cadba494a3e8d1d.jpg not downloaded yet
2026-03-28 18:46:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564e1bd0>
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_70ccf782d51eb06a77ddaf05ae587df2.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_70ccf782d51eb06a77ddaf05ae587df2.jpg saved to cache
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4dc64e49-56b2-53bd-88c6-a84311c425b1
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_0899c8e89d6f251008966e27e972036a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_0899c8e89d6f251008966e27e972036a.jpg not downloaded yet
2026-03-28 18:46:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245634fcd0>
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_f21c09b1c565661180fe71a777509405.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_f21c09b1c565661180fe71a777509405.jpg saved to cache
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4dc64e49-56b2-53bd-88c6-a84311c425b1
2026-03-28 18:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_224e6c49fc778506307b61257e81233a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_6d992bb4645f118b7848e3efc237f5e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_6d992bb4645f118b7848e3efc237f5e9.jpg not downloaded yet
2026-03-28 18:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE75867> (referer: https://www.auto1.com/v1/car-details-view/BE75867/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b8ad0>
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_273d4a0b2a790e0de65bf2bd715064a0.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_273d4a0b2a790e0de65bf2bd715064a0.jpg saved to cache
2026-03-28 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1
2026-03-28 18:46:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546e2450>
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_8404ff1b96eb424fd7f1961e0bd296e3.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_8404ff1b96eb424fd7f1961e0bd296e3.jpg saved to cache
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4dc64e49-56b2-53bd-88c6-a84311c425b1
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_129c767ec21af909b981bebc702f8165.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_129c767ec21af909b981bebc702f8165.jpg not downloaded yet
2026-03-28 18:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK83419/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV56642> (referer: https://www.auto1.com/v1/car-details-view/KV56642/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS51520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245651aa10>
2026-03-28 18:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_224e6c49fc778506307b61257e81233a.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_224e6c49fc778506307b61257e81233a.jpg saved to cache
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1
2026-03-28 18:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b6386c4-2313-5b3b-a4e6-a7f17404fc39 with identifier: BE75867
2026-03-28 18:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39 with scrape type 1
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_dd13482cc1015537ab89ad23410d1435.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_dd13482cc1015537ab89ad23410d1435.jpg not downloaded yet
2026-03-28 18:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT08508/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_4364b37e3e23f705962828f3db48fe22.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_4364b37e3e23f705962828f3db48fe22.jpg not downloaded yet
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_d45c246a2a0a36aff6825bc5155ffdfe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_d45c246a2a0a36aff6825bc5155ffdfe.jpg not downloaded yet
2026-03-28 18:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_74094fe5c2136b3e312c90209ee2c401.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_cc9fb8a2187b1b225c1472e822d9a75c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_2ea0b9b141878d6241e8dae2193d6f6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_2ea0b9b141878d6241e8dae2193d6f6c.jpg not downloaded yet
2026-03-28 18:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bf31179-041e-5a4b-87ac-904f27db6764 with identifier: KV56642
2026-03-28 18:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bf31179-041e-5a4b-87ac-904f27db6764 with scrape type 1
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3bf31179-041e-5a4b-87ac-904f27db6764
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F97%252F2597dc86947a15943853482522c9b761%252Fpa%252FKV56642_e58bb26b2a0f2437714ba1db6c564a8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_e58bb26b2a0f2437714ba1db6c564a8f.jpg already downloaded
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F97%252F2597dc86947a15943853482522c9b761%252Fpa%252FKV56642_cbdf9b42905fb367edce671f251f47e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_cbdf9b42905fb367edce671f251f47e6.jpg already downloaded
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F97%252F2597dc86947a15943853482522c9b761%252Fpa%252FKV56642_9b5d866e7c5c8f7d25111c6735f32ab7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_9b5d866e7c5c8f7d25111c6735f32ab7.jpg already downloaded
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F97%252F2597dc86947a15943853482522c9b761%252Fpa%252FKV56642_0c8005bbf29e706f787da07600ce7726.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_0c8005bbf29e706f787da07600ce7726.jpg already downloaded
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F97%252F2597dc86947a15943853482522c9b761%252Fpa%252FKV56642_dd3c12b17f932dccb9f1faa36248a835.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_dd3c12b17f932dccb9f1faa36248a835.jpg already downloaded
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F97%252F2597dc86947a15943853482522c9b761%252Fpa%252FKV56642_12f940e1988a45e1ddaede8dbb3ba665.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_12f940e1988a45e1ddaede8dbb3ba665.jpg already downloaded
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F97%252F2597dc86947a15943853482522c9b761%252Fpa%252FKV56642_ad6832d9c0398a7c3ee1bdb14ff15342.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_ad6832d9c0398a7c3ee1bdb14ff15342.jpg already downloaded
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F97%252F2597dc86947a15943853482522c9b761%252Fpa%252FKV56642_6bf4103f8490c5b86dd03ae0148eb8a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_6bf4103f8490c5b86dd03ae0148eb8a8.jpg already downloaded
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F97%252F2597dc86947a15943853482522c9b761%252Fpa%252FKV56642_5f6c6b4104d2e9bb4b3095b4967bd3d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_5f6c6b4104d2e9bb4b3095b4967bd3d6.jpg already downloaded
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F97%252F2597dc86947a15943853482522c9b761%252Fpa%252FKV56642_4b01693e7fd6ef3b1a7bb2b83353dbb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_4b01693e7fd6ef3b1a7bb2b83353dbb7.jpg already downloaded
2026-03-28 18:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bf31179-041e-5a4b-87ac-904f27db6764, identifier: KV56642
2026-03-28 18:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_9d1f6c466f9117642b6302e273b6e855.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_22a266709658bf353bfdb9c8ec8b6c90.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_22a266709658bf353bfdb9c8ec8b6c90.jpg not downloaded yet
2026-03-28 18:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bf31179-041e-5a4b-87ac-904f27db6764 with identifier: KV56642
2026-03-28 18:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bf31179-041e-5a4b-87ac-904f27db6764 with identifier: KV56642
2026-03-28 18:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bf31179-041e-5a4b-87ac-904f27db6764 with identifier: KV56642 to the API
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV56642>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:34Z',
 'fuel_type': 'diesel',
 'id': '3bf31179-041e-5a4b-87ac-904f27db6764',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV56642',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 33859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_e58bb26b2a0f2437714ba1db6c564a8f.jpg',
                'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_cbdf9b42905fb367edce671f251f47e6.jpg',
                'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_9b5d866e7c5c8f7d25111c6735f32ab7.jpg',
                'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_0c8005bbf29e706f787da07600ce7726.jpg',
                'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_dd3c12b17f932dccb9f1faa36248a835.jpg',
                'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_12f940e1988a45e1ddaede8dbb3ba665.jpg',
                'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_ad6832d9c0398a7c3ee1bdb14ff15342.jpg',
                'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_6bf4103f8490c5b86dd03ae0148eb8a8.jpg',
                'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_5f6c6b4104d2e9bb4b3095b4967bd3d6.jpg',
                'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_4b01693e7fd6ef3b1a7bb2b83353dbb7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf31179-041e-5a4b-87ac-904f27db6764/3bf31179-041e-5a4b-87ac-904f27db6764_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_e58bb26b2a0f2437714ba1db6c564a8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf31179-041e-5a4b-87ac-904f27db6764/3bf31179-041e-5a4b-87ac-904f27db6764_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_cbdf9b42905fb367edce671f251f47e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf31179-041e-5a4b-87ac-904f27db6764/3bf31179-041e-5a4b-87ac-904f27db6764_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2944408,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_9b5d866e7c5c8f7d25111c6735f32ab7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf31179-041e-5a4b-87ac-904f27db6764/3bf31179-041e-5a4b-87ac-904f27db6764_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2798834,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_0c8005bbf29e706f787da07600ce7726.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf31179-041e-5a4b-87ac-904f27db6764/3bf31179-041e-5a4b-87ac-904f27db6764_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3019792,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_dd3c12b17f932dccb9f1faa36248a835.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf31179-041e-5a4b-87ac-904f27db6764/3bf31179-041e-5a4b-87ac-904f27db6764_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_12f940e1988a45e1ddaede8dbb3ba665.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf31179-041e-5a4b-87ac-904f27db6764/3bf31179-041e-5a4b-87ac-904f27db6764_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2792568,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_ad6832d9c0398a7c3ee1bdb14ff15342.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf31179-041e-5a4b-87ac-904f27db6764/3bf31179-041e-5a4b-87ac-904f27db6764_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_6bf4103f8490c5b86dd03ae0148eb8a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf31179-041e-5a4b-87ac-904f27db6764/3bf31179-041e-5a4b-87ac-904f27db6764_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3039632,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_5f6c6b4104d2e9bb4b3095b4967bd3d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bf31179-041e-5a4b-87ac-904f27db6764/3bf31179-041e-5a4b-87ac-904f27db6764_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/97/2597dc86947a15943853482522c9b761/pa/KV56642_4b01693e7fd6ef3b1a7bb2b83353dbb7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56642%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [auto1.de] INFO: Saving data for KV56642: {'created_time': 1774723561.930063, 'last_price_update_time': 1774723561.930081, 'auction_closing_time': 1774883074.0}
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV56642') HTTP/1.1" 204 0
2026-03-28 18:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_6d992bb4645f118b7848e3efc237f5e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_fbbeac003d57790b1cadba494a3e8d1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_47b40c22529215f8a57ef7d5729d02fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_47b40c22529215f8a57ef7d5729d02fb.jpg not downloaded yet
2026-03-28 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_7905c79e17bfdc7ee11736a20fa9b3bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_7905c79e17bfdc7ee11736a20fa9b3bd.jpg not downloaded yet
2026-03-28 18:46:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561988d0>
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_74094fe5c2136b3e312c90209ee2c401.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_74094fe5c2136b3e312c90209ee2c401.jpg saved to cache
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25
2026-03-28 18:46:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560ace50>
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_cc9fb8a2187b1b225c1472e822d9a75c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_cc9fb8a2187b1b225c1472e822d9a75c.jpg saved to cache
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a
2026-03-28 18:46:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245479d450>
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_9d1f6c466f9117642b6302e273b6e855.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_9d1f6c466f9117642b6302e273b6e855.jpg saved to cache
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a
2026-03-28 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_cb22407a4e4ea49a483bbc8521d6ccd1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_2169cf21372c0b8ba5e54bae93ea7f57.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_2169cf21372c0b8ba5e54bae93ea7f57.jpg not downloaded yet
2026-03-28 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_129c767ec21af909b981bebc702f8165.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_a052a7ee5562509e2e01bbded1f972c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_a052a7ee5562509e2e01bbded1f972c7.jpg not downloaded yet
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563b4910>
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_6d992bb4645f118b7848e3efc237f5e9.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_6d992bb4645f118b7848e3efc237f5e9.jpg saved to cache
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17028070-e842-560a-84aa-3abdb5c90cb8
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245650e810>
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_fbbeac003d57790b1cadba494a3e8d1d.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_fbbeac003d57790b1cadba494a3e8d1d.jpg saved to cache
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17028070-e842-560a-84aa-3abdb5c90cb8
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_19676f1b40f766c8734a69f5dad23bb3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_19676f1b40f766c8734a69f5dad23bb3.jpg not downloaded yet
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454752590>
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_cb22407a4e4ea49a483bbc8521d6ccd1.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_cb22407a4e4ea49a483bbc8521d6ccd1.jpg saved to cache
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17028070-e842-560a-84aa-3abdb5c90cb8
2026-03-28 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_4364b37e3e23f705962828f3db48fe22.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454646250>
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_129c767ec21af909b981bebc702f8165.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_129c767ec21af909b981bebc702f8165.jpg saved to cache
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17028070-e842-560a-84aa-3abdb5c90cb8
2026-03-28 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_9251ecec2ace505f8ba9411fddb4a4c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_767dc1f9478e726830eb15f16e9a69da.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_8fd23356bceda6e3ca867615c7c723ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_0899c8e89d6f251008966e27e972036a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_8ab0c43d460196ff0af82005277d03f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_a49f688b7fbc89f3e86f59f2a3896d63.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_dd13482cc1015537ab89ad23410d1435.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546c3190>
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_4364b37e3e23f705962828f3db48fe22.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_4364b37e3e23f705962828f3db48fe22.jpg saved to cache
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39
2026-03-28 18:46:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245481b190>
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_9251ecec2ace505f8ba9411fddb4a4c7.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_9251ecec2ace505f8ba9411fddb4a4c7.jpg saved to cache
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17028070-e842-560a-84aa-3abdb5c90cb8
2026-03-28 18:46:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562c9590>
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_767dc1f9478e726830eb15f16e9a69da.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_767dc1f9478e726830eb15f16e9a69da.jpg saved to cache
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17028070-e842-560a-84aa-3abdb5c90cb8
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b32d0>
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_8fd23356bceda6e3ca867615c7c723ff.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_8fd23356bceda6e3ca867615c7c723ff.jpg saved to cache
2026-03-28 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1
2026-03-28 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_7905c79e17bfdc7ee11736a20fa9b3bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_19676f1b40f766c8734a69f5dad23bb3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456058a50>
2026-03-28 18:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_0899c8e89d6f251008966e27e972036a.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_0899c8e89d6f251008966e27e972036a.jpg saved to cache
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17028070-e842-560a-84aa-3abdb5c90cb8
2026-03-28 18:46:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245608c610>
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_8ab0c43d460196ff0af82005277d03f3.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_8ab0c43d460196ff0af82005277d03f3.jpg saved to cache
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17028070-e842-560a-84aa-3abdb5c90cb8
2026-03-28 18:46:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547cd3d0>
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_a49f688b7fbc89f3e86f59f2a3896d63.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_a49f688b7fbc89f3e86f59f2a3896d63.jpg saved to cache
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17028070-e842-560a-84aa-3abdb5c90cb8
2026-03-28 18:46:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563c1b90>
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_dd13482cc1015537ab89ad23410d1435.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_dd13482cc1015537ab89ad23410d1435.jpg saved to cache
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456193450>
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_7905c79e17bfdc7ee11736a20fa9b3bd.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_7905c79e17bfdc7ee11736a20fa9b3bd.jpg saved to cache
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547ee290>
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_19676f1b40f766c8734a69f5dad23bb3.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_19676f1b40f766c8734a69f5dad23bb3.jpg saved to cache
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39
2026-03-28 18:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_47b40c22529215f8a57ef7d5729d02fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_22a266709658bf353bfdb9c8ec8b6c90.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK83419> (referer: https://www.auto1.com/v1/car-details-view/YK83419/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT08508> (referer: https://www.auto1.com/v1/car-details-view/RT08508/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS51520> (referer: https://www.auto1.com/v1/car-details-view/DS51520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b16d0>
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_47b40c22529215f8a57ef7d5729d02fb.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_47b40c22529215f8a57ef7d5729d02fb.jpg saved to cache
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39
2026-03-28 18:46:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458620c10>
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_22a266709658bf353bfdb9c8ec8b6c90.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_22a266709658bf353bfdb9c8ec8b6c90.jpg saved to cache
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39
2026-03-28 18:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_30f28992c36193124c68fbf2dd0b9a65.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_f1354b10d4775d3f16d4b6b36de93a83.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730 with identifier: YK83419
2026-03-28 18:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730 with scrape type 1
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F4d%252Fbe4dfa18ca76dc0c27fb2eb9b0870736%252Fpa%252FYK83419_ca8631a255fc5cca407b389320c60412.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_ca8631a255fc5cca407b389320c60412.jpg already downloaded
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F4d%252Fbe4dfa18ca76dc0c27fb2eb9b0870736%252Fpa%252FYK83419_f9ace9b90015f32c36189cc63e89b252.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_f9ace9b90015f32c36189cc63e89b252.jpg already downloaded
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F4d%252Fbe4dfa18ca76dc0c27fb2eb9b0870736%252Fpa%252FYK83419_d5f4414dd9e5f42dd17ffc111d9b4063.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_d5f4414dd9e5f42dd17ffc111d9b4063.jpg already downloaded
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F4d%252Fbe4dfa18ca76dc0c27fb2eb9b0870736%252Fpa%252FYK83419_be380da413fcd2a4f650c7772f058633.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_be380da413fcd2a4f650c7772f058633.jpg already downloaded
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F4d%252Fbe4dfa18ca76dc0c27fb2eb9b0870736%252Fpa%252FYK83419_4b2d6076cf127a0eab04e325b6092623.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_4b2d6076cf127a0eab04e325b6092623.jpg already downloaded
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F4d%252Fbe4dfa18ca76dc0c27fb2eb9b0870736%252Fpa%252FYK83419_0e4e0ff5b0cf19d3f52105fe77d88828.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_0e4e0ff5b0cf19d3f52105fe77d88828.jpg already downloaded
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F4d%252Fbe4dfa18ca76dc0c27fb2eb9b0870736%252Fpa%252FYK83419_9dc0e6a2daf4980d8cd2783089d25abd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_9dc0e6a2daf4980d8cd2783089d25abd.jpg already downloaded
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F4d%252Fbe4dfa18ca76dc0c27fb2eb9b0870736%252Fpa%252FYK83419_8142ccf95d40f1f3a51c1fdfd73916ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_8142ccf95d40f1f3a51c1fdfd73916ca.jpg already downloaded
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F4d%252Fbe4dfa18ca76dc0c27fb2eb9b0870736%252Fpa%252FYK83419_d72d57c913d1dc525b3566dea796c1cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_d72d57c913d1dc525b3566dea796c1cd.jpg already downloaded
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F4d%252Fbe4dfa18ca76dc0c27fb2eb9b0870736%252Fpa%252FYK83419_98fa556f30686aba74469465a41794a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_98fa556f30686aba74469465a41794a4.jpg already downloaded
2026-03-28 18:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730, identifier: YK83419
2026-03-28 18:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d66889d0-9937-5e3e-8356-471cfa4e9016 with identifier: RT08508
2026-03-28 18:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d66889d0-9937-5e3e-8356-471cfa4e9016 with scrape type 1
2026-03-28 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d66889d0-9937-5e3e-8356-471cfa4e9016
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_28020786927f97341ee6d331587a4e5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_28020786927f97341ee6d331587a4e5e.jpg not downloaded yet
2026-03-28 18:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4ce37e7-c50c-5026-b06b-ead22d09e5cb with identifier: DS51520
2026-03-28 18:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4ce37e7-c50c-5026-b06b-ead22d09e5cb with scrape type 1
2026-03-28 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4ce37e7-c50c-5026-b06b-ead22d09e5cb
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F87%252F56878536cd0b96433513b9e0e8f07aba%252Fpa%252FDS51520_d53f3daf698513f76fc36ff0e9fdee91.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_d53f3daf698513f76fc36ff0e9fdee91.jpg already downloaded
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F87%252F56878536cd0b96433513b9e0e8f07aba%252Fpa%252FDS51520_5d3c1d562196dc516858e62a960a52e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_5d3c1d562196dc516858e62a960a52e4.jpg already downloaded
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F87%252F56878536cd0b96433513b9e0e8f07aba%252Fpa%252FDS51520_c969d3c7680efefa3844bf0f42e93b92.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_c969d3c7680efefa3844bf0f42e93b92.jpg already downloaded
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F87%252F56878536cd0b96433513b9e0e8f07aba%252Fpa%252FDS51520_0125f03382841fdb4ef36aa13e66a0c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_0125f03382841fdb4ef36aa13e66a0c4.jpg already downloaded
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F87%252F56878536cd0b96433513b9e0e8f07aba%252Fpa%252FDS51520_643722eb94f277776b3acef456caedef.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_643722eb94f277776b3acef456caedef.jpg already downloaded
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F87%252F56878536cd0b96433513b9e0e8f07aba%252Fpa%252FDS51520_d9113a4960b0a8fa38801adeafff3d5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_d9113a4960b0a8fa38801adeafff3d5c.jpg already downloaded
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F87%252F56878536cd0b96433513b9e0e8f07aba%252Fpa%252FDS51520_4c380a946e4fa66ecf1e48c3d6d463c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_4c380a946e4fa66ecf1e48c3d6d463c6.jpg already downloaded
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F87%252F56878536cd0b96433513b9e0e8f07aba%252Fpa%252FDS51520_b57e8dd0cc78370d7eee37516190f490.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_b57e8dd0cc78370d7eee37516190f490.jpg already downloaded
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F87%252F56878536cd0b96433513b9e0e8f07aba%252Fpa%252FDS51520_8eb82a2488c12cda5a5602ec2c6a0022.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_8eb82a2488c12cda5a5602ec2c6a0022.jpg already downloaded
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F87%252F56878536cd0b96433513b9e0e8f07aba%252Fpa%252FDS51520_583625f6cb85c530fc2a5a73511664ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_583625f6cb85c530fc2a5a73511664ee.jpg already downloaded
2026-03-28 18:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4ce37e7-c50c-5026-b06b-ead22d09e5cb, identifier: DS51520
2026-03-28 18:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730 with identifier: YK83419
2026-03-28 18:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730 with identifier: YK83419
2026-03-28 18:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730 with identifier: YK83419 to the API
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YK83419>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:07:51Z',
 'fuel_type': 'diesel',
 'id': '9fe2dca0-7a37-5b3b-9dd7-e96f6af63730',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK83419',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 88515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_ca8631a255fc5cca407b389320c60412.jpg',
                'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_f9ace9b90015f32c36189cc63e89b252.jpg',
                'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_d5f4414dd9e5f42dd17ffc111d9b4063.jpg',
                'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_be380da413fcd2a4f650c7772f058633.jpg',
                'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_4b2d6076cf127a0eab04e325b6092623.jpg',
                'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_0e4e0ff5b0cf19d3f52105fe77d88828.jpg',
                'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_9dc0e6a2daf4980d8cd2783089d25abd.jpg',
                'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_8142ccf95d40f1f3a51c1fdfd73916ca.jpg',
                'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_d72d57c913d1dc525b3566dea796c1cd.jpg',
                'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_98fa556f30686aba74469465a41794a4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe2dca0-7a37-5b3b-9dd7-e96f6af63730/9fe2dca0-7a37-5b3b-9dd7-e96f6af63730_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_ca8631a255fc5cca407b389320c60412.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe2dca0-7a37-5b3b-9dd7-e96f6af63730/9fe2dca0-7a37-5b3b-9dd7-e96f6af63730_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_f9ace9b90015f32c36189cc63e89b252.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe2dca0-7a37-5b3b-9dd7-e96f6af63730/9fe2dca0-7a37-5b3b-9dd7-e96f6af63730_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_d5f4414dd9e5f42dd17ffc111d9b4063.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe2dca0-7a37-5b3b-9dd7-e96f6af63730/9fe2dca0-7a37-5b3b-9dd7-e96f6af63730_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_be380da413fcd2a4f650c7772f058633.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe2dca0-7a37-5b3b-9dd7-e96f6af63730/9fe2dca0-7a37-5b3b-9dd7-e96f6af63730_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_4b2d6076cf127a0eab04e325b6092623.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe2dca0-7a37-5b3b-9dd7-e96f6af63730/9fe2dca0-7a37-5b3b-9dd7-e96f6af63730_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_0e4e0ff5b0cf19d3f52105fe77d88828.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe2dca0-7a37-5b3b-9dd7-e96f6af63730/9fe2dca0-7a37-5b3b-9dd7-e96f6af63730_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_9dc0e6a2daf4980d8cd2783089d25abd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe2dca0-7a37-5b3b-9dd7-e96f6af63730/9fe2dca0-7a37-5b3b-9dd7-e96f6af63730_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_8142ccf95d40f1f3a51c1fdfd73916ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe2dca0-7a37-5b3b-9dd7-e96f6af63730/9fe2dca0-7a37-5b3b-9dd7-e96f6af63730_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_d72d57c913d1dc525b3566dea796c1cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe2dca0-7a37-5b3b-9dd7-e96f6af63730/9fe2dca0-7a37-5b3b-9dd7-e96f6af63730_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/4d/be4dfa18ca76dc0c27fb2eb9b0870736/pa/YK83419_98fa556f30686aba74469465a41794a4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK83419%27 HTTP/1.1" 200 None
2026-03-28 18:46:04 [auto1.de] INFO: Saving data for YK83419: {'created_time': 1774723564.877096, 'last_price_update_time': 1774723564.877107, 'auction_closing_time': 1774883271.0}
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK83419') HTTP/1.1" 204 0
2026-03-28 18:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4ce37e7-c50c-5026-b06b-ead22d09e5cb with identifier: DS51520
2026-03-28 18:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4ce37e7-c50c-5026-b06b-ead22d09e5cb with identifier: DS51520
2026-03-28 18:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4ce37e7-c50c-5026-b06b-ead22d09e5cb with identifier: DS51520 to the API
2026-03-28 18:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DS51520>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:32:07Z',
 'fuel_type': 'petrol',
 'id': 'a4ce37e7-c50c-5026-b06b-ead22d09e5cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS51520',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 168260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_d53f3daf698513f76fc36ff0e9fdee91.jpg',
                'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_5d3c1d562196dc516858e62a960a52e4.jpg',
                'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_c969d3c7680efefa3844bf0f42e93b92.jpg',
                'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_0125f03382841fdb4ef36aa13e66a0c4.jpg',
                'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_643722eb94f277776b3acef456caedef.jpg',
                'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_d9113a4960b0a8fa38801adeafff3d5c.jpg',
                'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_4c380a946e4fa66ecf1e48c3d6d463c6.jpg',
                'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_b57e8dd0cc78370d7eee37516190f490.jpg',
                'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_8eb82a2488c12cda5a5602ec2c6a0022.jpg',
                'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_583625f6cb85c530fc2a5a73511664ee.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ce37e7-c50c-5026-b06b-ead22d09e5cb/a4ce37e7-c50c-5026-b06b-ead22d09e5cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_d53f3daf698513f76fc36ff0e9fdee91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ce37e7-c50c-5026-b06b-ead22d09e5cb/a4ce37e7-c50c-5026-b06b-ead22d09e5cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_5d3c1d562196dc516858e62a960a52e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ce37e7-c50c-5026-b06b-ead22d09e5cb/a4ce37e7-c50c-5026-b06b-ead22d09e5cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_c969d3c7680efefa3844bf0f42e93b92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ce37e7-c50c-5026-b06b-ead22d09e5cb/a4ce37e7-c50c-5026-b06b-ead22d09e5cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_0125f03382841fdb4ef36aa13e66a0c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ce37e7-c50c-5026-b06b-ead22d09e5cb/a4ce37e7-c50c-5026-b06b-ead22d09e5cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_643722eb94f277776b3acef456caedef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ce37e7-c50c-5026-b06b-ead22d09e5cb/a4ce37e7-c50c-5026-b06b-ead22d09e5cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_d9113a4960b0a8fa38801adeafff3d5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ce37e7-c50c-5026-b06b-ead22d09e5cb/a4ce37e7-c50c-5026-b06b-ead22d09e5cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_4c380a946e4fa66ecf1e48c3d6d463c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ce37e7-c50c-5026-b06b-ead22d09e5cb/a4ce37e7-c50c-5026-b06b-ead22d09e5cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_b57e8dd0cc78370d7eee37516190f490.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ce37e7-c50c-5026-b06b-ead22d09e5cb/a4ce37e7-c50c-5026-b06b-ead22d09e5cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_8eb82a2488c12cda5a5602ec2c6a0022.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ce37e7-c50c-5026-b06b-ead22d09e5cb/a4ce37e7-c50c-5026-b06b-ead22d09e5cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/87/56878536cd0b96433513b9e0e8f07aba/pa/DS51520_583625f6cb85c530fc2a5a73511664ee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Monte Carlo',
 'transmission': 'manual',
 'trim': 'Monte Carlo',
 'year': 2014}
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS51520%27 HTTP/1.1" 200 None
2026-03-28 18:46:05 [auto1.de] INFO: Saving data for DS51520: {'created_time': 1774723565.205552, 'last_price_update_time': 1774723565.205564, 'auction_closing_time': 1774884727.0}
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS51520') HTTP/1.1" 204 0
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_a4357894e34136d93ac6812ba9b841c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_a4357894e34136d93ac6812ba9b841c5.jpg not downloaded yet
2026-03-28 18:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_b1a922479d7bc26a50af61f65cd1d81f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_7078f0c6f9edfb6c01efe04f1b14f183.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547eead0>
2026-03-28 18:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F17%252F8917882098a5306b10d75140612582ce%252Fpa%252FKB45443_30f28992c36193124c68fbf2dd0b9a65.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_30f28992c36193124c68fbf2dd0b9a65.jpg saved to cache
2026-03-28 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17028070-e842-560a-84aa-3abdb5c90cb8
2026-03-28 18:46:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17028070-e842-560a-84aa-3abdb5c90cb8, skipping ID generation
2026-03-28 18:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17028070-e842-560a-84aa-3abdb5c90cb8 with scrape type 1
2026-03-28 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17028070-e842-560a-84aa-3abdb5c90cb8 sending to next pipeline
2026-03-28 18:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17028070-e842-560a-84aa-3abdb5c90cb8, identifier: KB45443
2026-03-28 18:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454812ad0>
2026-03-28 18:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_f1354b10d4775d3f16d4b6b36de93a83.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_f1354b10d4775d3f16d4b6b36de93a83.jpg saved to cache
2026-03-28 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_c52687fad414dc37e943c3517c806823.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_c52687fad414dc37e943c3517c806823.jpg not downloaded yet
2026-03-28 18:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17028070-e842-560a-84aa-3abdb5c90cb8 with identifier: KB45443
2026-03-28 18:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17028070-e842-560a-84aa-3abdb5c90cb8 with identifier: KB45443
2026-03-28 18:46:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17028070-e842-560a-84aa-3abdb5c90cb8 with identifier: KB45443 to the API
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_30f28992c36193124c68fbf2dd0b9a65.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:45:01Z',
 'fuel_type': 'diesel',
 'id': '17028070-e842-560a-84aa-3abdb5c90cb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB45443',
 'listing': 'auction',
 'location': 'DE, Bocholt',
 'make': 'BMW',
 'model': '3er',
 'odometer': 238537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_9251ecec2ace505f8ba9411fddb4a4c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2478535,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_767dc1f9478e726830eb15f16e9a69da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_30f28992c36193124c68fbf2dd0b9a65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_cb22407a4e4ea49a483bbc8521d6ccd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2538383,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_a49f688b7fbc89f3e86f59f2a3896d63.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2594278,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_8ab0c43d460196ff0af82005277d03f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_fbbeac003d57790b1cadba494a3e8d1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2572597,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_0899c8e89d6f251008966e27e972036a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_6d992bb4645f118b7848e3efc237f5e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17028070-e842-560a-84aa-3abdb5c90cb8/17028070-e842-560a-84aa-3abdb5c90cb8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/17/8917882098a5306b10d75140612582ce/pa/KB45443_129c767ec21af909b981bebc702f8165.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB45443%27 HTTP/1.1" 200 None
2026-03-28 18:46:05 [auto1.de] INFO: Saving data for KB45443: {'created_time': 1774723565.809008, 'last_price_update_time': 1774723565.809019, 'auction_closing_time': 1774885501.0}
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB45443') HTTP/1.1" 204 0
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_100930598d4b40550beb010a3a09f58d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_100930598d4b40550beb010a3a09f58d.jpg not downloaded yet
2026-03-28 18:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_91fd1a5f0bbc67023a6727da51e6af8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_d11fa33db6072be82e188f4a52a18194.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_602654551465a121a115d904cff58ee0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_602654551465a121a115d904cff58ee0.jpg not downloaded yet
2026-03-28 18:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456072350>
2026-03-28 18:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_b1a922479d7bc26a50af61f65cd1d81f.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_b1a922479d7bc26a50af61f65cd1d81f.jpg saved to cache
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456073190>
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_7078f0c6f9edfb6c01efe04f1b14f183.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_7078f0c6f9edfb6c01efe04f1b14f183.jpg saved to cache
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1
2026-03-28 18:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ73228> (referer: https://www.auto1.com/v1/car-details-view/DZ73228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_32f9632f82fd880106660acdc21b7fcf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_32f9632f82fd880106660acdc21b7fcf.jpg not downloaded yet
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_f4c174d0bee67d1606afb217d387d250.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_f4c174d0bee67d1606afb217d387d250.jpg not downloaded yet
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456534790>
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_91fd1a5f0bbc67023a6727da51e6af8c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_91fd1a5f0bbc67023a6727da51e6af8c.jpg saved to cache
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456430210>
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_d11fa33db6072be82e188f4a52a18194.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_d11fa33db6072be82e188f4a52a18194.jpg saved to cache
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1
2026-03-28 18:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_2169cf21372c0b8ba5e54bae93ea7f57.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_d3b4bed4e8a4bdc4bd5f204cc8951b13.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_d3b4bed4e8a4bdc4bd5f204cc8951b13.jpg not downloaded yet
2026-03-28 18:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_a8c65c4e422b44feac5218e55e82746f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_404fccb75e28ac7af953a19daa5b52bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_2bece38b53ce2268b1abbff3b7af5c68.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_2bece38b53ce2268b1abbff3b7af5c68.jpg not downloaded yet
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_8921cf886abb61c112fa365efb49b9d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_8921cf886abb61c112fa365efb49b9d6.jpg not downloaded yet
2026-03-28 18:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4fa49ad-ac77-5bce-bb06-2aed10975fc1 with identifier: DZ73228
2026-03-28 18:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1 with scrape type 1
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_be94ef071a1288017529de5a8dc19c9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_be94ef071a1288017529de5a8dc19c9e.jpg not downloaded yet
2026-03-28 18:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_97899b22920d561b22b6762963023122.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_a112d3bd8b7a9ae8afed314e791ce5ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_a112d3bd8b7a9ae8afed314e791ce5ce.jpg not downloaded yet
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_102f5a26e5e6b3545379b770cc82d9cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_102f5a26e5e6b3545379b770cc82d9cc.jpg not downloaded yet
2026-03-28 18:46:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456328510>
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_2169cf21372c0b8ba5e54bae93ea7f57.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_2169cf21372c0b8ba5e54bae93ea7f57.jpg saved to cache
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39
2026-03-28 18:46:06 [scrapy.extensions.logstats] INFO: Crawled 450 pages (at 80 pages/min), scraped 717 items (at 73 items/min)
2026-03-28 18:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 193MiB
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_aee8680b4f707f7834f8c64ab5362301.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_aee8680b4f707f7834f8c64ab5362301.jpg not downloaded yet
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458556e90>
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_a8c65c4e422b44feac5218e55e82746f.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_a8c65c4e422b44feac5218e55e82746f.jpg saved to cache
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456334dd0>
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_404fccb75e28ac7af953a19daa5b52bb.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_404fccb75e28ac7af953a19daa5b52bb.jpg saved to cache
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25
2026-03-28 18:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_100930598d4b40550beb010a3a09f58d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_c52687fad414dc37e943c3517c806823.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_ecb77c07a395ded07989270ec9a1822c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_ecb77c07a395ded07989270ec9a1822c.jpg not downloaded yet
2026-03-28 18:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD59666> (referer: https://www.auto1.com/v1/car-details-view/FD59666/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456154cd0>
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_97899b22920d561b22b6762963023122.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_97899b22920d561b22b6762963023122.jpg saved to cache
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_3e96b34c2dc968995fe054cc09d93755.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_3e96b34c2dc968995fe054cc09d93755.jpg not downloaded yet
2026-03-28 18:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_92d36514df6cc4acf6a57f7415c18e9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_abfb926fc80dd17e7a7be940010fa6cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_abfb926fc80dd17e7a7be940010fa6cb.jpg not downloaded yet
2026-03-28 18:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX07481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_8eb79ce411a28c0d81c57e4d9a351d01.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_8eb79ce411a28c0d81c57e4d9a351d01.jpg not downloaded yet
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_2da45c951bfced27d302aab3b9e1196f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_2da45c951bfced27d302aab3b9e1196f.jpg not downloaded yet
2026-03-28 18:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_a052a7ee5562509e2e01bbded1f972c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456311790>
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_100930598d4b40550beb010a3a09f58d.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_100930598d4b40550beb010a3a09f58d.jpg saved to cache
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d66889d0-9937-5e3e-8356-471cfa4e9016
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b8550>
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_c52687fad414dc37e943c3517c806823.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_c52687fad414dc37e943c3517c806823.jpg saved to cache
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d66889d0-9937-5e3e-8356-471cfa4e9016
2026-03-28 18:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_d45c246a2a0a36aff6825bc5155ffdfe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_2ea0b9b141878d6241e8dae2193d6f6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_d441f4bd07f52fb46a8c38101e8d456f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_d441f4bd07f52fb46a8c38101e8d456f.jpg not downloaded yet
2026-03-28 18:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23d0b74e-10a0-5f6d-807a-8900e261a4e4 with identifier: FD59666
2026-03-28 18:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4 with scrape type 1
2026-03-28 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4
2026-03-28 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_ce1c0710756e9eb119bc25b56b7cec36.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_ce1c0710756e9eb119bc25b56b7cec36.jpg not downloaded yet
2026-03-28 18:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_602654551465a121a115d904cff58ee0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_f4c174d0bee67d1606afb217d387d250.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_cd8751331028aba6fb7866230bf073e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_3fed93d8a6ea6318a1743a4a263f11f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_3fed93d8a6ea6318a1743a4a263f11f9.jpg not downloaded yet
2026-03-28 18:46:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245479c850>
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_92d36514df6cc4acf6a57f7415c18e9c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_92d36514df6cc4acf6a57f7415c18e9c.jpg saved to cache
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1
2026-03-28 18:46:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24582cd950>
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_a052a7ee5562509e2e01bbded1f972c7.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_a052a7ee5562509e2e01bbded1f972c7.jpg saved to cache
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_190a23ace0326a72b510552632a26bf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_190a23ace0326a72b510552632a26bf3.jpg not downloaded yet
2026-03-28 18:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_ecb77c07a395ded07989270ec9a1822c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_a112d3bd8b7a9ae8afed314e791ce5ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_edbf586d018f73b99e9f252ab6efe8a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_edbf586d018f73b99e9f252ab6efe8a1.jpg not downloaded yet
2026-03-28 18:46:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456491890>
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_d45c246a2a0a36aff6825bc5155ffdfe.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_d45c246a2a0a36aff6825bc5155ffdfe.jpg saved to cache
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39
2026-03-28 18:46:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563b5e10>
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F7d%252F6f7d3683dd6b1d3bbe97082086eaa22c%252Fpa%252FBE75867_2ea0b9b141878d6241e8dae2193d6f6c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_2ea0b9b141878d6241e8dae2193d6f6c.jpg saved to cache
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39
2026-03-28 18:46:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b6386c4-2313-5b3b-a4e6-a7f17404fc39, skipping ID generation
2026-03-28 18:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39 with scrape type 1
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39 sending to next pipeline
2026-03-28 18:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b6386c4-2313-5b3b-a4e6-a7f17404fc39, identifier: BE75867
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561e6e90>
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_602654551465a121a115d904cff58ee0.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_602654551465a121a115d904cff58ee0.jpg saved to cache
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d66889d0-9937-5e3e-8356-471cfa4e9016
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562c7b10>
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_f4c174d0bee67d1606afb217d387d250.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_f4c174d0bee67d1606afb217d387d250.jpg saved to cache
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d66889d0-9937-5e3e-8356-471cfa4e9016
2026-03-28 18:46:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456492350>
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fee%252Fe2ee85863bb2cfcf9e2d959a566f6689%252Fpa%252FMA20139_cd8751331028aba6fb7866230bf073e7.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_cd8751331028aba6fb7866230bf073e7.jpg saved to cache
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1
2026-03-28 18:46:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1, skipping ID generation
2026-03-28 18:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1 with scrape type 1
2026-03-28 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1 sending to next pipeline
2026-03-28 18:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1, identifier: MA20139
2026-03-28 18:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b6386c4-2313-5b3b-a4e6-a7f17404fc39 with identifier: BE75867
2026-03-28 18:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b6386c4-2313-5b3b-a4e6-a7f17404fc39 with identifier: BE75867
2026-03-28 18:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b6386c4-2313-5b3b-a4e6-a7f17404fc39 with identifier: BE75867 to the API
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_2ea0b9b141878d6241e8dae2193d6f6c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 201,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:34:11Z',
 'fuel_type': 'diesel',
 'id': '9b6386c4-2313-5b3b-a4e6-a7f17404fc39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE75867',
 'listing': 'auction',
 'location': 'Neufahrn',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 113154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2592375,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_dd13482cc1015537ab89ad23410d1435.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_4364b37e3e23f705962828f3db48fe22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2745420,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_d45c246a2a0a36aff6825bc5155ffdfe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2799602,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_2ea0b9b141878d6241e8dae2193d6f6c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619498,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_22a266709658bf353bfdb9c8ec8b6c90.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2226157,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_47b40c22529215f8a57ef7d5729d02fb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_7905c79e17bfdc7ee11736a20fa9b3bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2183023,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_2169cf21372c0b8ba5e54bae93ea7f57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2611951,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_a052a7ee5562509e2e01bbded1f972c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6386c4-2313-5b3b-a4e6-a7f17404fc39/9b6386c4-2313-5b3b-a4e6-a7f17404fc39_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/7d/6f7d3683dd6b1d3bbe97082086eaa22c/pa/BE75867_19676f1b40f766c8734a69f5dad23bb3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-17',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 119 CDI Select lang',
 'transmission': 'automatic',
 'trim': 'Select lang',
 'year': 2020}
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE75867%27 HTTP/1.1" 200 None
2026-03-28 18:46:08 [auto1.de] INFO: Saving data for BE75867: {'created_time': 1774723568.513085, 'last_price_update_time': 1774723568.513096, 'auction_closing_time': 1774884851.0}
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE75867') HTTP/1.1" 204 0
2026-03-28 18:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1 with identifier: MA20139
2026-03-28 18:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1 with identifier: MA20139
2026-03-28 18:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1 with identifier: MA20139 to the API
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_cd8751331028aba6fb7866230bf073e7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 217,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'engine_horse_power': 235,
 'expiration_date': '2026-03-30T15:34:41Z',
 'fuel_type': 'diesel',
 'id': '623c40d0-ce85-56e7-89e2-eb4d46ee2cc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA20139',
 'listing': 'auction',
 'location': 'DE, Münster',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 228052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_97899b22920d561b22b6762963023122.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_273d4a0b2a790e0de65bf2bd715064a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_224e6c49fc778506307b61257e81233a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_d11fa33db6072be82e188f4a52a18194.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_7078f0c6f9edfb6c01efe04f1b14f183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_b1a922479d7bc26a50af61f65cd1d81f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3027317,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_cd8751331028aba6fb7866230bf073e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3046688,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_92d36514df6cc4acf6a57f7415c18e9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_f1354b10d4775d3f16d4b6b36de93a83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_623c40d0-ce85-56e7-89e2-eb4d46ee2cc1/623c40d0-ce85-56e7-89e2-eb4d46ee2cc1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/ee/e2ee85863bb2cfcf9e2d959a566f6689/pa/MA20139_8fd23356bceda6e3ca867615c7c723ff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20139%27 HTTP/1.1" 200 None
2026-03-28 18:46:08 [auto1.de] INFO: Saving data for MA20139: {'created_time': 1774723568.874525, 'last_price_update_time': 1774723568.874536, 'auction_closing_time': 1774884881.0}
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA20139') HTTP/1.1" 204 0
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_442b7187e8d7f7a96e469d2ba7f98d2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_442b7187e8d7f7a96e469d2ba7f98d2b.jpg not downloaded yet
2026-03-28 18:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_abfb926fc80dd17e7a7be940010fa6cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456492810>
2026-03-28 18:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_ecb77c07a395ded07989270ec9a1822c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_ecb77c07a395ded07989270ec9a1822c.jpg saved to cache
2026-03-28 18:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1
2026-03-28 18:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546798d0>
2026-03-28 18:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_a112d3bd8b7a9ae8afed314e791ce5ce.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_a112d3bd8b7a9ae8afed314e791ce5ce.jpg saved to cache
2026-03-28 18:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1
2026-03-28 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_46fb3b90619d1a061de44d302d9809e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_46fb3b90619d1a061de44d302d9809e3.jpg not downloaded yet
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_c280c696e69145c02e3c05d007fd7bb9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_c280c696e69145c02e3c05d007fd7bb9.jpg not downloaded yet
2026-03-28 18:46:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_1244c4d233f3d479fe3971a3274321d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_1244c4d233f3d479fe3971a3274321d7.jpg not downloaded yet
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561814d0>
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_abfb926fc80dd17e7a7be940010fa6cb.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_abfb926fc80dd17e7a7be940010fa6cb.jpg saved to cache
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_369ecd740f2f1eb44108a6c6b7c49b76.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_369ecd740f2f1eb44108a6c6b7c49b76.jpg not downloaded yet
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_488d7efa8f707e27fdb40909618b6238.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_488d7efa8f707e27fdb40909618b6238.jpg not downloaded yet
2026-03-28 18:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_28020786927f97341ee6d331587a4e5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_102f5a26e5e6b3545379b770cc82d9cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_3e96b34c2dc968995fe054cc09d93755.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_be94ef071a1288017529de5a8dc19c9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_32f9632f82fd880106660acdc21b7fcf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_a4357894e34136d93ac6812ba9b841c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_442b7187e8d7f7a96e469d2ba7f98d2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_46fb3b90619d1a061de44d302d9809e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b4d90>
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_28020786927f97341ee6d331587a4e5e.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_28020786927f97341ee6d331587a4e5e.jpg saved to cache
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d66889d0-9937-5e3e-8356-471cfa4e9016
2026-03-28 18:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_488d7efa8f707e27fdb40909618b6238.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245482b250>
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_102f5a26e5e6b3545379b770cc82d9cc.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_102f5a26e5e6b3545379b770cc82d9cc.jpg saved to cache
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1
2026-03-28 18:46:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638d8d0>
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_3e96b34c2dc968995fe054cc09d93755.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_3e96b34c2dc968995fe054cc09d93755.jpg saved to cache
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1
2026-03-28 18:46:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560acb10>
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_be94ef071a1288017529de5a8dc19c9e.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_be94ef071a1288017529de5a8dc19c9e.jpg saved to cache
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1
2026-03-28 18:46:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638f790>
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_32f9632f82fd880106660acdc21b7fcf.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_32f9632f82fd880106660acdc21b7fcf.jpg saved to cache
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d66889d0-9937-5e3e-8356-471cfa4e9016
2026-03-28 18:46:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245636fb90>
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_a4357894e34136d93ac6812ba9b841c5.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_a4357894e34136d93ac6812ba9b841c5.jpg saved to cache
2026-03-28 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d66889d0-9937-5e3e-8356-471cfa4e9016
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245605a990>
2026-03-28 18:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_442b7187e8d7f7a96e469d2ba7f98d2b.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_442b7187e8d7f7a96e469d2ba7f98d2b.jpg saved to cache
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245627c9d0>
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_46fb3b90619d1a061de44d302d9809e3.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_46fb3b90619d1a061de44d302d9809e3.jpg saved to cache
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245616e110>
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_488d7efa8f707e27fdb40909618b6238.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_488d7efa8f707e27fdb40909618b6238.jpg saved to cache
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_edbf586d018f73b99e9f252ab6efe8a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_ce1c0710756e9eb119bc25b56b7cec36.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_190a23ace0326a72b510552632a26bf3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_3fed93d8a6ea6318a1743a4a263f11f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_d441f4bd07f52fb46a8c38101e8d456f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_2da45c951bfced27d302aab3b9e1196f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_1244c4d233f3d479fe3971a3274321d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_369ecd740f2f1eb44108a6c6b7c49b76.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855d5d0>
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_edbf586d018f73b99e9f252ab6efe8a1.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_edbf586d018f73b99e9f252ab6efe8a1.jpg saved to cache
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4
2026-03-28 18:46:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b72d0>
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_ce1c0710756e9eb119bc25b56b7cec36.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_ce1c0710756e9eb119bc25b56b7cec36.jpg saved to cache
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4
2026-03-28 18:46:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562be890>
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_190a23ace0326a72b510552632a26bf3.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_190a23ace0326a72b510552632a26bf3.jpg saved to cache
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4
2026-03-28 18:46:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618abd0>
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_3fed93d8a6ea6318a1743a4a263f11f9.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_3fed93d8a6ea6318a1743a4a263f11f9.jpg saved to cache
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4
2026-03-28 18:46:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456199550>
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_d441f4bd07f52fb46a8c38101e8d456f.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_d441f4bd07f52fb46a8c38101e8d456f.jpg saved to cache
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1
2026-03-28 18:46:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618a110>
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_2da45c951bfced27d302aab3b9e1196f.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_2da45c951bfced27d302aab3b9e1196f.jpg saved to cache
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458557f90>
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_1244c4d233f3d479fe3971a3274321d7.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_1244c4d233f3d479fe3971a3274321d7.jpg saved to cache
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456188610>
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_369ecd740f2f1eb44108a6c6b7c49b76.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_369ecd740f2f1eb44108a6c6b7c49b76.jpg saved to cache
2026-03-28 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_2534fc778867dd0b9c8fed373f8b32fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX07481> (referer: https://www.auto1.com/v1/car-details-view/LX07481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_8eb79ce411a28c0d81c57e4d9a351d01.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_c280c696e69145c02e3c05d007fd7bb9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_aee8680b4f707f7834f8c64ab5362301.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_2bece38b53ce2268b1abbff3b7af5c68.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_8921cf886abb61c112fa365efb49b9d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_d3b4bed4e8a4bdc4bd5f204cc8951b13.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_1069aa0e5c63bdb04f613dcb7a7faddb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245828ad10>
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_2534fc778867dd0b9c8fed373f8b32fb.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_2534fc778867dd0b9c8fed373f8b32fb.jpg saved to cache
2026-03-28 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25
2026-03-28 18:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7adc4e39-9198-592d-88fe-4a375358a9ad with identifier: LX07481
2026-03-28 18:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7adc4e39-9198-592d-88fe-4a375358a9ad with scrape type 1
2026-03-28 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7adc4e39-9198-592d-88fe-4a375358a9ad
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_5fa73d42a1045b36cbcf5d4b1f420c47.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_5fa73d42a1045b36cbcf5d4b1f420c47.jpg not downloaded yet
2026-03-28 18:46:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638f050>
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_8eb79ce411a28c0d81c57e4d9a351d01.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_8eb79ce411a28c0d81c57e4d9a351d01.jpg saved to cache
2026-03-28 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1
2026-03-28 18:46:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245463dd50>
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fd5%252F00d592af46e817ed74a00fb6d9dcfe6e%252Fpa%252FFD59666_c280c696e69145c02e3c05d007fd7bb9.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_c280c696e69145c02e3c05d007fd7bb9.jpg saved to cache
2026-03-28 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4
2026-03-28 18:46:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23d0b74e-10a0-5f6d-807a-8900e261a4e4, skipping ID generation
2026-03-28 18:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4 with scrape type 1
2026-03-28 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4 sending to next pipeline
2026-03-28 18:46:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23d0b74e-10a0-5f6d-807a-8900e261a4e4, identifier: FD59666
2026-03-28 18:46:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458559890>
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F13%252Fb4137b71801647764c412c4e8c81c300%252Fpa%252FDZ73228_aee8680b4f707f7834f8c64ab5362301.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_aee8680b4f707f7834f8c64ab5362301.jpg saved to cache
2026-03-28 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1
2026-03-28 18:46:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4fa49ad-ac77-5bce-bb06-2aed10975fc1, skipping ID generation
2026-03-28 18:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1 with scrape type 1
2026-03-28 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1 sending to next pipeline
2026-03-28 18:46:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4fa49ad-ac77-5bce-bb06-2aed10975fc1, identifier: DZ73228
2026-03-28 18:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_a335077190223df004aafa87be348947.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23d0b74e-10a0-5f6d-807a-8900e261a4e4 with identifier: FD59666
2026-03-28 18:46:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23d0b74e-10a0-5f6d-807a-8900e261a4e4 with identifier: FD59666
2026-03-28 18:46:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23d0b74e-10a0-5f6d-807a-8900e261a4e4 with identifier: FD59666 to the API
2026-03-28 18:46:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_c280c696e69145c02e3c05d007fd7bb9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:17:56Z',
 'fuel_type': 'petrol',
 'id': '23d0b74e-10a0-5f6d-807a-8900e261a4e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD59666',
 'listing': 'auction',
 'location': 'DE, Hof',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 10285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2397279,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_ce1c0710756e9eb119bc25b56b7cec36.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2351812,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_3fed93d8a6ea6318a1743a4a263f11f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2306546,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_190a23ace0326a72b510552632a26bf3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2203179,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_edbf586d018f73b99e9f252ab6efe8a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_442b7187e8d7f7a96e469d2ba7f98d2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_46fb3b90619d1a061de44d302d9809e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2351853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_c280c696e69145c02e3c05d007fd7bb9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_1244c4d233f3d479fe3971a3274321d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_369ecd740f2f1eb44108a6c6b7c49b76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23d0b74e-10a0-5f6d-807a-8900e261a4e4/23d0b74e-10a0-5f6d-807a-8900e261a4e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/d5/00d592af46e817ed74a00fb6d9dcfe6e/pa/FD59666_488d7efa8f707e27fdb40909618b6238.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2020}
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD59666%27 HTTP/1.1" 200 None
2026-03-28 18:46:12 [auto1.de] INFO: Saving data for FD59666: {'created_time': 1774723572.285469, 'last_price_update_time': 1774723572.285479, 'auction_closing_time': 1774883876.0}
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD59666') HTTP/1.1" 204 0
2026-03-28 18:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4fa49ad-ac77-5bce-bb06-2aed10975fc1 with identifier: DZ73228
2026-03-28 18:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4fa49ad-ac77-5bce-bb06-2aed10975fc1 with identifier: DZ73228
2026-03-28 18:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4fa49ad-ac77-5bce-bb06-2aed10975fc1 with identifier: DZ73228 to the API
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_aee8680b4f707f7834f8c64ab5362301.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:59Z',
 'fuel_type': 'diesel',
 'id': 'f4fa49ad-ac77-5bce-bb06-2aed10975fc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ73228',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 33556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2841866,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_be94ef071a1288017529de5a8dc19c9e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_a112d3bd8b7a9ae8afed314e791ce5ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2449888,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_102f5a26e5e6b3545379b770cc82d9cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2650214,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_aee8680b4f707f7834f8c64ab5362301.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_ecb77c07a395ded07989270ec9a1822c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2353652,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_3e96b34c2dc968995fe054cc09d93755.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_abfb926fc80dd17e7a7be940010fa6cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2328566,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_8eb79ce411a28c0d81c57e4d9a351d01.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2712786,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_2da45c951bfced27d302aab3b9e1196f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4fa49ad-ac77-5bce-bb06-2aed10975fc1/f4fa49ad-ac77-5bce-bb06-2aed10975fc1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2617610,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/13/b4137b71801647764c412c4e8c81c300/pa/DZ73228_d441f4bd07f52fb46a8c38101e8d456f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Goal',
 'transmission': 'automatic',
 'trim': 'Goal',
 'year': 2024}
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ73228%27 HTTP/1.1" 200 None
2026-03-28 18:46:12 [auto1.de] INFO: Saving data for DZ73228: {'created_time': 1774723572.680888, 'last_price_update_time': 1774723572.680899, 'auction_closing_time': 1774883399.0}
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ73228') HTTP/1.1" 204 0
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_c0a79cefc208ea22d5628fb8bdfcc915.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_c0a79cefc208ea22d5628fb8bdfcc915.jpg not downloaded yet
2026-03-28 18:46:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546a5b90>
2026-03-28 18:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_2bece38b53ce2268b1abbff3b7af5c68.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_2bece38b53ce2268b1abbff3b7af5c68.jpg saved to cache
2026-03-28 18:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d66889d0-9937-5e3e-8356-471cfa4e9016
2026-03-28 18:46:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a54d0>
2026-03-28 18:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_8921cf886abb61c112fa365efb49b9d6.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_8921cf886abb61c112fa365efb49b9d6.jpg saved to cache
2026-03-28 18:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d66889d0-9937-5e3e-8356-471cfa4e9016
2026-03-28 18:46:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456194a50>
2026-03-28 18:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F63%252Fe263d90792e9d7dfa09ccd74960fb1c8%252Fpa%252FRT08508_d3b4bed4e8a4bdc4bd5f204cc8951b13.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_d3b4bed4e8a4bdc4bd5f204cc8951b13.jpg saved to cache
2026-03-28 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d66889d0-9937-5e3e-8356-471cfa4e9016
2026-03-28 18:46:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d66889d0-9937-5e3e-8356-471cfa4e9016, skipping ID generation
2026-03-28 18:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d66889d0-9937-5e3e-8356-471cfa4e9016 with scrape type 1
2026-03-28 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d66889d0-9937-5e3e-8356-471cfa4e9016 sending to next pipeline
2026-03-28 18:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d66889d0-9937-5e3e-8356-471cfa4e9016, identifier: RT08508
2026-03-28 18:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454761d90>
2026-03-28 18:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_1069aa0e5c63bdb04f613dcb7a7faddb.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_1069aa0e5c63bdb04f613dcb7a7faddb.jpg saved to cache
2026-03-28 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25
2026-03-28 18:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d66889d0-9937-5e3e-8356-471cfa4e9016 with identifier: RT08508
2026-03-28 18:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d66889d0-9937-5e3e-8356-471cfa4e9016 with identifier: RT08508
2026-03-28 18:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d66889d0-9937-5e3e-8356-471cfa4e9016 with identifier: RT08508 to the API
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_d3b4bed4e8a4bdc4bd5f204cc8951b13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:17:19Z',
 'fuel_type': 'diesel',
 'id': 'd66889d0-9937-5e3e-8356-471cfa4e9016',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT08508',
 'listing': 'auction',
 'location': 'DE, Mönchengladbach',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 133773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3495462,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_28020786927f97341ee6d331587a4e5e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3254660,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_a4357894e34136d93ac6812ba9b841c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_c52687fad414dc37e943c3517c806823.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_100930598d4b40550beb010a3a09f58d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_602654551465a121a115d904cff58ee0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3286212,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_32f9632f82fd880106660acdc21b7fcf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_f4c174d0bee67d1606afb217d387d250.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3279344,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_d3b4bed4e8a4bdc4bd5f204cc8951b13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3186604,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_2bece38b53ce2268b1abbff3b7af5c68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66889d0-9937-5e3e-8356-471cfa4e9016/d66889d0-9937-5e3e-8356-471cfa4e9016_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3262088,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/63/e263d90792e9d7dfa09ccd74960fb1c8/pa/RT08508_8921cf886abb61c112fa365efb49b9d6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT08508%27 HTTP/1.1" 200 None
2026-03-28 18:46:13 [auto1.de] INFO: Saving data for RT08508: {'created_time': 1774723573.601927, 'last_price_update_time': 1774723573.601945, 'auction_closing_time': 1774883839.0}
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT08508') HTTP/1.1" 204 0
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_e486a4a824d93182493ef73d89e7bb3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_e486a4a824d93182493ef73d89e7bb3d.jpg not downloaded yet
2026-03-28 18:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VD40849> (referer: https://www.auto1.com/v1/car-details-view/VD40849/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456310a10>
2026-03-28 18:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fea%252Fc8ea6430e4d73746eb49aadeb8460691%252Fpa%252FBY26931_a335077190223df004aafa87be348947.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_a335077190223df004aafa87be348947.jpg saved to cache
2026-03-28 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25
2026-03-28 18:46:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3e17ed1-4c2d-5272-b421-ecf43bfb7a25, skipping ID generation
2026-03-28 18:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25 with scrape type 1
2026-03-28 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25 sending to next pipeline
2026-03-28 18:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3e17ed1-4c2d-5272-b421-ecf43bfb7a25, identifier: BY26931
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_96ce5b988976876cbedec0d7604fa10e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_96ce5b988976876cbedec0d7604fa10e.jpg not downloaded yet
2026-03-28 18:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3e17ed1-4c2d-5272-b421-ecf43bfb7a25 with identifier: BY26931
2026-03-28 18:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3e17ed1-4c2d-5272-b421-ecf43bfb7a25 with identifier: BY26931
2026-03-28 18:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3e17ed1-4c2d-5272-b421-ecf43bfb7a25 with identifier: BY26931 to the API
2026-03-28 18:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_a335077190223df004aafa87be348947.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:40:46Z',
 'fuel_type': 'diesel',
 'id': 'a3e17ed1-4c2d-5272-b421-ecf43bfb7a25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY26931',
 'listing': 'auction',
 'location': 'DE, Kumhausen',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 98818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_93b385d788a4649ddf5508c4e941521b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_1069aa0e5c63bdb04f613dcb7a7faddb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_91f1c72a20f0796d9f03fd69515f4c7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2383552,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_74094fe5c2136b3e312c90209ee2c401.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_a335077190223df004aafa87be348947.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_75e44e5676665a695bf520df1fa62ba0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_2534fc778867dd0b9c8fed373f8b32fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_a8c65c4e422b44feac5218e55e82746f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_404fccb75e28ac7af953a19daa5b52bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3e17ed1-4c2d-5272-b421-ecf43bfb7a25/a3e17ed1-4c2d-5272-b421-ecf43bfb7a25_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/ea/c8ea6430e4d73746eb49aadeb8460691/pa/BY26931_91fd1a5f0bbc67023a6727da51e6af8c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Beach',
 'transmission': 'automatic',
 'trim': 'Beach',
 'year': 2018}
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26931%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [auto1.de] INFO: Saving data for BY26931: {'created_time': 1774723574.173424, 'last_price_update_time': 1774723574.173436, 'auction_closing_time': 1774885246.0}
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY26931') HTTP/1.1" 204 0
2026-03-28 18:46:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_21d19b4259f8bd07c180c08a4d900150.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_21d19b4259f8bd07c180c08a4d900150.jpg not downloaded yet
2026-03-28 18:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ46464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK16963> (referer: https://www.auto1.com/v1/car-details-view/AK16963/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY99626> (referer: https://www.auto1.com/v1/car-details-view/JY99626/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE64708> (referer: https://www.auto1.com/v1/car-details-view/HE64708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ce504b-cf12-5d18-968f-8f13fa6023c6 with identifier: VD40849
2026-03-28 18:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ce504b-cf12-5d18-968f-8f13fa6023c6 with scrape type 1
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20ce504b-cf12-5d18-968f-8f13fa6023c6
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_e9fe266b9f3ca4fcd111b6d3a14edaf4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_e9fe266b9f3ca4fcd111b6d3a14edaf4.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_b06928d3e33c0b5f8580349385255fdc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_b06928d3e33c0b5f8580349385255fdc.jpg not downloaded yet
2026-03-28 18:46:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_65b2be5c2046305e596a828735538911.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_65b2be5c2046305e596a828735538911.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_9dcfc644169562eb3fa1f828668dea12.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_9dcfc644169562eb3fa1f828668dea12.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_39479baf27929305fc6860f74287be6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_39479baf27929305fc6860f74287be6d.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_3f05375c3a5fd72a40f08179060127ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_3f05375c3a5fd72a40f08179060127ca.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_4bc2c622e44e83b323e7ab16d1c0ad87.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_4bc2c622e44e83b323e7ab16d1c0ad87.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_0924cf49516cfdf4faeea73b1a1d7899.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_0924cf49516cfdf4faeea73b1a1d7899.jpg not downloaded yet
2026-03-28 18:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c285e17-d0e8-59db-9108-bc37c27bf963 with identifier: AK16963
2026-03-28 18:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c285e17-d0e8-59db-9108-bc37c27bf963 with scrape type 1
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3c285e17-d0e8-59db-9108-bc37c27bf963
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fea%252F31ea0ed88d2e684aee7e6c194d0c9dff%252Fpa%252FAK16963_26a067d1b1af687ecb2f4b3c37e21606.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_26a067d1b1af687ecb2f4b3c37e21606.jpg not downloaded yet
2026-03-28 18:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3f89c88-dfc3-5350-af06-7828b253e018 with identifier: JY99626
2026-03-28 18:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3f89c88-dfc3-5350-af06-7828b253e018 with scrape type 1
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3f89c88-dfc3-5350-af06-7828b253e018
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_02861c13d78080022b0c810178db5e17.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_02861c13d78080022b0c810178db5e17.jpg not downloaded yet
2026-03-28 18:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2 with identifier: HE64708
2026-03-28 18:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2 with scrape type 1
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_330f0a4ad25e7602b96e64ba48d4b8d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_330f0a4ad25e7602b96e64ba48d4b8d6.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_89454995df926b472ee5554b8e5adccc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_89454995df926b472ee5554b8e5adccc.jpg not downloaded yet
2026-03-28 18:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_bde3eb9e4761cd5a9ecd4f83987cef27.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_27287dd6a49d48c4033713a989ee960b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_27287dd6a49d48c4033713a989ee960b.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fea%252F31ea0ed88d2e684aee7e6c194d0c9dff%252Fpa%252FAK16963_bc37b8836b18bcd396768a5c7a7bd402.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_bc37b8836b18bcd396768a5c7a7bd402.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_aa27bc0d35d6f2fc12c4159e4f68f880.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_aa27bc0d35d6f2fc12c4159e4f68f880.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_6db968b782975cff1e811a008f698aa8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_6db968b782975cff1e811a008f698aa8.jpg not downloaded yet
2026-03-28 18:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_5365864a9c6d6de217154cc1fc5ba0d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_c42369031d195f63364c1bd8431312ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_c42369031d195f63364c1bd8431312ce.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fea%252F31ea0ed88d2e684aee7e6c194d0c9dff%252Fpa%252FAK16963_964acf7d4f2b0f01bea49cc3168e7571.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_964acf7d4f2b0f01bea49cc3168e7571.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_22c81cffc0859e3125f45d0ecac28dd1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_22c81cffc0859e3125f45d0ecac28dd1.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_b735a20cdf338c3cf9fd83938cfa0d8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_b735a20cdf338c3cf9fd83938cfa0d8b.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_c8c065dcc7da140940fc0936cb13a880.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_c8c065dcc7da140940fc0936cb13a880.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fea%252F31ea0ed88d2e684aee7e6c194d0c9dff%252Fpa%252FAK16963_7aa0fe628071ac269f0820c0fe5e7596.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_7aa0fe628071ac269f0820c0fe5e7596.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_89f68fe185a71500fea30a557b1a38e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_89f68fe185a71500fea30a557b1a38e9.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_288d70c10bea2f21c697295080f8f93f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_288d70c10bea2f21c697295080f8f93f.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_1897eadf5bc515d120d8747868076522.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_1897eadf5bc515d120d8747868076522.jpg not downloaded yet
2026-03-28 18:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456313910>
2026-03-28 18:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_bde3eb9e4761cd5a9ecd4f83987cef27.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_bde3eb9e4761cd5a9ecd4f83987cef27.jpg saved to cache
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fea%252F31ea0ed88d2e684aee7e6c194d0c9dff%252Fpa%252FAK16963_087356751ce2bd6e716c86f4b7aec077.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_087356751ce2bd6e716c86f4b7aec077.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_42c310d91466441b90e283e0e81fe3b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_42c310d91466441b90e283e0e81fe3b7.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_3d9f2a63304ed50bf9706131312fc03f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_3d9f2a63304ed50bf9706131312fc03f.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_ffedd44f756c50889b785a031d2e3299.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_ffedd44f756c50889b785a031d2e3299.jpg not downloaded yet
2026-03-28 18:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456094a50>
2026-03-28 18:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_5365864a9c6d6de217154cc1fc5ba0d6.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_5365864a9c6d6de217154cc1fc5ba0d6.jpg saved to cache
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a
2026-03-28 18:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_96ce5b988976876cbedec0d7604fa10e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_bf0b0949470d86d987e4d884703f9fd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_bf0b0949470d86d987e4d884703f9fd0.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_8353c5f9ea0c0cb272a089890bf2f056.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_8353c5f9ea0c0cb272a089890bf2f056.jpg not downloaded yet
2026-03-28 18:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_21d19b4259f8bd07c180c08a4d900150.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_55427b5297d129df7c786d58227ff22f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_55427b5297d129df7c786d58227ff22f.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_a6aa6999654ec97f2c341b8f4739aa04.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_a6aa6999654ec97f2c341b8f4739aa04.jpg not downloaded yet
2026-03-28 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_5f27ec288313c88d8c49f0a0c9d723a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_5f27ec288313c88d8c49f0a0c9d723a6.jpg not downloaded yet
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_1ad442be297d53752cb4ebbd63cd001e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_1ad442be297d53752cb4ebbd63cd001e.jpg not downloaded yet
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_a379f50931ab38157ee3795b65409217.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_a379f50931ab38157ee3795b65409217.jpg not downloaded yet
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_330f0a4ad25e7602b96e64ba48d4b8d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_6db968b782975cff1e811a008f698aa8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_c7167353fd5d47414678ee2c238c350d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_c7167353fd5d47414678ee2c238c350d.jpg not downloaded yet
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_90339d55eaa30a6025ebc680c0742bec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_90339d55eaa30a6025ebc680c0742bec.jpg not downloaded yet
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_3d9f2a63304ed50bf9706131312fc03f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_481e0421fc17e5476f085b658d720403.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_481e0421fc17e5476f085b658d720403.jpg not downloaded yet
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_0b291774e88d3ca42864f52b8959886a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_0b291774e88d3ca42864f52b8959886a.jpg not downloaded yet
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477be10>
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_96ce5b988976876cbedec0d7604fa10e.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_96ce5b988976876cbedec0d7604fa10e.jpg saved to cache
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7adc4e39-9198-592d-88fe-4a375358a9ad
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24582a5ed0>
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_21d19b4259f8bd07c180c08a4d900150.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_21d19b4259f8bd07c180c08a4d900150.jpg saved to cache
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7adc4e39-9198-592d-88fe-4a375358a9ad
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_8353c5f9ea0c0cb272a089890bf2f056.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547ee490>
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_330f0a4ad25e7602b96e64ba48d4b8d6.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_330f0a4ad25e7602b96e64ba48d4b8d6.jpg saved to cache
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a6c10>
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_6db968b782975cff1e811a008f698aa8.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_6db968b782975cff1e811a008f698aa8.jpg saved to cache
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24548190d0>
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_3d9f2a63304ed50bf9706131312fc03f.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_3d9f2a63304ed50bf9706131312fc03f.jpg saved to cache
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_0e05d4cc12f178763b105a9b99f197d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_1940a9b0eaea1b30e37d05e807550c17.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_a379f50931ab38157ee3795b65409217.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_5f27ec288313c88d8c49f0a0c9d723a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU28029> (referer: https://www.auto1.com/v1/car-details-view/JU28029/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245619a950>
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_8353c5f9ea0c0cb272a089890bf2f056.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_8353c5f9ea0c0cb272a089890bf2f056.jpg saved to cache
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_9d151a138a9e4ad5d99a5abf641a3b2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_5fa73d42a1045b36cbcf5d4b1f420c47.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_e486a4a824d93182493ef73d89e7bb3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_c0a79cefc208ea22d5628fb8bdfcc915.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24548111d0>
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_0e05d4cc12f178763b105a9b99f197d0.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_0e05d4cc12f178763b105a9b99f197d0.jpg saved to cache
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ88951/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK18000/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC68366/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245624ed10>
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_1940a9b0eaea1b30e37d05e807550c17.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_1940a9b0eaea1b30e37d05e807550c17.jpg saved to cache
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561bc150>
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_a379f50931ab38157ee3795b65409217.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_a379f50931ab38157ee3795b65409217.jpg saved to cache
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456401710>
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_5f27ec288313c88d8c49f0a0c9d723a6.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_5f27ec288313c88d8c49f0a0c9d723a6.jpg saved to cache
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2
2026-03-28 18:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a with identifier: JU28029
2026-03-28 18:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a with scrape type 1
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fde%252F28de7599612263941b10f80d5c0bcc1e%252Fpa%252FJU28029_6dd0f6114cb62b0615441d5e9229e7b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_6dd0f6114cb62b0615441d5e9229e7b4.jpg already downloaded
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fde%252F28de7599612263941b10f80d5c0bcc1e%252Fpa%252FJU28029_59a6426446c85ca69f8fbb8da603f41f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_59a6426446c85ca69f8fbb8da603f41f.jpg already downloaded
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fde%252F28de7599612263941b10f80d5c0bcc1e%252Fpa%252FJU28029_1cc6f30cea3414e2ca3ab05509121073.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_1cc6f30cea3414e2ca3ab05509121073.jpg already downloaded
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fde%252F28de7599612263941b10f80d5c0bcc1e%252Fpa%252FJU28029_34c548df217b70f27781bb1211ec00c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_34c548df217b70f27781bb1211ec00c3.jpg already downloaded
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fde%252F28de7599612263941b10f80d5c0bcc1e%252Fpa%252FJU28029_df05080d699f5e387a07fba16043c5fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_df05080d699f5e387a07fba16043c5fa.jpg already downloaded
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fde%252F28de7599612263941b10f80d5c0bcc1e%252Fpa%252FJU28029_4de945cbdf8a79b668efc0533c5fa651.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_4de945cbdf8a79b668efc0533c5fa651.jpg already downloaded
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fde%252F28de7599612263941b10f80d5c0bcc1e%252Fpa%252FJU28029_44fea50972b8f4f90d83457f312bdb87.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_44fea50972b8f4f90d83457f312bdb87.jpg already downloaded
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fde%252F28de7599612263941b10f80d5c0bcc1e%252Fpa%252FJU28029_952234d66246b7cb2f41d7f500b0f7d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_952234d66246b7cb2f41d7f500b0f7d7.jpg already downloaded
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fde%252F28de7599612263941b10f80d5c0bcc1e%252Fpa%252FJU28029_3b87ba42d33b589846075a2027f8862f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_3b87ba42d33b589846075a2027f8862f.jpg already downloaded
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fde%252F28de7599612263941b10f80d5c0bcc1e%252Fpa%252FJU28029_601c50e437219d0f4542322cd9eda8a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_601c50e437219d0f4542322cd9eda8a2.jpg already downloaded
2026-03-28 18:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a, identifier: JU28029
2026-03-28 18:46:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454811910>
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_9d151a138a9e4ad5d99a5abf641a3b2c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_9d151a138a9e4ad5d99a5abf641a3b2c.jpg saved to cache
2026-03-28 18:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a
2026-03-28 18:46:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456158d90>
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_5fa73d42a1045b36cbcf5d4b1f420c47.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_5fa73d42a1045b36cbcf5d4b1f420c47.jpg saved to cache
2026-03-28 18:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7adc4e39-9198-592d-88fe-4a375358a9ad
2026-03-28 18:46:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456198490>
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_e486a4a824d93182493ef73d89e7bb3d.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_e486a4a824d93182493ef73d89e7bb3d.jpg saved to cache
2026-03-28 18:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7adc4e39-9198-592d-88fe-4a375358a9ad
2026-03-28 18:46:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564ee9d0>
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_c0a79cefc208ea22d5628fb8bdfcc915.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_c0a79cefc208ea22d5628fb8bdfcc915.jpg saved to cache
2026-03-28 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7adc4e39-9198-592d-88fe-4a375358a9ad
2026-03-28 18:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a with identifier: JU28029
2026-03-28 18:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a with identifier: JU28029
2026-03-28 18:46:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a with identifier: JU28029 to the API
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JU28029>
{'auction_title': '',
 'c_o_2_emission_value': 200,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:57:19Z',
 'fuel_type': 'petrol',
 'id': '89e4b264-951e-5bd4-b4b6-b21c0ec96c7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU28029',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 71643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_6dd0f6114cb62b0615441d5e9229e7b4.jpg',
                'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_59a6426446c85ca69f8fbb8da603f41f.jpg',
                'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_1cc6f30cea3414e2ca3ab05509121073.jpg',
                'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_34c548df217b70f27781bb1211ec00c3.jpg',
                'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_df05080d699f5e387a07fba16043c5fa.jpg',
                'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_4de945cbdf8a79b668efc0533c5fa651.jpg',
                'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_44fea50972b8f4f90d83457f312bdb87.jpg',
                'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_952234d66246b7cb2f41d7f500b0f7d7.jpg',
                'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_3b87ba42d33b589846075a2027f8862f.jpg',
                'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_601c50e437219d0f4542322cd9eda8a2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e4b264-951e-5bd4-b4b6-b21c0ec96c7a/89e4b264-951e-5bd4-b4b6-b21c0ec96c7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2507827,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_6dd0f6114cb62b0615441d5e9229e7b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e4b264-951e-5bd4-b4b6-b21c0ec96c7a/89e4b264-951e-5bd4-b4b6-b21c0ec96c7a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_59a6426446c85ca69f8fbb8da603f41f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e4b264-951e-5bd4-b4b6-b21c0ec96c7a/89e4b264-951e-5bd4-b4b6-b21c0ec96c7a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_1cc6f30cea3414e2ca3ab05509121073.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e4b264-951e-5bd4-b4b6-b21c0ec96c7a/89e4b264-951e-5bd4-b4b6-b21c0ec96c7a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2408360,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_34c548df217b70f27781bb1211ec00c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e4b264-951e-5bd4-b4b6-b21c0ec96c7a/89e4b264-951e-5bd4-b4b6-b21c0ec96c7a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2768072,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_df05080d699f5e387a07fba16043c5fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e4b264-951e-5bd4-b4b6-b21c0ec96c7a/89e4b264-951e-5bd4-b4b6-b21c0ec96c7a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_4de945cbdf8a79b668efc0533c5fa651.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e4b264-951e-5bd4-b4b6-b21c0ec96c7a/89e4b264-951e-5bd4-b4b6-b21c0ec96c7a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380015,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_44fea50972b8f4f90d83457f312bdb87.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e4b264-951e-5bd4-b4b6-b21c0ec96c7a/89e4b264-951e-5bd4-b4b6-b21c0ec96c7a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_952234d66246b7cb2f41d7f500b0f7d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e4b264-951e-5bd4-b4b6-b21c0ec96c7a/89e4b264-951e-5bd4-b4b6-b21c0ec96c7a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2405987,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_3b87ba42d33b589846075a2027f8862f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89e4b264-951e-5bd4-b4b6-b21c0ec96c7a/89e4b264-951e-5bd4-b4b6-b21c0ec96c7a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2696380,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/de/28de7599612263941b10f80d5c0bcc1e/pa/JU28029_601c50e437219d0f4542322cd9eda8a2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU28029%27 HTTP/1.1" 200 None
2026-03-28 18:46:17 [auto1.de] INFO: Saving data for JU28029: {'created_time': 1774723577.377706, 'last_price_update_time': 1774723577.377717, 'auction_closing_time': 1774886239.0}
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU28029') HTTP/1.1" 204 0
2026-03-28 18:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE46966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_90339d55eaa30a6025ebc680c0742bec.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_0b291774e88d3ca42864f52b8959886a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_c7167353fd5d47414678ee2c238c350d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_481e0421fc17e5476f085b658d720403.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_1897eadf5bc515d120d8747868076522.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245627cd10>
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_90339d55eaa30a6025ebc680c0742bec.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_90339d55eaa30a6025ebc680c0742bec.jpg saved to cache
2026-03-28 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2
2026-03-28 18:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_288d70c10bea2f21c697295080f8f93f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_087356751ce2bd6e716c86f4b7aec077.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456192cd0>
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_0b291774e88d3ca42864f52b8959886a.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_0b291774e88d3ca42864f52b8959886a.jpg saved to cache
2026-03-28 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456071e50>
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_c7167353fd5d47414678ee2c238c350d.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_c7167353fd5d47414678ee2c238c350d.jpg saved to cache
2026-03-28 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3f89c88-dfc3-5350-af06-7828b253e018
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562cb190>
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_481e0421fc17e5476f085b658d720403.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_481e0421fc17e5476f085b658d720403.jpg saved to cache
2026-03-28 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3f89c88-dfc3-5350-af06-7828b253e018
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24590d24d0>
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_1897eadf5bc515d120d8747868076522.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_1897eadf5bc515d120d8747868076522.jpg saved to cache
2026-03-28 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20ce504b-cf12-5d18-968f-8f13fa6023c6
2026-03-28 18:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_89f68fe185a71500fea30a557b1a38e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561a7790>
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_288d70c10bea2f21c697295080f8f93f.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_288d70c10bea2f21c697295080f8f93f.jpg saved to cache
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562c8350>
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c285e17-d0e8-59db-9108-bc37c27bf963/3c285e17-d0e8-59db-9108-bc37c27bf963_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fea%252F31ea0ed88d2e684aee7e6c194d0c9dff%252Fpa%252FAK16963_087356751ce2bd6e716c86f4b7aec077.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_087356751ce2bd6e716c86f4b7aec077.jpg saved to cache
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c285e17-d0e8-59db-9108-bc37c27bf963
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_c8c065dcc7da140940fc0936cb13a880.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_7aa0fe628071ac269f0820c0fe5e7596.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245651b350>
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_89f68fe185a71500fea30a557b1a38e9.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_89f68fe185a71500fea30a557b1a38e9.jpg saved to cache
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3f89c88-dfc3-5350-af06-7828b253e018
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_b735a20cdf338c3cf9fd83938cfa0d8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_a6aa6999654ec97f2c341b8f4739aa04.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_55427b5297d129df7c786d58227ff22f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_22c81cffc0859e3125f45d0ecac28dd1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_1ad442be297d53752cb4ebbd63cd001e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_bf0b0949470d86d987e4d884703f9fd0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_42c310d91466441b90e283e0e81fe3b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_ffedd44f756c50889b785a031d2e3299.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245615bb10>
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_c8c065dcc7da140940fc0936cb13a880.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_c8c065dcc7da140940fc0936cb13a880.jpg saved to cache
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20ce504b-cf12-5d18-968f-8f13fa6023c6
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245632a0d0>
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c285e17-d0e8-59db-9108-bc37c27bf963/3c285e17-d0e8-59db-9108-bc37c27bf963_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fea%252F31ea0ed88d2e684aee7e6c194d0c9dff%252Fpa%252FAK16963_7aa0fe628071ac269f0820c0fe5e7596.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_7aa0fe628071ac269f0820c0fe5e7596.jpg saved to cache
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c285e17-d0e8-59db-9108-bc37c27bf963
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563db750>
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cd0bbcdf9d3d5350b9addb732d2f7%252Fpa%252FHE64708_b735a20cdf338c3cf9fd83938cfa0d8b.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_b735a20cdf338c3cf9fd83938cfa0d8b.jpg saved to cache
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2
2026-03-28 18:46:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2, skipping ID generation
2026-03-28 18:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2 with scrape type 1
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2 sending to next pipeline
2026-03-28 18:46:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2, identifier: HE64708
2026-03-28 18:46:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2 with identifier: HE64708
2026-03-28 18:46:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2 with identifier: HE64708
2026-03-28 18:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2 with identifier: HE64708 to the API
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_b735a20cdf338c3cf9fd83938cfa0d8b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:16:28Z',
 'fuel_type': 'diesel',
 'id': '9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE64708',
 'listing': 'auction',
 'location': 'DE, Erfurt',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 175526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_330f0a4ad25e7602b96e64ba48d4b8d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_6db968b782975cff1e811a008f698aa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_b735a20cdf338c3cf9fd83938cfa0d8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_288d70c10bea2f21c697295080f8f93f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_3d9f2a63304ed50bf9706131312fc03f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_8353c5f9ea0c0cb272a089890bf2f056.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_5f27ec288313c88d8c49f0a0c9d723a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_a379f50931ab38157ee3795b65409217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2692040,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_90339d55eaa30a6025ebc680c0742bec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2/9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2814207,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cd0bbcdf9d3d5350b9addb732d2f7/pa/HE64708_0b291774e88d3ca42864f52b8959886a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Alltrack BlueMotion',
 'transmission': 'manual',
 'trim': 'Alltrack BlueMotion',
 'year': 2017}
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE64708%27 HTTP/1.1" 200 None
2026-03-28 18:46:18 [auto1.de] INFO: Saving data for HE64708: {'created_time': 1774723578.802939, 'last_price_update_time': 1774723578.80295, 'auction_closing_time': 1774883788.0}
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE64708') HTTP/1.1" 204 0
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_964acf7d4f2b0f01bea49cc3168e7571.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_bc37b8836b18bcd396768a5c7a7bd402.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC68366> (referer: https://www.auto1.com/v1/car-details-view/BC68366/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE46966> (referer: https://www.auto1.com/v1/car-details-view/BE46966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK18000> (referer: https://www.auto1.com/v1/car-details-view/VK18000/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855b3d0>
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_a6aa6999654ec97f2c341b8f4739aa04.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_a6aa6999654ec97f2c341b8f4739aa04.jpg saved to cache
2026-03-28 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3f89c88-dfc3-5350-af06-7828b253e018
2026-03-28 18:46:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561ef550>
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_55427b5297d129df7c786d58227ff22f.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_55427b5297d129df7c786d58227ff22f.jpg saved to cache
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20ce504b-cf12-5d18-968f-8f13fa6023c6
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b30d0>
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_22c81cffc0859e3125f45d0ecac28dd1.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_22c81cffc0859e3125f45d0ecac28dd1.jpg saved to cache
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3f89c88-dfc3-5350-af06-7828b253e018
2026-03-28 18:46:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245632a950>
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_1ad442be297d53752cb4ebbd63cd001e.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_1ad442be297d53752cb4ebbd63cd001e.jpg saved to cache
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3f89c88-dfc3-5350-af06-7828b253e018
2026-03-28 18:46:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561899d0>
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_bf0b0949470d86d987e4d884703f9fd0.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_bf0b0949470d86d987e4d884703f9fd0.jpg saved to cache
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3f89c88-dfc3-5350-af06-7828b253e018
2026-03-28 18:46:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454646c90>
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_42c310d91466441b90e283e0e81fe3b7.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_42c310d91466441b90e283e0e81fe3b7.jpg saved to cache
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3f89c88-dfc3-5350-af06-7828b253e018
2026-03-28 18:46:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b2b10>
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_ffedd44f756c50889b785a031d2e3299.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_ffedd44f756c50889b785a031d2e3299.jpg saved to cache
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20ce504b-cf12-5d18-968f-8f13fa6023c6
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454646290>
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c285e17-d0e8-59db-9108-bc37c27bf963/3c285e17-d0e8-59db-9108-bc37c27bf963_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fea%252F31ea0ed88d2e684aee7e6c194d0c9dff%252Fpa%252FAK16963_964acf7d4f2b0f01bea49cc3168e7571.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_964acf7d4f2b0f01bea49cc3168e7571.jpg saved to cache
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c285e17-d0e8-59db-9108-bc37c27bf963
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454811250>
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c285e17-d0e8-59db-9108-bc37c27bf963/3c285e17-d0e8-59db-9108-bc37c27bf963_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fea%252F31ea0ed88d2e684aee7e6c194d0c9dff%252Fpa%252FAK16963_bc37b8836b18bcd396768a5c7a7bd402.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_bc37b8836b18bcd396768a5c7a7bd402.jpg saved to cache
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c285e17-d0e8-59db-9108-bc37c27bf963
2026-03-28 18:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d73cd456-3a47-5e5c-b96b-442fafff7a78 with identifier: BC68366
2026-03-28 18:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d73cd456-3a47-5e5c-b96b-442fafff7a78 with scrape type 1
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d73cd456-3a47-5e5c-b96b-442fafff7a78
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F3d%252F493d1aa11824c232d6a9ded5e6db4316%252Fpa%252FBC68366_a0619c85b2bdf58a23d1f12756fa321c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_a0619c85b2bdf58a23d1f12756fa321c.jpg already downloaded
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F3d%252F493d1aa11824c232d6a9ded5e6db4316%252Fpa%252FBC68366_f3cb16236b02408fe37765cfbf2ec2df.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_f3cb16236b02408fe37765cfbf2ec2df.jpg already downloaded
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F3d%252F493d1aa11824c232d6a9ded5e6db4316%252Fpa%252FBC68366_979c6ae4505e3ce4a9793f2f978e909c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_979c6ae4505e3ce4a9793f2f978e909c.jpg already downloaded
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F3d%252F493d1aa11824c232d6a9ded5e6db4316%252Fpa%252FBC68366_4c2123636e2288df8097d69113443896.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_4c2123636e2288df8097d69113443896.jpg already downloaded
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F3d%252F493d1aa11824c232d6a9ded5e6db4316%252Fpa%252FBC68366_169e2b71fb16a168b180edda94eec903.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_169e2b71fb16a168b180edda94eec903.jpg already downloaded
2026-03-28 18:46:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d73cd456-3a47-5e5c-b96b-442fafff7a78, identifier: BC68366
2026-03-28 18:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6c393d5-69d3-5a3f-92a0-ca03f32db445 with identifier: BE46966
2026-03-28 18:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6c393d5-69d3-5a3f-92a0-ca03f32db445 with scrape type 1
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_5c86e4e1f028b5cb73572aa13aa6f3ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_5c86e4e1f028b5cb73572aa13aa6f3ea.jpg not downloaded yet
2026-03-28 18:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27cc3358-c343-58b8-b89e-c8a05a9677f4 with identifier: VK18000
2026-03-28 18:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27cc3358-c343-58b8-b89e-c8a05a9677f4 with scrape type 1
2026-03-28 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27cc3358-c343-58b8-b89e-c8a05a9677f4
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_84f95f73f342655c35292838ac9d285e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_84f95f73f342655c35292838ac9d285e.jpg not downloaded yet
2026-03-28 18:46:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d73cd456-3a47-5e5c-b96b-442fafff7a78 with identifier: BC68366
2026-03-28 18:46:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d73cd456-3a47-5e5c-b96b-442fafff7a78 with identifier: BC68366
2026-03-28 18:46:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d73cd456-3a47-5e5c-b96b-442fafff7a78 with identifier: BC68366 to the API
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BC68366>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:13Z',
 'fuel_type': 'diesel',
 'id': 'd73cd456-3a47-5e5c-b96b-442fafff7a78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC68366',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Alfa Romeo',
 'model': 'Alfa GT',
 'odometer': 304237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_a0619c85b2bdf58a23d1f12756fa321c.jpg',
                'https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_f3cb16236b02408fe37765cfbf2ec2df.jpg',
                'https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_979c6ae4505e3ce4a9793f2f978e909c.jpg',
                'https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_4c2123636e2288df8097d69113443896.jpg',
                'https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_169e2b71fb16a168b180edda94eec903.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73cd456-3a47-5e5c-b96b-442fafff7a78/d73cd456-3a47-5e5c-b96b-442fafff7a78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_a0619c85b2bdf58a23d1f12756fa321c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73cd456-3a47-5e5c-b96b-442fafff7a78/d73cd456-3a47-5e5c-b96b-442fafff7a78_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_f3cb16236b02408fe37765cfbf2ec2df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73cd456-3a47-5e5c-b96b-442fafff7a78/d73cd456-3a47-5e5c-b96b-442fafff7a78_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_979c6ae4505e3ce4a9793f2f978e909c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73cd456-3a47-5e5c-b96b-442fafff7a78/d73cd456-3a47-5e5c-b96b-442fafff7a78_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_4c2123636e2288df8097d69113443896.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73cd456-3a47-5e5c-b96b-442fafff7a78/d73cd456-3a47-5e5c-b96b-442fafff7a78_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/3d/493d1aa11824c232d6a9ded5e6db4316/pa/BC68366_169e2b71fb16a168b180edda94eec903.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Alfa GT 1.9 JTD M-Jet Distinctive',
 'transmission': 'manual',
 'trim': 'M-Jet Distinctive',
 'year': 2008}
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC68366%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [auto1.de] INFO: Saving data for BC68366: {'created_time': 1774723580.332695, 'last_price_update_time': 1774723580.332707, 'auction_closing_time': 1774883953.0}
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC68366') HTTP/1.1" 204 0
2026-03-28 18:46:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_05fca88348ba9683a240c7f181636266.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_05fca88348ba9683a240c7f181636266.jpg not downloaded yet
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_0b77914ece4cb3407a1de50b19836a32.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_0b77914ece4cb3407a1de50b19836a32.jpg not downloaded yet
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_f8ab0e66b0fb6c65908da751e074e73f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f8ab0e66b0fb6c65908da751e074e73f.jpg not downloaded yet
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_6b19450497e3f8c062dd3e597ff2f9e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_6b19450497e3f8c062dd3e597ff2f9e9.jpg not downloaded yet
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_499467258efe755a6c9a50840b393d9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_499467258efe755a6c9a50840b393d9c.jpg not downloaded yet
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_e977db2d9e41c7e7bad8b7a9f0b44cc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_e977db2d9e41c7e7bad8b7a9f0b44cc2.jpg not downloaded yet
2026-03-28 18:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_4bc2c622e44e83b323e7ab16d1c0ad87.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_f935dcdbd1bc5469174d6c960b7948f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f935dcdbd1bc5469174d6c960b7948f4.jpg not downloaded yet
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_fe16ba12295b2050d0ba29804076f7a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_fe16ba12295b2050d0ba29804076f7a2.jpg not downloaded yet
2026-03-28 18:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_26a067d1b1af687ecb2f4b3c37e21606.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_712f87ff75d6d7f34754914085ce32d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_712f87ff75d6d7f34754914085ce32d8.jpg not downloaded yet
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_f79226fe6e08388a6ce8cab5ee9c2924.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_f79226fe6e08388a6ce8cab5ee9c2924.jpg not downloaded yet
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_9a179181824ca5abc3c899b57c74a243.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9a179181824ca5abc3c899b57c74a243.jpg not downloaded yet
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_b71fbc33dbc08dfb7714379e260168f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_b71fbc33dbc08dfb7714379e260168f2.jpg not downloaded yet
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_7d4109eecc3f5031ed9d7e496eee0b60.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7d4109eecc3f5031ed9d7e496eee0b60.jpg not downloaded yet
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_d076a71c1490409d851623fd91b556f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_d076a71c1490409d851623fd91b556f6.jpg not downloaded yet
2026-03-28 18:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562849d0>
2026-03-28 18:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_4bc2c622e44e83b323e7ab16d1c0ad87.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_4bc2c622e44e83b323e7ab16d1c0ad87.jpg saved to cache
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20ce504b-cf12-5d18-968f-8f13fa6023c6
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_7f112229e840beaffb7c75865a4bd943.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7f112229e840beaffb7c75865a4bd943.jpg not downloaded yet
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_1375d4a89e1ecc950eee5710e8f50389.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_1375d4a89e1ecc950eee5710e8f50389.jpg not downloaded yet
2026-03-28 18:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456537bd0>
2026-03-28 18:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c285e17-d0e8-59db-9108-bc37c27bf963/3c285e17-d0e8-59db-9108-bc37c27bf963_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fea%252F31ea0ed88d2e684aee7e6c194d0c9dff%252Fpa%252FAK16963_26a067d1b1af687ecb2f4b3c37e21606.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_26a067d1b1af687ecb2f4b3c37e21606.jpg saved to cache
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c285e17-d0e8-59db-9108-bc37c27bf963
2026-03-28 18:46:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c285e17-d0e8-59db-9108-bc37c27bf963, skipping ID generation
2026-03-28 18:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c285e17-d0e8-59db-9108-bc37c27bf963 with scrape type 1
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c285e17-d0e8-59db-9108-bc37c27bf963 sending to next pipeline
2026-03-28 18:46:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c285e17-d0e8-59db-9108-bc37c27bf963, identifier: AK16963
2026-03-28 18:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_0924cf49516cfdf4faeea73b1a1d7899.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_9dc14a2304457559c75c1d533091dac1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9dc14a2304457559c75c1d533091dac1.jpg not downloaded yet
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_e69fac678c2b3a310842433440f27dd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_e69fac678c2b3a310842433440f27dd5.jpg not downloaded yet
2026-03-28 18:46:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c285e17-d0e8-59db-9108-bc37c27bf963 with identifier: AK16963
2026-03-28 18:46:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c285e17-d0e8-59db-9108-bc37c27bf963 with identifier: AK16963
2026-03-28 18:46:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c285e17-d0e8-59db-9108-bc37c27bf963 with identifier: AK16963 to the API
2026-03-28 18:46:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_26a067d1b1af687ecb2f4b3c37e21606.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:50:53Z',
 'fuel_type': 'petrol',
 'id': '3c285e17-d0e8-59db-9108-bc37c27bf963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK16963',
 'listing': 'auction',
 'location': 'Oranienburg',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 165694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c285e17-d0e8-59db-9108-bc37c27bf963/3c285e17-d0e8-59db-9108-bc37c27bf963_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_26a067d1b1af687ecb2f4b3c37e21606.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c285e17-d0e8-59db-9108-bc37c27bf963/3c285e17-d0e8-59db-9108-bc37c27bf963_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_bc37b8836b18bcd396768a5c7a7bd402.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c285e17-d0e8-59db-9108-bc37c27bf963/3c285e17-d0e8-59db-9108-bc37c27bf963_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_964acf7d4f2b0f01bea49cc3168e7571.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c285e17-d0e8-59db-9108-bc37c27bf963/3c285e17-d0e8-59db-9108-bc37c27bf963_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_7aa0fe628071ac269f0820c0fe5e7596.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c285e17-d0e8-59db-9108-bc37c27bf963/3c285e17-d0e8-59db-9108-bc37c27bf963_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ea/31ea0ed88d2e684aee7e6c194d0c9dff/pa/AK16963_087356751ce2bd6e716c86f4b7aec077.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK16963%27 HTTP/1.1" 200 None
2026-03-28 18:46:21 [auto1.de] INFO: Saving data for AK16963: {'created_time': 1774723581.218419, 'last_price_update_time': 1774723581.218431, 'auction_closing_time': 1774885853.0}
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK16963') HTTP/1.1" 204 0
2026-03-28 18:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_3f05375c3a5fd72a40f08179060127ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547e4ad0>
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_0924cf49516cfdf4faeea73b1a1d7899.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_0924cf49516cfdf4faeea73b1a1d7899.jpg saved to cache
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7adc4e39-9198-592d-88fe-4a375358a9ad
2026-03-28 18:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_c42369031d195f63364c1bd8431312ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_65b2be5c2046305e596a828735538911.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_aa27bc0d35d6f2fc12c4159e4f68f880.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_89454995df926b472ee5554b8e5adccc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_02861c13d78080022b0c810178db5e17.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_27287dd6a49d48c4033713a989ee960b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_39479baf27929305fc6860f74287be6d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245614bf50>
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_3f05375c3a5fd72a40f08179060127ca.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_3f05375c3a5fd72a40f08179060127ca.jpg saved to cache
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7adc4e39-9198-592d-88fe-4a375358a9ad
2026-03-28 18:46:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563100d0>
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_c42369031d195f63364c1bd8431312ce.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_c42369031d195f63364c1bd8431312ce.jpg saved to cache
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20ce504b-cf12-5d18-968f-8f13fa6023c6
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245603d8d0>
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_65b2be5c2046305e596a828735538911.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_65b2be5c2046305e596a828735538911.jpg saved to cache
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20ce504b-cf12-5d18-968f-8f13fa6023c6
2026-03-28 18:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_e977db2d9e41c7e7bad8b7a9f0b44cc2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454771ed0>
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_aa27bc0d35d6f2fc12c4159e4f68f880.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_aa27bc0d35d6f2fc12c4159e4f68f880.jpg saved to cache
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3f89c88-dfc3-5350-af06-7828b253e018
2026-03-28 18:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_9dcfc644169562eb3fa1f828668dea12.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454662750>
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_89454995df926b472ee5554b8e5adccc.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_89454995df926b472ee5554b8e5adccc.jpg saved to cache
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20ce504b-cf12-5d18-968f-8f13fa6023c6
2026-03-28 18:46:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456376690>
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fb8%252Faeb8a96cbc8f419acb6e94a308fac233%252Fpa%252FJY99626_02861c13d78080022b0c810178db5e17.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_02861c13d78080022b0c810178db5e17.jpg saved to cache
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3f89c88-dfc3-5350-af06-7828b253e018
2026-03-28 18:46:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3f89c88-dfc3-5350-af06-7828b253e018, skipping ID generation
2026-03-28 18:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3f89c88-dfc3-5350-af06-7828b253e018 with scrape type 1
2026-03-28 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3f89c88-dfc3-5350-af06-7828b253e018 sending to next pipeline
2026-03-28 18:46:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3f89c88-dfc3-5350-af06-7828b253e018, identifier: JY99626
2026-03-28 18:46:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b1fd0>
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_27287dd6a49d48c4033713a989ee960b.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_27287dd6a49d48c4033713a989ee960b.jpg saved to cache
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7adc4e39-9198-592d-88fe-4a375358a9ad
2026-03-28 18:46:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245463f250>
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_39479baf27929305fc6860f74287be6d.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_39479baf27929305fc6860f74287be6d.jpg saved to cache
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20ce504b-cf12-5d18-968f-8f13fa6023c6
2026-03-28 18:46:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3f89c88-dfc3-5350-af06-7828b253e018 with identifier: JY99626
2026-03-28 18:46:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3f89c88-dfc3-5350-af06-7828b253e018 with identifier: JY99626
2026-03-28 18:46:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3f89c88-dfc3-5350-af06-7828b253e018 with identifier: JY99626 to the API
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_02861c13d78080022b0c810178db5e17.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:14Z',
 'fuel_type': 'diesel',
 'id': 'f3f89c88-dfc3-5350-af06-7828b253e018',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY99626',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 154046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3180183,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_02861c13d78080022b0c810178db5e17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3135664,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_aa27bc0d35d6f2fc12c4159e4f68f880.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_22c81cffc0859e3125f45d0ecac28dd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_89f68fe185a71500fea30a557b1a38e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3232516,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_42c310d91466441b90e283e0e81fe3b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2739507,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_bf0b0949470d86d987e4d884703f9fd0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2691729,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_a6aa6999654ec97f2c341b8f4739aa04.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2714353,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_1ad442be297d53752cb4ebbd63cd001e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_c7167353fd5d47414678ee2c238c350d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3f89c88-dfc3-5350-af06-7828b253e018/f3f89c88-dfc3-5350-af06-7828b253e018_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/b8/aeb8a96cbc8f419acb6e94a308fac233/pa/JY99626_481e0421fc17e5476f085b658d720403.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY99626%27 HTTP/1.1" 200 None
2026-03-28 18:46:22 [auto1.de] INFO: Saving data for JY99626: {'created_time': 1774723582.638211, 'last_price_update_time': 1774723582.638222, 'auction_closing_time': 1774883534.0}
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY99626') HTTP/1.1" 204 0
2026-03-28 18:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ46464> (referer: https://www.auto1.com/v1/car-details-view/ZZ46464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456317e90>
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_e977db2d9e41c7e7bad8b7a9f0b44cc2.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_e977db2d9e41c7e7bad8b7a9f0b44cc2.jpg saved to cache
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27cc3358-c343-58b8-b89e-c8a05a9677f4
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562f6cd0>
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_9dcfc644169562eb3fa1f828668dea12.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_9dcfc644169562eb3fa1f828668dea12.jpg saved to cache
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7adc4e39-9198-592d-88fe-4a375358a9ad
2026-03-28 18:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ88951> (referer: https://www.auto1.com/v1/car-details-view/ZJ88951/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55c965aa-0eac-5b01-8693-e95e067c4fc0 with identifier: ZZ46464
2026-03-28 18:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55c965aa-0eac-5b01-8693-e95e067c4fc0 with scrape type 1
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55c965aa-0eac-5b01-8693-e95e067c4fc0
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_cb33a241521090b1d94938eec61ef9b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_cb33a241521090b1d94938eec61ef9b1.jpg not downloaded yet
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_b0c076c53636983d327caabbf23a1c7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_b0c076c53636983d327caabbf23a1c7d.jpg not downloaded yet
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_858496e45e5dbc07e4a1766d9602eca8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_858496e45e5dbc07e4a1766d9602eca8.jpg not downloaded yet
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_c9c134f5d000c23772534d9cee02a4f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_c9c134f5d000c23772534d9cee02a4f9.jpg not downloaded yet
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_2dcca38939a934fe3fd8ca0a6f3f0b3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_2dcca38939a934fe3fd8ca0a6f3f0b3c.jpg not downloaded yet
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_b656ebe76362e018adc786aa6bdc38b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_b656ebe76362e018adc786aa6bdc38b6.jpg not downloaded yet
2026-03-28 18:46:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7 with identifier: ZJ88951
2026-03-28 18:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7 with scrape type 1
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_ea52883c31babee7e9a73d4da98cc97a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_ea52883c31babee7e9a73d4da98cc97a.jpg not downloaded yet
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_ee48a95cbe9e003a4137b98cdb1073db.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_ee48a95cbe9e003a4137b98cdb1073db.jpg not downloaded yet
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_e4707b946bb4d8fc05fee4c08c8de752.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_e4707b946bb4d8fc05fee4c08c8de752.jpg not downloaded yet
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_4d2c3a0fa5d64a573cf5cd36cfbf9463.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_4d2c3a0fa5d64a573cf5cd36cfbf9463.jpg not downloaded yet
2026-03-28 18:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7f112229e840beaffb7c75865a4bd943.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_d076a71c1490409d851623fd91b556f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_eece1e5abd174eca229f2b076c1d8f8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_eece1e5abd174eca229f2b076c1d8f8e.jpg not downloaded yet
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_a6b864e11fb2c3b78f4c02b75a7d4ee2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_a6b864e11fb2c3b78f4c02b75a7d4ee2.jpg not downloaded yet
2026-03-28 18:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_499467258efe755a6c9a50840b393d9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7d4109eecc3f5031ed9d7e496eee0b60.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_411a628fbac0541cc886e2defb628012.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_411a628fbac0541cc886e2defb628012.jpg not downloaded yet
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_69f834d94ffdc714f8f4d4181fb99a60.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_69f834d94ffdc714f8f4d4181fb99a60.jpg not downloaded yet
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_43632103d3ba9eeeb0ca0460d24607d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_43632103d3ba9eeeb0ca0460d24607d5.jpg not downloaded yet
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_2eeb8c552bb9bca87f6dbf87bc4160ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_2eeb8c552bb9bca87f6dbf87bc4160ca.jpg not downloaded yet
2026-03-28 18:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9dc14a2304457559c75c1d533091dac1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_a1965c12b86b47a69988062733d41336.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_a1965c12b86b47a69988062733d41336.jpg not downloaded yet
2026-03-28 18:46:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855f790>
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_7f112229e840beaffb7c75865a4bd943.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7f112229e840beaffb7c75865a4bd943.jpg saved to cache
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245650e490>
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_d076a71c1490409d851623fd91b556f6.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_d076a71c1490409d851623fd91b556f6.jpg saved to cache
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27cc3358-c343-58b8-b89e-c8a05a9677f4
2026-03-28 18:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_e69fac678c2b3a310842433440f27dd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_1375d4a89e1ecc950eee5710e8f50389.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_e4dd7ff607e212c2f523098e8c46b883.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_e4dd7ff607e212c2f523098e8c46b883.jpg not downloaded yet
2026-03-28 18:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9a179181824ca5abc3c899b57c74a243.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_712f87ff75d6d7f34754914085ce32d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_5e73d9d0051acb3d2082d9422923daf8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_5e73d9d0051acb3d2082d9422923daf8.jpg not downloaded yet
2026-03-28 18:46:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562f6e10>
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_499467258efe755a6c9a50840b393d9c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_499467258efe755a6c9a50840b393d9c.jpg saved to cache
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454663710>
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_7d4109eecc3f5031ed9d7e496eee0b60.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7d4109eecc3f5031ed9d7e496eee0b60.jpg saved to cache
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-03-28 18:46:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245603c0d0>
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_9dc14a2304457559c75c1d533091dac1.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9dc14a2304457559c75c1d533091dac1.jpg saved to cache
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_e843ee713f7d914967d173e8ba62d120.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_e843ee713f7d914967d173e8ba62d120.jpg not downloaded yet
2026-03-28 18:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_ee48a95cbe9e003a4137b98cdb1073db.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_e4707b946bb4d8fc05fee4c08c8de752.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_b06928d3e33c0b5f8580349385255fdc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245649e590>
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_e69fac678c2b3a310842433440f27dd5.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_e69fac678c2b3a310842433440f27dd5.jpg saved to cache
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27cc3358-c343-58b8-b89e-c8a05a9677f4
2026-03-28 18:46:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456059110>
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_1375d4a89e1ecc950eee5710e8f50389.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_1375d4a89e1ecc950eee5710e8f50389.jpg saved to cache
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27cc3358-c343-58b8-b89e-c8a05a9677f4
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245620d150>
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_9a179181824ca5abc3c899b57c74a243.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9a179181824ca5abc3c899b57c74a243.jpg saved to cache
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855fbd0>
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_712f87ff75d6d7f34754914085ce32d8.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_712f87ff75d6d7f34754914085ce32d8.jpg saved to cache
2026-03-28 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-03-28 18:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245641bc90>
2026-03-28 18:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_ee48a95cbe9e003a4137b98cdb1073db.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_ee48a95cbe9e003a4137b98cdb1073db.jpg saved to cache
2026-03-28 18:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55c965aa-0eac-5b01-8693-e95e067c4fc0
2026-03-28 18:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245627d810>
2026-03-28 18:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_e4707b946bb4d8fc05fee4c08c8de752.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_e4707b946bb4d8fc05fee4c08c8de752.jpg saved to cache
2026-03-28 18:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7
2026-03-28 18:46:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546cd950>
2026-03-28 18:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F5e%252F635ec3ad5918161a251ef56a65c016a3%252Fpa%252FLX07481_b06928d3e33c0b5f8580349385255fdc.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_b06928d3e33c0b5f8580349385255fdc.jpg saved to cache
2026-03-28 18:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7adc4e39-9198-592d-88fe-4a375358a9ad
2026-03-28 18:46:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7adc4e39-9198-592d-88fe-4a375358a9ad, skipping ID generation
2026-03-28 18:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7adc4e39-9198-592d-88fe-4a375358a9ad with scrape type 1
2026-03-28 18:46:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7adc4e39-9198-592d-88fe-4a375358a9ad sending to next pipeline
2026-03-28 18:46:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7adc4e39-9198-592d-88fe-4a375358a9ad, identifier: LX07481
2026-03-28 18:46:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7adc4e39-9198-592d-88fe-4a375358a9ad with identifier: LX07481
2026-03-28 18:46:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7adc4e39-9198-592d-88fe-4a375358a9ad with identifier: LX07481
2026-03-28 18:46:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7adc4e39-9198-592d-88fe-4a375358a9ad with identifier: LX07481 to the API
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_b06928d3e33c0b5f8580349385255fdc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:23:39Z',
 'fuel_type': 'petrol',
 'id': '7adc4e39-9198-592d-88fe-4a375358a9ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX07481',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 118523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3357286,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_5fa73d42a1045b36cbcf5d4b1f420c47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3463251,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_c0a79cefc208ea22d5628fb8bdfcc915.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3528986,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_e486a4a824d93182493ef73d89e7bb3d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_96ce5b988976876cbedec0d7604fa10e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_21d19b4259f8bd07c180c08a4d900150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3616276,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_b06928d3e33c0b5f8580349385255fdc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_9dcfc644169562eb3fa1f828668dea12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_3f05375c3a5fd72a40f08179060127ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_0924cf49516cfdf4faeea73b1a1d7899.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7adc4e39-9198-592d-88fe-4a375358a9ad/7adc4e39-9198-592d-88fe-4a375358a9ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3319872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/5e/635ec3ad5918161a251ef56a65c016a3/pa/LX07481_27287dd6a49d48c4033713a989ee960b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2012}
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX07481%27 HTTP/1.1" 200 None
2026-03-28 18:46:24 [auto1.de] INFO: Saving data for LX07481: {'created_time': 1774723584.864866, 'last_price_update_time': 1774723584.864878, 'auction_closing_time': 1774884219.0}
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX07481') HTTP/1.1" 204 0
2026-03-28 18:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_b71fbc33dbc08dfb7714379e260168f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_f79226fe6e08388a6ce8cab5ee9c2924.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f935dcdbd1bc5469174d6c960b7948f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_6b19450497e3f8c062dd3e597ff2f9e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_fe16ba12295b2050d0ba29804076f7a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_5e73d9d0051acb3d2082d9422923daf8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_e843ee713f7d914967d173e8ba62d120.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_69f834d94ffdc714f8f4d4181fb99a60.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a8750>
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_b71fbc33dbc08dfb7714379e260168f2.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_b71fbc33dbc08dfb7714379e260168f2.jpg saved to cache
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27cc3358-c343-58b8-b89e-c8a05a9677f4
2026-03-28 18:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_a6b864e11fb2c3b78f4c02b75a7d4ee2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_eece1e5abd174eca229f2b076c1d8f8e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_4d2c3a0fa5d64a573cf5cd36cfbf9463.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a0750>
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_f79226fe6e08388a6ce8cab5ee9c2924.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_f79226fe6e08388a6ce8cab5ee9c2924.jpg saved to cache
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27cc3358-c343-58b8-b89e-c8a05a9677f4
2026-03-28 18:46:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456314490>
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_f935dcdbd1bc5469174d6c960b7948f4.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f935dcdbd1bc5469174d6c960b7948f4.jpg saved to cache
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-03-28 18:46:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563bf510>
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_6b19450497e3f8c062dd3e597ff2f9e9.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_6b19450497e3f8c062dd3e597ff2f9e9.jpg saved to cache
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27cc3358-c343-58b8-b89e-c8a05a9677f4
2026-03-28 18:46:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456431c90>
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_fe16ba12295b2050d0ba29804076f7a2.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_fe16ba12295b2050d0ba29804076f7a2.jpg saved to cache
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27cc3358-c343-58b8-b89e-c8a05a9677f4
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546cfe10>
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_5e73d9d0051acb3d2082d9422923daf8.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_5e73d9d0051acb3d2082d9422923daf8.jpg saved to cache
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546ce2d0>
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_e843ee713f7d914967d173e8ba62d120.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_e843ee713f7d914967d173e8ba62d120.jpg saved to cache
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563bcb90>
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_69f834d94ffdc714f8f4d4181fb99a60.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_69f834d94ffdc714f8f4d4181fb99a60.jpg saved to cache
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55c965aa-0eac-5b01-8693-e95e067c4fc0
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456534350>
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_a6b864e11fb2c3b78f4c02b75a7d4ee2.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_a6b864e11fb2c3b78f4c02b75a7d4ee2.jpg saved to cache
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55c965aa-0eac-5b01-8693-e95e067c4fc0
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456311f10>
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_eece1e5abd174eca229f2b076c1d8f8e.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_eece1e5abd174eca229f2b076c1d8f8e.jpg saved to cache
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bb910>
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_4d2c3a0fa5d64a573cf5cd36cfbf9463.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_4d2c3a0fa5d64a573cf5cd36cfbf9463.jpg saved to cache
2026-03-28 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55c965aa-0eac-5b01-8693-e95e067c4fc0
2026-03-28 18:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_2eeb8c552bb9bca87f6dbf87bc4160ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_43632103d3ba9eeeb0ca0460d24607d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_e4dd7ff607e212c2f523098e8c46b883.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_a1965c12b86b47a69988062733d41336.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_411a628fbac0541cc886e2defb628012.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_ea52883c31babee7e9a73d4da98cc97a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_c9c134f5d000c23772534d9cee02a4f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_858496e45e5dbc07e4a1766d9602eca8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_2dcca38939a934fe3fd8ca0a6f3f0b3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561ed2d0>
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_2eeb8c552bb9bca87f6dbf87bc4160ca.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_2eeb8c552bb9bca87f6dbf87bc4160ca.jpg saved to cache
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7
2026-03-28 18:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_b656ebe76362e018adc786aa6bdc38b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_0b77914ece4cb3407a1de50b19836a32.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454644ad0>
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_43632103d3ba9eeeb0ca0460d24607d5.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_43632103d3ba9eeeb0ca0460d24607d5.jpg saved to cache
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7
2026-03-28 18:46:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456072250>
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_e4dd7ff607e212c2f523098e8c46b883.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_e4dd7ff607e212c2f523098e8c46b883.jpg saved to cache
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7
2026-03-28 18:46:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456183090>
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_a1965c12b86b47a69988062733d41336.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_a1965c12b86b47a69988062733d41336.jpg saved to cache
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7
2026-03-28 18:46:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245479ecd0>
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_411a628fbac0541cc886e2defb628012.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_411a628fbac0541cc886e2defb628012.jpg saved to cache
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456159890>
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbb%252F6fbbd113919d15498d68b49a6d48d621%252Fpa%252FZJ88951_ea52883c31babee7e9a73d4da98cc97a.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_ea52883c31babee7e9a73d4da98cc97a.jpg saved to cache
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7
2026-03-28 18:46:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7, skipping ID generation
2026-03-28 18:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7 with scrape type 1
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7 sending to next pipeline
2026-03-28 18:46:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7, identifier: ZJ88951
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638e390>
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_c9c134f5d000c23772534d9cee02a4f9.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_c9c134f5d000c23772534d9cee02a4f9.jpg saved to cache
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55c965aa-0eac-5b01-8693-e95e067c4fc0
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477b910>
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_858496e45e5dbc07e4a1766d9602eca8.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_858496e45e5dbc07e4a1766d9602eca8.jpg saved to cache
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55c965aa-0eac-5b01-8693-e95e067c4fc0
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b1450>
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_2dcca38939a934fe3fd8ca0a6f3f0b3c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_2dcca38939a934fe3fd8ca0a6f3f0b3c.jpg saved to cache
2026-03-28 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55c965aa-0eac-5b01-8693-e95e067c4fc0
2026-03-28 18:46:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7 with identifier: ZJ88951
2026-03-28 18:46:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7 with identifier: ZJ88951
2026-03-28 18:46:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7 with identifier: ZJ88951 to the API
2026-03-28 18:46:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_ea52883c31babee7e9a73d4da98cc97a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:47:15Z',
 'fuel_type': 'petrol',
 'id': '0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ88951',
 'listing': 'auction',
 'location': 'DE, Oldenburg',
 'make': 'BMW',
 'model': '3er',
 'odometer': 152059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_ea52883c31babee7e9a73d4da98cc97a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_e4707b946bb4d8fc05fee4c08c8de752.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_eece1e5abd174eca229f2b076c1d8f8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2500012,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_411a628fbac0541cc886e2defb628012.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2776047,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_43632103d3ba9eeeb0ca0460d24607d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2532143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_2eeb8c552bb9bca87f6dbf87bc4160ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2697760,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_a1965c12b86b47a69988062733d41336.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2601922,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_e4dd7ff607e212c2f523098e8c46b883.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_5e73d9d0051acb3d2082d9422923daf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7/0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bb/6fbbd113919d15498d68b49a6d48d621/pa/ZJ88951_e843ee713f7d914967d173e8ba62d120.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ88951%27 HTTP/1.1" 200 None
2026-03-28 18:46:27 [auto1.de] INFO: Saving data for ZJ88951: {'created_time': 1774723587.261736, 'last_price_update_time': 1774723587.261747, 'auction_closing_time': 1774885635.0}
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ88951') HTTP/1.1" 204 0
2026-03-28 18:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT47702> (referer: https://www.auto1.com/v1/car-details-view/RT47702/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454811b90>
2026-03-28 18:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_b656ebe76362e018adc786aa6bdc38b6.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_b656ebe76362e018adc786aa6bdc38b6.jpg saved to cache
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55c965aa-0eac-5b01-8693-e95e067c4fc0
2026-03-28 18:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b2ad0>
2026-03-28 18:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_0b77914ece4cb3407a1de50b19836a32.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_0b77914ece4cb3407a1de50b19836a32.jpg saved to cache
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27cc3358-c343-58b8-b89e-c8a05a9677f4
2026-03-28 18:46:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57aee205-5c9c-5e64-b445-02144e19996f with identifier: RT47702
2026-03-28 18:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57aee205-5c9c-5e64-b445-02144e19996f with scrape type 1
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57aee205-5c9c-5e64-b445-02144e19996f
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_1c50eb4d6f257470ec2c75848b5f24f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_1c50eb4d6f257470ec2c75848b5f24f8.jpg not downloaded yet
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_28dc09f483466f2bb9399b020813bd73.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_28dc09f483466f2bb9399b020813bd73.jpg not downloaded yet
2026-03-28 18:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_e9fe266b9f3ca4fcd111b6d3a14edaf4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_a84df20effb7f727aa0008801bf45dc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_a84df20effb7f727aa0008801bf45dc3.jpg not downloaded yet
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_638e03295f15b4acdcfc64059842d75b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_638e03295f15b4acdcfc64059842d75b.jpg not downloaded yet
2026-03-28 18:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_cb33a241521090b1d94938eec61ef9b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_99624760df5fda880b01905b80d81be3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_99624760df5fda880b01905b80d81be3.jpg not downloaded yet
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_8c4bf605398c7934f5da6a6122cbc602.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_8c4bf605398c7934f5da6a6122cbc602.jpg not downloaded yet
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_47bf32e34abb1e8c19ad38286b20b06a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_47bf32e34abb1e8c19ad38286b20b06a.jpg not downloaded yet
2026-03-28 18:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_b0c076c53636983d327caabbf23a1c7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_d769b6b99405e06b62d5b9229b3e5253.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_d769b6b99405e06b62d5b9229b3e5253.jpg not downloaded yet
2026-03-28 18:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546c2fd0>
2026-03-28 18:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb834c45275991e037241dc17745d297%252Fpa%252FVD40849_e9fe266b9f3ca4fcd111b6d3a14edaf4.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_e9fe266b9f3ca4fcd111b6d3a14edaf4.jpg saved to cache
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20ce504b-cf12-5d18-968f-8f13fa6023c6
2026-03-28 18:46:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20ce504b-cf12-5d18-968f-8f13fa6023c6, skipping ID generation
2026-03-28 18:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ce504b-cf12-5d18-968f-8f13fa6023c6 with scrape type 1
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20ce504b-cf12-5d18-968f-8f13fa6023c6 sending to next pipeline
2026-03-28 18:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20ce504b-cf12-5d18-968f-8f13fa6023c6, identifier: VD40849
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_547640847a36dd4d4b6b4e4b5eae05ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_547640847a36dd4d4b6b4e4b5eae05ad.jpg not downloaded yet
2026-03-28 18:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20ce504b-cf12-5d18-968f-8f13fa6023c6 with identifier: VD40849
2026-03-28 18:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20ce504b-cf12-5d18-968f-8f13fa6023c6 with identifier: VD40849
2026-03-28 18:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20ce504b-cf12-5d18-968f-8f13fa6023c6 with identifier: VD40849 to the API
2026-03-28 18:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_e9fe266b9f3ca4fcd111b6d3a14edaf4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 290,
 'expiration_date': '2026-03-30T15:35:32Z',
 'fuel_type': 'petrol',
 'id': '20ce504b-cf12-5d18-968f-8f13fa6023c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD40849',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 100813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_e9fe266b9f3ca4fcd111b6d3a14edaf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_65b2be5c2046305e596a828735538911.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3056454,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_39479baf27929305fc6860f74287be6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_4bc2c622e44e83b323e7ab16d1c0ad87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2876533,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_89454995df926b472ee5554b8e5adccc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2724559,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_c42369031d195f63364c1bd8431312ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_c8c065dcc7da140940fc0936cb13a880.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_1897eadf5bc515d120d8747868076522.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3360707,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_ffedd44f756c50889b785a031d2e3299.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ce504b-cf12-5d18-968f-8f13fa6023c6/20ce504b-cf12-5d18-968f-8f13fa6023c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3305450,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db834c45275991e037241dc17745d297/pa/VD40849_55427b5297d129df7c786d58227ff22f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
 'transmission': 'automatic',
 'trim': 'GTI TCR',
 'year': 2019}
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD40849%27 HTTP/1.1" 200 None
2026-03-28 18:46:28 [auto1.de] INFO: Saving data for VD40849: {'created_time': 1774723588.143818, 'last_price_update_time': 1774723588.143833, 'auction_closing_time': 1774884932.0}
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD40849') HTTP/1.1" 204 0
2026-03-28 18:46:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560d0450>
2026-03-28 18:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_cb33a241521090b1d94938eec61ef9b1.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_cb33a241521090b1d94938eec61ef9b1.jpg saved to cache
2026-03-28 18:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55c965aa-0eac-5b01-8693-e95e067c4fc0
2026-03-28 18:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_c5348fc30f9738cfae88fd5943c54814.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_bfaa74e3fac0fa6bac124dba4bff8ef8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_6bb00916397ff9ece94a82eee18daa3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_6bb00916397ff9ece94a82eee18daa3a.jpg not downloaded yet
2026-03-28 18:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ96014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TG23617/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454820490>
2026-03-28 18:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fa8%252Fd8a87ceb0c90de1be9570fca40bf5cf0%252Fpa%252FZZ46464_b0c076c53636983d327caabbf23a1c7d.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_b0c076c53636983d327caabbf23a1c7d.jpg saved to cache
2026-03-28 18:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55c965aa-0eac-5b01-8693-e95e067c4fc0
2026-03-28 18:46:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55c965aa-0eac-5b01-8693-e95e067c4fc0, skipping ID generation
2026-03-28 18:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55c965aa-0eac-5b01-8693-e95e067c4fc0 with scrape type 1
2026-03-28 18:46:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55c965aa-0eac-5b01-8693-e95e067c4fc0 sending to next pipeline
2026-03-28 18:46:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55c965aa-0eac-5b01-8693-e95e067c4fc0, identifier: ZZ46464
2026-03-28 18:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW84058/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55c965aa-0eac-5b01-8693-e95e067c4fc0 with identifier: ZZ46464
2026-03-28 18:46:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55c965aa-0eac-5b01-8693-e95e067c4fc0 with identifier: ZZ46464
2026-03-28 18:46:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55c965aa-0eac-5b01-8693-e95e067c4fc0 with identifier: ZZ46464 to the API
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_b0c076c53636983d327caabbf23a1c7d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 214,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 239,
 'expiration_date': '2026-03-30T15:16:59Z',
 'fuel_type': 'diesel',
 'id': '55c965aa-0eac-5b01-8693-e95e067c4fc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ46464',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse Marco Polo',
 'odometer': 177565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518414,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_cb33a241521090b1d94938eec61ef9b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2558727,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_b0c076c53636983d327caabbf23a1c7d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_858496e45e5dbc07e4a1766d9602eca8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_c9c134f5d000c23772534d9cee02a4f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_2dcca38939a934fe3fd8ca0a6f3f0b3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_b656ebe76362e018adc786aa6bdc38b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_ee48a95cbe9e003a4137b98cdb1073db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_4d2c3a0fa5d64a573cf5cd36cfbf9463.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_a6b864e11fb2c3b78f4c02b75a7d4ee2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c965aa-0eac-5b01-8693-e95e067c4fc0/55c965aa-0eac-5b01-8693-e95e067c4fc0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/a8/d8a87ceb0c90de1be9570fca40bf5cf0/pa/ZZ46464_69f834d94ffdc714f8f4d4181fb99a60.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse Marco Polo V 300 d EDITION',
 'transmission': 'automatic',
 'trim': 'EDITION',
 'year': 2020}
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ46464%27 HTTP/1.1" 200 None
2026-03-28 18:46:28 [auto1.de] INFO: Saving data for ZZ46464: {'created_time': 1774723588.938218, 'last_price_update_time': 1774723588.938229, 'auction_closing_time': 1774883819.0}
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ46464') HTTP/1.1" 204 0
2026-03-28 18:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f8ab0e66b0fb6c65908da751e074e73f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL01383/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_84f95f73f342655c35292838ac9d285e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563eb750>
2026-03-28 18:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_c5348fc30f9738cfae88fd5943c54814.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_c5348fc30f9738cfae88fd5943c54814.jpg saved to cache
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563c0cd0>
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_bfaa74e3fac0fa6bac124dba4bff8ef8.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_bfaa74e3fac0fa6bac124dba4bff8ef8.jpg saved to cache
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4dc64e49-56b2-53bd-88c6-a84311c425b1
2026-03-28 18:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_1c50eb4d6f257470ec2c75848b5f24f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_a84df20effb7f727aa0008801bf45dc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_05fca88348ba9683a240c7f181636266.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456377e10>
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_f8ab0e66b0fb6c65908da751e074e73f.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f8ab0e66b0fb6c65908da751e074e73f.jpg saved to cache
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-03-28 18:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_6bb00916397ff9ece94a82eee18daa3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_547640847a36dd4d4b6b4e4b5eae05ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_8c4bf605398c7934f5da6a6122cbc602.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458b7ef50>
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F81%252F2981be1cd55cc9783974fc6b3cf26480%252Fpa%252FVK18000_84f95f73f342655c35292838ac9d285e.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_84f95f73f342655c35292838ac9d285e.jpg saved to cache
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27cc3358-c343-58b8-b89e-c8a05a9677f4
2026-03-28 18:46:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27cc3358-c343-58b8-b89e-c8a05a9677f4, skipping ID generation
2026-03-28 18:46:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27cc3358-c343-58b8-b89e-c8a05a9677f4 with scrape type 1
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27cc3358-c343-58b8-b89e-c8a05a9677f4 sending to next pipeline
2026-03-28 18:46:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27cc3358-c343-58b8-b89e-c8a05a9677f4, identifier: VK18000
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456337ed0>
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_1c50eb4d6f257470ec2c75848b5f24f8.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_1c50eb4d6f257470ec2c75848b5f24f8.jpg saved to cache
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57aee205-5c9c-5e64-b445-02144e19996f
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456194a10>
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_a84df20effb7f727aa0008801bf45dc3.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_a84df20effb7f727aa0008801bf45dc3.jpg saved to cache
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57aee205-5c9c-5e64-b445-02144e19996f
2026-03-28 18:46:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454685850>
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_05fca88348ba9683a240c7f181636266.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_05fca88348ba9683a240c7f181636266.jpg saved to cache
2026-03-28 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-03-28 18:46:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27cc3358-c343-58b8-b89e-c8a05a9677f4 with identifier: VK18000
2026-03-28 18:46:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27cc3358-c343-58b8-b89e-c8a05a9677f4 with identifier: VK18000
2026-03-28 18:46:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27cc3358-c343-58b8-b89e-c8a05a9677f4 with identifier: VK18000 to the API
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_84f95f73f342655c35292838ac9d285e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:15:41Z',
 'fuel_type': 'diesel',
 'id': '27cc3358-c343-58b8-b89e-c8a05a9677f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK18000',
 'listing': 'auction',
 'location': 'DE, Neustadt an der Weinstraße',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 262433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2921101,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_84f95f73f342655c35292838ac9d285e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_0b77914ece4cb3407a1de50b19836a32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3048171,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_6b19450497e3f8c062dd3e597ff2f9e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_e977db2d9e41c7e7bad8b7a9f0b44cc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3295700,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_fe16ba12295b2050d0ba29804076f7a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3103265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_f79226fe6e08388a6ce8cab5ee9c2924.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3062651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_b71fbc33dbc08dfb7714379e260168f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_d076a71c1490409d851623fd91b556f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2992294,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_1375d4a89e1ecc950eee5710e8f50389.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27cc3358-c343-58b8-b89e-c8a05a9677f4/27cc3358-c343-58b8-b89e-c8a05a9677f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3402305,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/81/2981be1cd55cc9783974fc6b3cf26480/pa/VK18000_e69fac678c2b3a310842433440f27dd5.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK18000%27 HTTP/1.1" 200 None
2026-03-28 18:46:30 [auto1.de] INFO: Saving data for VK18000: {'created_time': 1774723590.08805, 'last_price_update_time': 1774723590.088061, 'auction_closing_time': 1774883741.0}
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK18000') HTTP/1.1" 204 0
2026-03-28 18:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_5c86e4e1f028b5cb73572aa13aa6f3ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_47bf32e34abb1e8c19ad38286b20b06a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_d769b6b99405e06b62d5b9229b3e5253.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456493310>
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_6bb00916397ff9ece94a82eee18daa3a.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_6bb00916397ff9ece94a82eee18daa3a.jpg saved to cache
2026-03-28 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57aee205-5c9c-5e64-b445-02144e19996f
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245476fed0>
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_547640847a36dd4d4b6b4e4b5eae05ad.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_547640847a36dd4d4b6b4e4b5eae05ad.jpg saved to cache
2026-03-28 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57aee205-5c9c-5e64-b445-02144e19996f
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454752190>
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_8c4bf605398c7934f5da6a6122cbc602.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_8c4bf605398c7934f5da6a6122cbc602.jpg saved to cache
2026-03-28 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57aee205-5c9c-5e64-b445-02144e19996f
2026-03-28 18:46:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560d3850>
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fd7%252F1ad71e17d10fcda2d841979b7a7162fc%252Fpa%252FBE46966_5c86e4e1f028b5cb73572aa13aa6f3ea.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_5c86e4e1f028b5cb73572aa13aa6f3ea.jpg saved to cache
2026-03-28 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6c393d5-69d3-5a3f-92a0-ca03f32db445
2026-03-28 18:46:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6c393d5-69d3-5a3f-92a0-ca03f32db445, skipping ID generation
2026-03-28 18:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6c393d5-69d3-5a3f-92a0-ca03f32db445 with scrape type 1
2026-03-28 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6c393d5-69d3-5a3f-92a0-ca03f32db445 sending to next pipeline
2026-03-28 18:46:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6c393d5-69d3-5a3f-92a0-ca03f32db445, identifier: BE46966
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245476dad0>
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_47bf32e34abb1e8c19ad38286b20b06a.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_47bf32e34abb1e8c19ad38286b20b06a.jpg saved to cache
2026-03-28 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57aee205-5c9c-5e64-b445-02144e19996f
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561966d0>
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_d769b6b99405e06b62d5b9229b3e5253.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_d769b6b99405e06b62d5b9229b3e5253.jpg saved to cache
2026-03-28 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57aee205-5c9c-5e64-b445-02144e19996f
2026-03-28 18:46:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6c393d5-69d3-5a3f-92a0-ca03f32db445 with identifier: BE46966
2026-03-28 18:46:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6c393d5-69d3-5a3f-92a0-ca03f32db445 with identifier: BE46966
2026-03-28 18:46:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6c393d5-69d3-5a3f-92a0-ca03f32db445 with identifier: BE46966 to the API
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_5c86e4e1f028b5cb73572aa13aa6f3ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:19:42Z',
 'fuel_type': 'diesel',
 'id': 'a6c393d5-69d3-5a3f-92a0-ca03f32db445',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE46966',
 'listing': 'auction',
 'location': 'DE, Neufahrn',
 'make': 'BMW',
 'model': '7er',
 'odometer': 234064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2632817,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_5c86e4e1f028b5cb73572aa13aa6f3ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2744004,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_05fca88348ba9683a240c7f181636266.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2655250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f8ab0e66b0fb6c65908da751e074e73f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2625400,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_499467258efe755a6c9a50840b393d9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2678091,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_f935dcdbd1bc5469174d6c960b7948f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_712f87ff75d6d7f34754914085ce32d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9a179181824ca5abc3c899b57c74a243.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7d4109eecc3f5031ed9d7e496eee0b60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2669176,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_7f112229e840beaffb7c75865a4bd943.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6c393d5-69d3-5a3f-92a0-ca03f32db445/a6c393d5-69d3-5a3f-92a0-ca03f32db445_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2900206,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/d7/1ad71e17d10fcda2d841979b7a7162fc/pa/BE46966_9dc14a2304457559c75c1d533091dac1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 7er 740d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE46966%27 HTTP/1.1" 200 None
2026-03-28 18:46:31 [auto1.de] INFO: Saving data for BE46966: {'created_time': 1774723591.01442, 'last_price_update_time': 1774723591.014431, 'auction_closing_time': 1774883982.0}
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE46966') HTTP/1.1" 204 0
2026-03-28 18:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_638e03295f15b4acdcfc64059842d75b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_99624760df5fda880b01905b80d81be3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_28dc09f483466f2bb9399b020813bd73.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_df9ef822de5d93fe3551566095bbfad3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD07645> (referer: https://www.auto1.com/v1/car-details-view/JD07645/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_09c0a6e66820eb1a5833d932fab4c68e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_ca1cfce9aac167ada7775b7e08cd9261.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_60d3fc7e5796e43c551fe38b378c95a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_8e4ce6e74b9b2e2e6973581777b30403.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561fd110>
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_638e03295f15b4acdcfc64059842d75b.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_638e03295f15b4acdcfc64059842d75b.jpg saved to cache
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57aee205-5c9c-5e64-b445-02144e19996f
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456192810>
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_99624760df5fda880b01905b80d81be3.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_99624760df5fda880b01905b80d81be3.jpg saved to cache
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57aee205-5c9c-5e64-b445-02144e19996f
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564183d0>
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F6b%252F3a6bc238c045a0e4582e0fdf30ef6a88%252Fpa%252FRT47702_28dc09f483466f2bb9399b020813bd73.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_28dc09f483466f2bb9399b020813bd73.jpg saved to cache
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57aee205-5c9c-5e64-b445-02144e19996f
2026-03-28 18:46:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57aee205-5c9c-5e64-b445-02144e19996f, skipping ID generation
2026-03-28 18:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57aee205-5c9c-5e64-b445-02144e19996f with scrape type 1
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57aee205-5c9c-5e64-b445-02144e19996f sending to next pipeline
2026-03-28 18:46:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57aee205-5c9c-5e64-b445-02144e19996f, identifier: RT47702
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456156b50>
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_df9ef822de5d93fe3551566095bbfad3.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_df9ef822de5d93fe3551566095bbfad3.jpg saved to cache
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4dc64e49-56b2-53bd-88c6-a84311c425b1
2026-03-28 18:46:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6de7bc2-85b4-510d-af96-a22b58b32fc9 with identifier: JD07645
2026-03-28 18:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6de7bc2-85b4-510d-af96-a22b58b32fc9 with scrape type 1
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6de7bc2-85b4-510d-af96-a22b58b32fc9
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_1d39efe7aa6bd3e53c75e9de505ade10.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_1d39efe7aa6bd3e53c75e9de505ade10.jpg not downloaded yet
2026-03-28 18:46:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245476e2d0>
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_09c0a6e66820eb1a5833d932fab4c68e.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_09c0a6e66820eb1a5833d932fab4c68e.jpg saved to cache
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a
2026-03-28 18:46:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454685150>
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_ca1cfce9aac167ada7775b7e08cd9261.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_ca1cfce9aac167ada7775b7e08cd9261.jpg saved to cache
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4dc64e49-56b2-53bd-88c6-a84311c425b1
2026-03-28 18:46:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562f49d0>
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F2c%252Fab2c7181f8d70b82a8982311d7f22222%252Fpa%252FUX88157_60d3fc7e5796e43c551fe38b378c95a5.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_60d3fc7e5796e43c551fe38b378c95a5.jpg saved to cache
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a
2026-03-28 18:46:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88930ba8-f3d1-5c62-81dc-0c30afb5557a, skipping ID generation
2026-03-28 18:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a with scrape type 1
2026-03-28 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a sending to next pipeline
2026-03-28 18:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88930ba8-f3d1-5c62-81dc-0c30afb5557a, identifier: UX88157
2026-03-28 18:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57aee205-5c9c-5e64-b445-02144e19996f with identifier: RT47702
2026-03-28 18:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57aee205-5c9c-5e64-b445-02144e19996f with identifier: RT47702
2026-03-28 18:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57aee205-5c9c-5e64-b445-02144e19996f with identifier: RT47702 to the API
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_28dc09f483466f2bb9399b020813bd73.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:09:56Z',
 'fuel_type': 'petrol',
 'id': '57aee205-5c9c-5e64-b445-02144e19996f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT47702',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 64123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_1c50eb4d6f257470ec2c75848b5f24f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_28dc09f483466f2bb9399b020813bd73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_a84df20effb7f727aa0008801bf45dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_638e03295f15b4acdcfc64059842d75b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_99624760df5fda880b01905b80d81be3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_8c4bf605398c7934f5da6a6122cbc602.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_47bf32e34abb1e8c19ad38286b20b06a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_d769b6b99405e06b62d5b9229b3e5253.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_547640847a36dd4d4b6b4e4b5eae05ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aee205-5c9c-5e64-b445-02144e19996f/57aee205-5c9c-5e64-b445-02144e19996f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/6b/3a6bc238c045a0e4582e0fdf30ef6a88/pa/RT47702_6bb00916397ff9ece94a82eee18daa3a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Play',
 'transmission': 'manual',
 'trim': 'Play',
 'year': 2018}
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47702%27 HTTP/1.1" 200 None
2026-03-28 18:46:32 [auto1.de] INFO: Saving data for RT47702: {'created_time': 1774723592.403308, 'last_price_update_time': 1774723592.403318, 'auction_closing_time': 1774883396.0}
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT47702') HTTP/1.1" 204 0
2026-03-28 18:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88930ba8-f3d1-5c62-81dc-0c30afb5557a with identifier: UX88157
2026-03-28 18:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88930ba8-f3d1-5c62-81dc-0c30afb5557a with identifier: UX88157
2026-03-28 18:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88930ba8-f3d1-5c62-81dc-0c30afb5557a with identifier: UX88157 to the API
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_60d3fc7e5796e43c551fe38b378c95a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 204,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:55:47Z',
 'fuel_type': 'petrol',
 'id': '88930ba8-f3d1-5c62-81dc-0c30afb5557a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX88157',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'Mercedes-Benz',
 'model': 'CLC-Klasse',
 'odometer': 155112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3525773,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_60d3fc7e5796e43c551fe38b378c95a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3510627,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_09c0a6e66820eb1a5833d932fab4c68e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_c5348fc30f9738cfae88fd5943c54814.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_5365864a9c6d6de217154cc1fc5ba0d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_bde3eb9e4761cd5a9ecd4f83987cef27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3574997,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_cc9fb8a2187b1b225c1472e822d9a75c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3534716,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_9d151a138a9e4ad5d99a5abf641a3b2c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3385382,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_9d1f6c466f9117642b6302e273b6e855.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3652627,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_1940a9b0eaea1b30e37d05e807550c17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88930ba8-f3d1-5c62-81dc-0c30afb5557a/88930ba8-f3d1-5c62-81dc-0c30afb5557a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3497412,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/2c/ab2c7181f8d70b82a8982311d7f22222/pa/UX88157_0e05d4cc12f178763b105a9b99f197d0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-12-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz CLC-Klasse CLC 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX88157%27 HTTP/1.1" 200 None
2026-03-28 18:46:32 [auto1.de] INFO: Saving data for UX88157: {'created_time': 1774723592.772926, 'last_price_update_time': 1774723592.772936, 'auction_closing_time': 1774886147.0}
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX88157') HTTP/1.1" 204 0
2026-03-28 18:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_b2ec3042ad7a4b247932a294410d8dd0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_eba6b9e6407d23bc60afb7275e2a1b0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_eba6b9e6407d23bc60afb7275e2a1b0b.jpg not downloaded yet
2026-03-28 18:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456156dd0>
2026-03-28 18:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d745b-ac05-5f2c-a67f-64b41a8efc39/306d745b-ac05-5f2c-a67f-64b41a8efc39_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5a7c13c2c61b9471ac7dee5a28f0f2%252Fpa%252FHN29475_8e4ce6e74b9b2e2e6973581777b30403.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_8e4ce6e74b9b2e2e6973581777b30403.jpg saved to cache
2026-03-28 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 306d745b-ac05-5f2c-a67f-64b41a8efc39
2026-03-28 18:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ96014> (referer: https://www.auto1.com/v1/car-details-view/WJ96014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL01383> (referer: https://www.auto1.com/v1/car-details-view/DL01383/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TG23617> (referer: https://www.auto1.com/v1/car-details-view/TG23617/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF84100/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST78231> (referer: https://www.auto1.com/v1/car-details-view/ST78231/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT27218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_905b82bd39cf298c52b8c370a41688e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_905b82bd39cf298c52b8c370a41688e0.jpg not downloaded yet
2026-03-28 18:46:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_76de0c589d84510e1e072aff9a819d62.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_76de0c589d84510e1e072aff9a819d62.jpg not downloaded yet
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_9012500fa5ded61a779dafc4c7914760.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_9012500fa5ded61a779dafc4c7914760.jpg not downloaded yet
2026-03-28 18:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245627db50>
2026-03-28 18:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_b2ec3042ad7a4b247932a294410d8dd0.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_b2ec3042ad7a4b247932a294410d8dd0.jpg saved to cache
2026-03-28 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4dc64e49-56b2-53bd-88c6-a84311c425b1
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_b5de2f908e954ff49638c9b464b9baf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_b5de2f908e954ff49638c9b464b9baf3.jpg not downloaded yet
2026-03-28 18:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_cc637508070fe649f4be8e4698b87092.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_ccc0880af6a359479c52c433870dad1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_ccc0880af6a359479c52c433870dad1e.jpg not downloaded yet
2026-03-28 18:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_eba6b9e6407d23bc60afb7275e2a1b0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_685e0c954c3588755e6b9b60467cc713.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_90fea55ffb7230abafbe12522ffc6a3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_90fea55ffb7230abafbe12522ffc6a3d.jpg not downloaded yet
2026-03-28 18:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69e8735f-10e7-50ca-afdd-1830a5164945 with identifier: WJ96014
2026-03-28 18:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69e8735f-10e7-50ca-afdd-1830a5164945 with scrape type 1
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69e8735f-10e7-50ca-afdd-1830a5164945
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_11a19f3023721660a56661782e3edb08.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_11a19f3023721660a56661782e3edb08.jpg not downloaded yet
2026-03-28 18:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2455164e-0840-5ce2-b240-bc935f5ba72b with identifier: DL01383
2026-03-28 18:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2455164e-0840-5ce2-b240-bc935f5ba72b with scrape type 1
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2455164e-0840-5ce2-b240-bc935f5ba72b
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2c%252F0f2cf83c8f7c52bd64f3d72c6ed9e65b%252Fpa%252FDL01383_9462edadb270826742c04ddbaea046db.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_9462edadb270826742c04ddbaea046db.jpg not downloaded yet
2026-03-28 18:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b36272d4-f016-51b1-bda0-5f905d11b176 with identifier: TG23617
2026-03-28 18:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b36272d4-f016-51b1-bda0-5f905d11b176 with scrape type 1
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b36272d4-f016-51b1-bda0-5f905d11b176
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_c1cd8b57be336c252dc15c015c21e16d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_c1cd8b57be336c252dc15c015c21e16d.jpg not downloaded yet
2026-03-28 18:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43660542-0239-5791-b2d9-5bb568d20e7a with identifier: ST78231
2026-03-28 18:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43660542-0239-5791-b2d9-5bb568d20e7a with scrape type 1
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43660542-0239-5791-b2d9-5bb568d20e7a
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_d60a7e43654c19c1bbfe270046f42e49.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_d60a7e43654c19c1bbfe270046f42e49.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_49d2d3b557fa52313d23e74b0738631e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_49d2d3b557fa52313d23e74b0738631e.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_ced839f66e8ded585a64c6318d891212.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_ced839f66e8ded585a64c6318d891212.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2c%252F0f2cf83c8f7c52bd64f3d72c6ed9e65b%252Fpa%252FDL01383_ec1e7937235fcd075ef57a6cb6bccea9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_ec1e7937235fcd075ef57a6cb6bccea9.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_d897e913c7c03cbfb6760b3877a7daad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_d897e913c7c03cbfb6760b3877a7daad.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_b45308105425bf4ff2a62835ca52f8c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_b45308105425bf4ff2a62835ca52f8c9.jpg not downloaded yet
2026-03-28 18:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_52702d5498dcd9afb7db1c727383e2ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563bc410>
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d745b-ac05-5f2c-a67f-64b41a8efc39/306d745b-ac05-5f2c-a67f-64b41a8efc39_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5a7c13c2c61b9471ac7dee5a28f0f2%252Fpa%252FHN29475_cc637508070fe649f4be8e4698b87092.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_cc637508070fe649f4be8e4698b87092.jpg saved to cache
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 306d745b-ac05-5f2c-a67f-64b41a8efc39
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456060ed0>
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_eba6b9e6407d23bc60afb7275e2a1b0b.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_eba6b9e6407d23bc60afb7275e2a1b0b.jpg saved to cache
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6de7bc2-85b4-510d-af96-a22b58b32fc9
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a7d90>
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d745b-ac05-5f2c-a67f-64b41a8efc39/306d745b-ac05-5f2c-a67f-64b41a8efc39_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5a7c13c2c61b9471ac7dee5a28f0f2%252Fpa%252FHN29475_685e0c954c3588755e6b9b60467cc713.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_685e0c954c3588755e6b9b60467cc713.jpg saved to cache
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 306d745b-ac05-5f2c-a67f-64b41a8efc39
2026-03-28 18:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_9012500fa5ded61a779dafc4c7914760.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_701c400134403e26c6a927fd0f9bfae5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_701c400134403e26c6a927fd0f9bfae5.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_4ed19b61835ec1d3cf1065d172a19f14.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_4ed19b61835ec1d3cf1065d172a19f14.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2c%252F0f2cf83c8f7c52bd64f3d72c6ed9e65b%252Fpa%252FDL01383_b39f3530b9a0f92174907be0db30a752.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_b39f3530b9a0f92174907be0db30a752.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_3bb183dfb424ba63fc2fd67852ba4ca8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_3bb183dfb424ba63fc2fd67852ba4ca8.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_71fb0c972d1d803d719b627bcecea20d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_71fb0c972d1d803d719b627bcecea20d.jpg not downloaded yet
2026-03-28 18:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_b5de2f908e954ff49638c9b464b9baf3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_ccc0880af6a359479c52c433870dad1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_127190633b6a6f52f15ca10433a5c1be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_127190633b6a6f52f15ca10433a5c1be.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2c%252F0f2cf83c8f7c52bd64f3d72c6ed9e65b%252Fpa%252FDL01383_25c16e8fb962b4abdfce9dbe2814e595.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_25c16e8fb962b4abdfce9dbe2814e595.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_46e336b35dc27004a8ef11e491c31283.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_46e336b35dc27004a8ef11e491c31283.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_57b2b7d146d03500de4eea21a9f99abb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_57b2b7d146d03500de4eea21a9f99abb.jpg not downloaded yet
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456061390>
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d745b-ac05-5f2c-a67f-64b41a8efc39/306d745b-ac05-5f2c-a67f-64b41a8efc39_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5a7c13c2c61b9471ac7dee5a28f0f2%252Fpa%252FHN29475_52702d5498dcd9afb7db1c727383e2ff.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_52702d5498dcd9afb7db1c727383e2ff.jpg saved to cache
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 306d745b-ac05-5f2c-a67f-64b41a8efc39
2026-03-28 18:46:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 306d745b-ac05-5f2c-a67f-64b41a8efc39, skipping ID generation
2026-03-28 18:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306d745b-ac05-5f2c-a67f-64b41a8efc39 with scrape type 1
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 306d745b-ac05-5f2c-a67f-64b41a8efc39 sending to next pipeline
2026-03-28 18:46:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 306d745b-ac05-5f2c-a67f-64b41a8efc39, identifier: HN29475
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_dd12fe2e333277491ac94493e31cd7ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_dd12fe2e333277491ac94493e31cd7ae.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2c%252F0f2cf83c8f7c52bd64f3d72c6ed9e65b%252Fpa%252FDL01383_2238c9922fac1ddced4932a68b60d382.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_2238c9922fac1ddced4932a68b60d382.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_2d456bd0064e2f07a93bbaa05cb8f9b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_2d456bd0064e2f07a93bbaa05cb8f9b9.jpg not downloaded yet
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_a2c87b8cd668d8eb53508a0da0097bf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_a2c87b8cd668d8eb53508a0da0097bf3.jpg not downloaded yet
2026-03-28 18:46:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 306d745b-ac05-5f2c-a67f-64b41a8efc39 with identifier: HN29475
2026-03-28 18:46:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 306d745b-ac05-5f2c-a67f-64b41a8efc39 with identifier: HN29475
2026-03-28 18:46:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 306d745b-ac05-5f2c-a67f-64b41a8efc39 with identifier: HN29475 to the API
2026-03-28 18:46:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_52702d5498dcd9afb7db1c727383e2ff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:36:53Z',
 'fuel_type': 'petrol',
 'id': '306d745b-ac05-5f2c-a67f-64b41a8efc39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN29475',
 'listing': 'auction',
 'location': 'DE, Buchholz',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 162594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d745b-ac05-5f2c-a67f-64b41a8efc39/306d745b-ac05-5f2c-a67f-64b41a8efc39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_cc637508070fe649f4be8e4698b87092.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d745b-ac05-5f2c-a67f-64b41a8efc39/306d745b-ac05-5f2c-a67f-64b41a8efc39_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_685e0c954c3588755e6b9b60467cc713.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d745b-ac05-5f2c-a67f-64b41a8efc39/306d745b-ac05-5f2c-a67f-64b41a8efc39_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_52702d5498dcd9afb7db1c727383e2ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d745b-ac05-5f2c-a67f-64b41a8efc39/306d745b-ac05-5f2c-a67f-64b41a8efc39_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_42a3a16de2fd5f01a91dcc1ede86a76c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d745b-ac05-5f2c-a67f-64b41a8efc39/306d745b-ac05-5f2c-a67f-64b41a8efc39_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_e2392162e516dd8f61f69b954c2afd96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d745b-ac05-5f2c-a67f-64b41a8efc39/306d745b-ac05-5f2c-a67f-64b41a8efc39_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/5a/2b5a7c13c2c61b9471ac7dee5a28f0f2/pa/HN29475_8e4ce6e74b9b2e2e6973581777b30403.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.6 LIVE II',
 'transmission': 'manual',
 'trim': 'LIVE II',
 'year': 2012}
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN29475%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [auto1.de] INFO: Saving data for HN29475: {'created_time': 1774723594.12052, 'last_price_update_time': 1774723594.120532, 'auction_closing_time': 1774885013.0}
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN29475') HTTP/1.1" 204 0
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456250490>
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_9012500fa5ded61a779dafc4c7914760.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_9012500fa5ded61a779dafc4c7914760.jpg saved to cache
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6de7bc2-85b4-510d-af96-a22b58b32fc9
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_d897e913c7c03cbfb6760b3877a7daad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_ce3f51f1a6d4f8951033f174a49ec9f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_ce3f51f1a6d4f8951033f174a49ec9f9.jpg not downloaded yet
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_9586fba3c536ed00e3ea28459c01551d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_9586fba3c536ed00e3ea28459c01551d.jpg not downloaded yet
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_b7e876cbfbfccf9480cea9d05dc2b7b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_b7e876cbfbfccf9480cea9d05dc2b7b0.jpg not downloaded yet
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC53202/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX34662/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU87047/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU11253/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_b45308105425bf4ff2a62835ca52f8c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_71fb0c972d1d803d719b627bcecea20d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456277290>
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_b5de2f908e954ff49638c9b464b9baf3.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_b5de2f908e954ff49638c9b464b9baf3.jpg saved to cache
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6de7bc2-85b4-510d-af96-a22b58b32fc9
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477e150>
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_ccc0880af6a359479c52c433870dad1e.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_ccc0880af6a359479c52c433870dad1e.jpg saved to cache
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6de7bc2-85b4-510d-af96-a22b58b32fc9
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_35d1ab072d0acbcb9dbe33156aebba7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_35d1ab072d0acbcb9dbe33156aebba7c.jpg not downloaded yet
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_8564c4f5e09c9ff270361f741eb4edde.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_8564c4f5e09c9ff270361f741eb4edde.jpg not downloaded yet
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_7ff463214ed17ab7bb22077f1a56fbd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_7ff463214ed17ab7bb22077f1a56fbd2.jpg not downloaded yet
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL33228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW39915/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_34ec1aace2918594ebf5d06017a80438.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_34ec1aace2918594ebf5d06017a80438.jpg not downloaded yet
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_cf627fc79a1ec3da8f814b4e41b58366.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_cf627fc79a1ec3da8f814b4e41b58366.jpg not downloaded yet
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_3401882e61634a456710f9882bab440d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_3401882e61634a456710f9882bab440d.jpg not downloaded yet
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456213090>
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_d897e913c7c03cbfb6760b3877a7daad.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_d897e913c7c03cbfb6760b3877a7daad.jpg saved to cache
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b36272d4-f016-51b1-bda0-5f905d11b176
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_41bb0db7a9c023bce1bbc385fa068ff1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_41bb0db7a9c023bce1bbc385fa068ff1.jpg not downloaded yet
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_5e673bbc07d57faa4248d8b354af7aa3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_5e673bbc07d57faa4248d8b354af7aa3.jpg not downloaded yet
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_8f90f84cfd45720196653c1a84954e84.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_8f90f84cfd45720196653c1a84954e84.jpg not downloaded yet
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456313290>
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_b45308105425bf4ff2a62835ca52f8c9.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_b45308105425bf4ff2a62835ca52f8c9.jpg saved to cache
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43660542-0239-5791-b2d9-5bb568d20e7a
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547d3910>
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_71fb0c972d1d803d719b627bcecea20d.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_71fb0c972d1d803d719b627bcecea20d.jpg saved to cache
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43660542-0239-5791-b2d9-5bb568d20e7a
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_2d456bd0064e2f07a93bbaa05cb8f9b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_dd12fe2e333277491ac94493e31cd7ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_a2c87b8cd668d8eb53508a0da0097bf3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_101d08ee2ec9213e0cf79f5011e6e6fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_101d08ee2ec9213e0cf79f5011e6e6fb.jpg not downloaded yet
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_2653e17dc23416072c6e1ed86711d55f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_2653e17dc23416072c6e1ed86711d55f.jpg not downloaded yet
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_d271dfba01355c0f2e029c2d825c1f4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_d271dfba01355c0f2e029c2d825c1f4e.jpg not downloaded yet
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_2238c9922fac1ddced4932a68b60d382.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_6ce86f5d4643b130069ac837a65ed50b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_1d39efe7aa6bd3e53c75e9de505ade10.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_25c16e8fb962b4abdfce9dbe2814e595.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_f0e182d347ba1dd3069740f9f287b9d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_7f074354e1f4001da2397845bd68e7e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245641b510>
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_2d456bd0064e2f07a93bbaa05cb8f9b9.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_2d456bd0064e2f07a93bbaa05cb8f9b9.jpg saved to cache
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b36272d4-f016-51b1-bda0-5f905d11b176
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245636d150>
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_dd12fe2e333277491ac94493e31cd7ae.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_dd12fe2e333277491ac94493e31cd7ae.jpg saved to cache
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69e8735f-10e7-50ca-afdd-1830a5164945
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245873f950>
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_a2c87b8cd668d8eb53508a0da0097bf3.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_a2c87b8cd668d8eb53508a0da0097bf3.jpg saved to cache
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43660542-0239-5791-b2d9-5bb568d20e7a
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_d271dfba01355c0f2e029c2d825c1f4e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_3401882e61634a456710f9882bab440d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_57b2b7d146d03500de4eea21a9f99abb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245832e6d0>
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2455164e-0840-5ce2-b240-bc935f5ba72b/2455164e-0840-5ce2-b240-bc935f5ba72b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2c%252F0f2cf83c8f7c52bd64f3d72c6ed9e65b%252Fpa%252FDL01383_2238c9922fac1ddced4932a68b60d382.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_2238c9922fac1ddced4932a68b60d382.jpg saved to cache
2026-03-28 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2455164e-0840-5ce2-b240-bc935f5ba72b
2026-03-28 18:46:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2466b7bd10>
2026-03-28 18:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_6ce86f5d4643b130069ac837a65ed50b.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_6ce86f5d4643b130069ac837a65ed50b.jpg saved to cache
2026-03-28 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4dc64e49-56b2-53bd-88c6-a84311c425b1
2026-03-28 18:46:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245636ee50>
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_1d39efe7aa6bd3e53c75e9de505ade10.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_1d39efe7aa6bd3e53c75e9de505ade10.jpg saved to cache
2026-03-28 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6de7bc2-85b4-510d-af96-a22b58b32fc9
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458609410>
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2455164e-0840-5ce2-b240-bc935f5ba72b/2455164e-0840-5ce2-b240-bc935f5ba72b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2c%252F0f2cf83c8f7c52bd64f3d72c6ed9e65b%252Fpa%252FDL01383_25c16e8fb962b4abdfce9dbe2814e595.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_25c16e8fb962b4abdfce9dbe2814e595.jpg saved to cache
2026-03-28 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2455164e-0840-5ce2-b240-bc935f5ba72b
2026-03-28 18:46:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547695d0>
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_f0e182d347ba1dd3069740f9f287b9d9.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_f0e182d347ba1dd3069740f9f287b9d9.jpg saved to cache
2026-03-28 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4dc64e49-56b2-53bd-88c6-a84311c425b1
2026-03-28 18:46:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563eb9d0>
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F8b%252Ff98b714cad175a89a96a2a9d6aeb7b08%252Fpa%252FHJ08295_7f074354e1f4001da2397845bd68e7e9.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_7f074354e1f4001da2397845bd68e7e9.jpg saved to cache
2026-03-28 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4dc64e49-56b2-53bd-88c6-a84311c425b1
2026-03-28 18:46:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4dc64e49-56b2-53bd-88c6-a84311c425b1, skipping ID generation
2026-03-28 18:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dc64e49-56b2-53bd-88c6-a84311c425b1 with scrape type 1
2026-03-28 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4dc64e49-56b2-53bd-88c6-a84311c425b1 sending to next pipeline
2026-03-28 18:46:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dc64e49-56b2-53bd-88c6-a84311c425b1, identifier: HJ08295
2026-03-28 18:46:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dc64e49-56b2-53bd-88c6-a84311c425b1 with identifier: HJ08295
2026-03-28 18:46:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dc64e49-56b2-53bd-88c6-a84311c425b1 with identifier: HJ08295
2026-03-28 18:46:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dc64e49-56b2-53bd-88c6-a84311c425b1 with identifier: HJ08295 to the API
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_7f074354e1f4001da2397845bd68e7e9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:50:10Z',
 'fuel_type': 'diesel',
 'id': '4dc64e49-56b2-53bd-88c6-a84311c425b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ08295',
 'listing': 'auction',
 'location': 'DE, Mönchengladbach',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 161039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3390609,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_f0e182d347ba1dd3069740f9f287b9d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3301870,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_7f074354e1f4001da2397845bd68e7e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3241681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_6ce86f5d4643b130069ac837a65ed50b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3217237,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_f21c09b1c565661180fe71a777509405.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3142324,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_70ccf782d51eb06a77ddaf05ae587df2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_b2ec3042ad7a4b247932a294410d8dd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_df9ef822de5d93fe3551566095bbfad3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3284076,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_8404ff1b96eb424fd7f1961e0bd296e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3272538,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_ca1cfce9aac167ada7775b7e08cd9261.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4dc64e49-56b2-53bd-88c6-a84311c425b1/4dc64e49-56b2-53bd-88c6-a84311c425b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/8b/f98b714cad175a89a96a2a9d6aeb7b08/pa/HJ08295_bfaa74e3fac0fa6bac124dba4bff8ef8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2016}
2026-03-28 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ08295%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [auto1.de] INFO: Saving data for HJ08295: {'created_time': 1774723596.003835, 'last_price_update_time': 1774723596.003846, 'auction_closing_time': 1774885810.0}
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ08295') HTTP/1.1" 204 0
2026-03-28 18:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_b7e876cbfbfccf9480cea9d05dc2b7b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_7ff463214ed17ab7bb22077f1a56fbd2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT27218> (referer: https://www.auto1.com/v1/car-details-view/LT27218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW84058> (referer: https://www.auto1.com/v1/car-details-view/BW84058/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546f62d0>
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_d271dfba01355c0f2e029c2d825c1f4e.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_d271dfba01355c0f2e029c2d825c1f4e.jpg saved to cache
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43660542-0239-5791-b2d9-5bb568d20e7a
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563c1810>
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_3401882e61634a456710f9882bab440d.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_3401882e61634a456710f9882bab440d.jpg saved to cache
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43660542-0239-5791-b2d9-5bb568d20e7a
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454687dd0>
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_57b2b7d146d03500de4eea21a9f99abb.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_57b2b7d146d03500de4eea21a9f99abb.jpg saved to cache
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43660542-0239-5791-b2d9-5bb568d20e7a
2026-03-28 18:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_5e673bbc07d57faa4248d8b354af7aa3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560546d0>
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_b7e876cbfbfccf9480cea9d05dc2b7b0.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_b7e876cbfbfccf9480cea9d05dc2b7b0.jpg saved to cache
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43660542-0239-5791-b2d9-5bb568d20e7a
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454812f50>
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_7ff463214ed17ab7bb22077f1a56fbd2.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_7ff463214ed17ab7bb22077f1a56fbd2.jpg saved to cache
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43660542-0239-5791-b2d9-5bb568d20e7a
2026-03-28 18:46:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76e6e21b-71ab-549d-a300-05d206ce7541 with identifier: LT27218
2026-03-28 18:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76e6e21b-71ab-549d-a300-05d206ce7541 with scrape type 1
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76e6e21b-71ab-549d-a300-05d206ce7541
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_0739cb039e49a27707dca80b78c897ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_0739cb039e49a27707dca80b78c897ea.jpg not downloaded yet
2026-03-28 18:46:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da587257-26c9-5201-8a3a-06f0ddb6f3f6 with identifier: BW84058
2026-03-28 18:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da587257-26c9-5201-8a3a-06f0ddb6f3f6 with scrape type 1
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da587257-26c9-5201-8a3a-06f0ddb6f3f6
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fe3%252Faee311fbcd03be8119db06177b6c0a54%252Fpa%252FBW84058_cc7130224392d66987ff727490465b4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_cc7130224392d66987ff727490465b4e.jpg already downloaded
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fe3%252Faee311fbcd03be8119db06177b6c0a54%252Fpa%252FBW84058_c38eb98ac437d93c3bcd131ed7463f01.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_c38eb98ac437d93c3bcd131ed7463f01.jpg already downloaded
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fe3%252Faee311fbcd03be8119db06177b6c0a54%252Fpa%252FBW84058_c006e439df6634bee1901424094691c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_c006e439df6634bee1901424094691c9.jpg already downloaded
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fe3%252Faee311fbcd03be8119db06177b6c0a54%252Fpa%252FBW84058_9b45c1d69d24a0a07ae558d79ccef5b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_9b45c1d69d24a0a07ae558d79ccef5b1.jpg already downloaded
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fe3%252Faee311fbcd03be8119db06177b6c0a54%252Fpa%252FBW84058_cf9f0422ab5efe7a776676676997a5da.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_cf9f0422ab5efe7a776676676997a5da.jpg already downloaded
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fe3%252Faee311fbcd03be8119db06177b6c0a54%252Fpa%252FBW84058_aa5523cb2d3bb4a9bb6db39de75cb31e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_aa5523cb2d3bb4a9bb6db39de75cb31e.jpg already downloaded
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fe3%252Faee311fbcd03be8119db06177b6c0a54%252Fpa%252FBW84058_9361fc2ec6e05a4a6cfd0e82ce0407d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_9361fc2ec6e05a4a6cfd0e82ce0407d7.jpg already downloaded
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fe3%252Faee311fbcd03be8119db06177b6c0a54%252Fpa%252FBW84058_f1b94cd4433524bfca329c85c47472f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_f1b94cd4433524bfca329c85c47472f9.jpg already downloaded
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fe3%252Faee311fbcd03be8119db06177b6c0a54%252Fpa%252FBW84058_dd0a46226dca4f6c0a66b117160e4601.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_dd0a46226dca4f6c0a66b117160e4601.jpg already downloaded
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fe3%252Faee311fbcd03be8119db06177b6c0a54%252Fpa%252FBW84058_a64ad4283f3a8f3253dc7400d5f85199.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_a64ad4283f3a8f3253dc7400d5f85199.jpg already downloaded
2026-03-28 18:46:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da587257-26c9-5201-8a3a-06f0ddb6f3f6, identifier: BW84058
2026-03-28 18:46:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da587257-26c9-5201-8a3a-06f0ddb6f3f6 with identifier: BW84058
2026-03-28 18:46:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da587257-26c9-5201-8a3a-06f0ddb6f3f6 with identifier: BW84058
2026-03-28 18:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da587257-26c9-5201-8a3a-06f0ddb6f3f6 with identifier: BW84058 to the API
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BW84058>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:26:45Z',
 'fuel_type': 'diesel',
 'id': 'da587257-26c9-5201-8a3a-06f0ddb6f3f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW84058',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 115312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_cc7130224392d66987ff727490465b4e.jpg',
                'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_c38eb98ac437d93c3bcd131ed7463f01.jpg',
                'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_c006e439df6634bee1901424094691c9.jpg',
                'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_9b45c1d69d24a0a07ae558d79ccef5b1.jpg',
                'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_cf9f0422ab5efe7a776676676997a5da.jpg',
                'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_aa5523cb2d3bb4a9bb6db39de75cb31e.jpg',
                'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_9361fc2ec6e05a4a6cfd0e82ce0407d7.jpg',
                'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_f1b94cd4433524bfca329c85c47472f9.jpg',
                'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_dd0a46226dca4f6c0a66b117160e4601.jpg',
                'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_a64ad4283f3a8f3253dc7400d5f85199.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da587257-26c9-5201-8a3a-06f0ddb6f3f6/da587257-26c9-5201-8a3a-06f0ddb6f3f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_cc7130224392d66987ff727490465b4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da587257-26c9-5201-8a3a-06f0ddb6f3f6/da587257-26c9-5201-8a3a-06f0ddb6f3f6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_c38eb98ac437d93c3bcd131ed7463f01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da587257-26c9-5201-8a3a-06f0ddb6f3f6/da587257-26c9-5201-8a3a-06f0ddb6f3f6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_c006e439df6634bee1901424094691c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da587257-26c9-5201-8a3a-06f0ddb6f3f6/da587257-26c9-5201-8a3a-06f0ddb6f3f6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_9b45c1d69d24a0a07ae558d79ccef5b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da587257-26c9-5201-8a3a-06f0ddb6f3f6/da587257-26c9-5201-8a3a-06f0ddb6f3f6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_cf9f0422ab5efe7a776676676997a5da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da587257-26c9-5201-8a3a-06f0ddb6f3f6/da587257-26c9-5201-8a3a-06f0ddb6f3f6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_aa5523cb2d3bb4a9bb6db39de75cb31e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da587257-26c9-5201-8a3a-06f0ddb6f3f6/da587257-26c9-5201-8a3a-06f0ddb6f3f6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_9361fc2ec6e05a4a6cfd0e82ce0407d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da587257-26c9-5201-8a3a-06f0ddb6f3f6/da587257-26c9-5201-8a3a-06f0ddb6f3f6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_f1b94cd4433524bfca329c85c47472f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da587257-26c9-5201-8a3a-06f0ddb6f3f6/da587257-26c9-5201-8a3a-06f0ddb6f3f6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_dd0a46226dca4f6c0a66b117160e4601.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da587257-26c9-5201-8a3a-06f0ddb6f3f6/da587257-26c9-5201-8a3a-06f0ddb6f3f6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/e3/aee311fbcd03be8119db06177b6c0a54/pa/BW84058_a64ad4283f3a8f3253dc7400d5f85199.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 DDiS Comfort+ 4x4',
 'transmission': 'manual',
 'trim': 'Comfort+ 4x4',
 'year': 2016}
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW84058%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [auto1.de] INFO: Saving data for BW84058: {'created_time': 1774723596.905144, 'last_price_update_time': 1774723596.905155, 'auction_closing_time': 1774884405.0}
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW84058') HTTP/1.1" 204 0
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_81f73689d0f88ac3b2b9c1c6f06f14c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_81f73689d0f88ac3b2b9c1c6f06f14c5.jpg not downloaded yet
2026-03-28 18:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_41bb0db7a9c023bce1bbc385fa068ff1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_8f90f84cfd45720196653c1a84954e84.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_8564c4f5e09c9ff270361f741eb4edde.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_0795420750be3453a838d2d2e166ed96.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_0795420750be3453a838d2d2e166ed96.jpg not downloaded yet
2026-03-28 18:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW39915> (referer: https://www.auto1.com/v1/car-details-view/UW39915/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d3850>
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_5e673bbc07d57faa4248d8b354af7aa3.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_5e673bbc07d57faa4248d8b354af7aa3.jpg saved to cache
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b36272d4-f016-51b1-bda0-5f905d11b176
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_14f23f8d745c6e808ad5171e1e46145a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_14f23f8d745c6e808ad5171e1e46145a.jpg not downloaded yet
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_d8abbce9b96fe54081888bd08466ff00.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_d8abbce9b96fe54081888bd08466ff00.jpg not downloaded yet
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_5f3fad21d31cb7f50bb2718aa7e60ad0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_5f3fad21d31cb7f50bb2718aa7e60ad0.jpg not downloaded yet
2026-03-28 18:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_0739cb039e49a27707dca80b78c897ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_eb904572091eb4b0553578c58ec507cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_eb904572091eb4b0553578c58ec507cd.jpg not downloaded yet
2026-03-28 18:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_81f73689d0f88ac3b2b9c1c6f06f14c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855ae10>
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_41bb0db7a9c023bce1bbc385fa068ff1.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_41bb0db7a9c023bce1bbc385fa068ff1.jpg saved to cache
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69e8735f-10e7-50ca-afdd-1830a5164945
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454821810>
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_8f90f84cfd45720196653c1a84954e84.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_8f90f84cfd45720196653c1a84954e84.jpg saved to cache
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43660542-0239-5791-b2d9-5bb568d20e7a
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454647a90>
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_8564c4f5e09c9ff270361f741eb4edde.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_8564c4f5e09c9ff270361f741eb4edde.jpg saved to cache
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b36272d4-f016-51b1-bda0-5f905d11b176
2026-03-28 18:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_35d1ab072d0acbcb9dbe33156aebba7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_4e7d3806307d7babda1f1f0e82ee6274.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_4e7d3806307d7babda1f1f0e82ee6274.jpg not downloaded yet
2026-03-28 18:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f80eb5e3-6431-5962-a7bc-f37fa17496ff with identifier: UW39915
2026-03-28 18:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f80eb5e3-6431-5962-a7bc-f37fa17496ff with scrape type 1
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f80eb5e3-6431-5962-a7bc-f37fa17496ff
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d51f48408a92077e0aade6e0ef6648e%252Fpa%252FUW39915_f95027f7251698657f97de09eaeed650.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_f95027f7251698657f97de09eaeed650.jpg already downloaded
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d51f48408a92077e0aade6e0ef6648e%252Fpa%252FUW39915_01832ac2cc5ecc4c60b3f9de9a28d18f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_01832ac2cc5ecc4c60b3f9de9a28d18f.jpg already downloaded
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d51f48408a92077e0aade6e0ef6648e%252Fpa%252FUW39915_da804182b17bea2cb6ac97635debaada.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_da804182b17bea2cb6ac97635debaada.jpg already downloaded
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d51f48408a92077e0aade6e0ef6648e%252Fpa%252FUW39915_858ff8d29bb360415eaba7aa63f0a498.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_858ff8d29bb360415eaba7aa63f0a498.jpg already downloaded
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d51f48408a92077e0aade6e0ef6648e%252Fpa%252FUW39915_0f0528ae353c4c74a3cd986bf83e1941.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_0f0528ae353c4c74a3cd986bf83e1941.jpg already downloaded
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d51f48408a92077e0aade6e0ef6648e%252Fpa%252FUW39915_1dafbdce1cd4ccf30f37fda6af47b1b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_1dafbdce1cd4ccf30f37fda6af47b1b4.jpg already downloaded
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d51f48408a92077e0aade6e0ef6648e%252Fpa%252FUW39915_f883dec8a9c199b39cd5e1f1dbc8a8d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_f883dec8a9c199b39cd5e1f1dbc8a8d5.jpg already downloaded
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d51f48408a92077e0aade6e0ef6648e%252Fpa%252FUW39915_b7ba67af4d34ed87b51f3561ca2c60c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_b7ba67af4d34ed87b51f3561ca2c60c2.jpg already downloaded
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d51f48408a92077e0aade6e0ef6648e%252Fpa%252FUW39915_47e8ea9ceab404d18088806d5d5941bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_47e8ea9ceab404d18088806d5d5941bb.jpg already downloaded
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d51f48408a92077e0aade6e0ef6648e%252Fpa%252FUW39915_0284ea522ca87fc82593f0cd84ea8b71.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_0284ea522ca87fc82593f0cd84ea8b71.jpg already downloaded
2026-03-28 18:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f80eb5e3-6431-5962-a7bc-f37fa17496ff, identifier: UW39915
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_b631349750b650b52204b26666fe2d1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_b631349750b650b52204b26666fe2d1f.jpg not downloaded yet
2026-03-28 18:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f80eb5e3-6431-5962-a7bc-f37fa17496ff with identifier: UW39915
2026-03-28 18:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f80eb5e3-6431-5962-a7bc-f37fa17496ff with identifier: UW39915
2026-03-28 18:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f80eb5e3-6431-5962-a7bc-f37fa17496ff with identifier: UW39915 to the API
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UW39915>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:47:10Z',
 'fuel_type': 'petrol',
 'id': 'f80eb5e3-6431-5962-a7bc-f37fa17496ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW39915',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 97356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_f95027f7251698657f97de09eaeed650.jpg',
                'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_01832ac2cc5ecc4c60b3f9de9a28d18f.jpg',
                'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_da804182b17bea2cb6ac97635debaada.jpg',
                'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_858ff8d29bb360415eaba7aa63f0a498.jpg',
                'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_0f0528ae353c4c74a3cd986bf83e1941.jpg',
                'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_1dafbdce1cd4ccf30f37fda6af47b1b4.jpg',
                'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_f883dec8a9c199b39cd5e1f1dbc8a8d5.jpg',
                'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_b7ba67af4d34ed87b51f3561ca2c60c2.jpg',
                'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_47e8ea9ceab404d18088806d5d5941bb.jpg',
                'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_0284ea522ca87fc82593f0cd84ea8b71.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80eb5e3-6431-5962-a7bc-f37fa17496ff/f80eb5e3-6431-5962-a7bc-f37fa17496ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_f95027f7251698657f97de09eaeed650.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80eb5e3-6431-5962-a7bc-f37fa17496ff/f80eb5e3-6431-5962-a7bc-f37fa17496ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_01832ac2cc5ecc4c60b3f9de9a28d18f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80eb5e3-6431-5962-a7bc-f37fa17496ff/f80eb5e3-6431-5962-a7bc-f37fa17496ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_da804182b17bea2cb6ac97635debaada.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80eb5e3-6431-5962-a7bc-f37fa17496ff/f80eb5e3-6431-5962-a7bc-f37fa17496ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_858ff8d29bb360415eaba7aa63f0a498.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80eb5e3-6431-5962-a7bc-f37fa17496ff/f80eb5e3-6431-5962-a7bc-f37fa17496ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_0f0528ae353c4c74a3cd986bf83e1941.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80eb5e3-6431-5962-a7bc-f37fa17496ff/f80eb5e3-6431-5962-a7bc-f37fa17496ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_1dafbdce1cd4ccf30f37fda6af47b1b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80eb5e3-6431-5962-a7bc-f37fa17496ff/f80eb5e3-6431-5962-a7bc-f37fa17496ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_f883dec8a9c199b39cd5e1f1dbc8a8d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80eb5e3-6431-5962-a7bc-f37fa17496ff/f80eb5e3-6431-5962-a7bc-f37fa17496ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_b7ba67af4d34ed87b51f3561ca2c60c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80eb5e3-6431-5962-a7bc-f37fa17496ff/f80eb5e3-6431-5962-a7bc-f37fa17496ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_47e8ea9ceab404d18088806d5d5941bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f80eb5e3-6431-5962-a7bc-f37fa17496ff/f80eb5e3-6431-5962-a7bc-f37fa17496ff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d51f48408a92077e0aade6e0ef6648e/pa/UW39915_0284ea522ca87fc82593f0cd84ea8b71.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 0.9 Energy Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2018}
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39915%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [auto1.de] INFO: Saving data for UW39915: {'created_time': 1774723597.844809, 'last_price_update_time': 1774723597.844823, 'auction_closing_time': 1774885630.0}
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW39915') HTTP/1.1" 204 0
2026-03-28 18:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_9586fba3c536ed00e3ea28459c01551d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_ce3f51f1a6d4f8951033f174a49ec9f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_8fc340e8a09ccebc12021d6f0854e021.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_8fc340e8a09ccebc12021d6f0854e021.jpg not downloaded yet
2026-03-28 18:46:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP32069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546f7890>
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_0739cb039e49a27707dca80b78c897ea.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_0739cb039e49a27707dca80b78c897ea.jpg saved to cache
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76e6e21b-71ab-549d-a300-05d206ce7541
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245608c1d0>
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_81f73689d0f88ac3b2b9c1c6f06f14c5.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_81f73689d0f88ac3b2b9c1c6f06f14c5.jpg saved to cache
2026-03-28 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76e6e21b-71ab-549d-a300-05d206ce7541
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458531310>
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_35d1ab072d0acbcb9dbe33156aebba7c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_35d1ab072d0acbcb9dbe33156aebba7c.jpg saved to cache
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69e8735f-10e7-50ca-afdd-1830a5164945
2026-03-28 18:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL33228> (referer: https://www.auto1.com/v1/car-details-view/YL33228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX34662> (referer: https://www.auto1.com/v1/car-details-view/AX34662/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC53202> (referer: https://www.auto1.com/v1/car-details-view/GC53202/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU11253> (referer: https://www.auto1.com/v1/car-details-view/ZU11253/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU87047> (referer: https://www.auto1.com/v1/car-details-view/XU87047/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456095710>
2026-03-28 18:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_9586fba3c536ed00e3ea28459c01551d.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_9586fba3c536ed00e3ea28459c01551d.jpg saved to cache
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b36272d4-f016-51b1-bda0-5f905d11b176
2026-03-28 18:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24571557d0>
2026-03-28 18:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_ce3f51f1a6d4f8951033f174a49ec9f9.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_ce3f51f1a6d4f8951033f174a49ec9f9.jpg saved to cache
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69e8735f-10e7-50ca-afdd-1830a5164945
2026-03-28 18:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_34ec1aace2918594ebf5d06017a80438.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 039f92b0-a47d-513c-be79-1bdb93ea3dfd with identifier: YL33228
2026-03-28 18:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039f92b0-a47d-513c-be79-1bdb93ea3dfd with scrape type 1
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 039f92b0-a47d-513c-be79-1bdb93ea3dfd
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea39bb38c213704f32a315489f89404%252Fpa%252FYL33228_5071894dae4e111a50264af77a6c0848.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_5071894dae4e111a50264af77a6c0848.jpg already downloaded
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea39bb38c213704f32a315489f89404%252Fpa%252FYL33228_94ed4f70cb40cb0bc448a87c8fbe6a8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_94ed4f70cb40cb0bc448a87c8fbe6a8a.jpg already downloaded
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea39bb38c213704f32a315489f89404%252Fpa%252FYL33228_f462768a8f84f3152cbad41009768b0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_f462768a8f84f3152cbad41009768b0d.jpg already downloaded
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea39bb38c213704f32a315489f89404%252Fpa%252FYL33228_9a5cf64ee9f185118d73d9af0358c1fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_9a5cf64ee9f185118d73d9af0358c1fb.jpg already downloaded
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea39bb38c213704f32a315489f89404%252Fpa%252FYL33228_d96322cf8b2d753b5acf44697782d643.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_d96322cf8b2d753b5acf44697782d643.jpg already downloaded
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea39bb38c213704f32a315489f89404%252Fpa%252FYL33228_c243326381c798b0549d9c774842d190.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_c243326381c798b0549d9c774842d190.jpg already downloaded
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea39bb38c213704f32a315489f89404%252Fpa%252FYL33228_4691101f4c047cca7d9c90c9f4e32d17.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_4691101f4c047cca7d9c90c9f4e32d17.jpg already downloaded
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea39bb38c213704f32a315489f89404%252Fpa%252FYL33228_c4e8dfe23a7b568c077327da28b361d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_c4e8dfe23a7b568c077327da28b361d5.jpg already downloaded
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea39bb38c213704f32a315489f89404%252Fpa%252FYL33228_64d96d4d20865be87bc8999b59b2f81b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_64d96d4d20865be87bc8999b59b2f81b.jpg already downloaded
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea39bb38c213704f32a315489f89404%252Fpa%252FYL33228_f3a065dd0867470b990171800f891391.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_f3a065dd0867470b990171800f891391.jpg already downloaded
2026-03-28 18:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 039f92b0-a47d-513c-be79-1bdb93ea3dfd, identifier: YL33228
2026-03-28 18:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f57040be-5764-5b31-ac27-bf01704e375b with identifier: AX34662
2026-03-28 18:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f57040be-5764-5b31-ac27-bf01704e375b with scrape type 1
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f57040be-5764-5b31-ac27-bf01704e375b
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fea%252Fbcea9544407b890376d74181f12341f1%252Fpa%252FAX34662_d309eca415b2dff2f376f37d20c89019.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_d309eca415b2dff2f376f37d20c89019.jpg not downloaded yet
2026-03-28 18:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f493106e-6d51-5e38-a23f-c7c6f4021320 with identifier: GC53202
2026-03-28 18:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f493106e-6d51-5e38-a23f-c7c6f4021320 with scrape type 1
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f493106e-6d51-5e38-a23f-c7c6f4021320
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faa%252Ff4aa5453f5388deed471a213df2f9cb6%252Fpa%252FGC53202_9a0fd66dad10d0cb47bb249f13316e70.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_9a0fd66dad10d0cb47bb249f13316e70.jpg not downloaded yet
2026-03-28 18:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e82298f8-bcc5-582a-8136-30fec9e4cead with identifier: ZU11253
2026-03-28 18:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e82298f8-bcc5-582a-8136-30fec9e4cead with scrape type 1
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e82298f8-bcc5-582a-8136-30fec9e4cead
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_eba60e1941bd4bc091539df9053f1ebe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_eba60e1941bd4bc091539df9053f1ebe.jpg not downloaded yet
2026-03-28 18:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 232f933d-bcce-5bd0-bdd5-1f0c6f66a012 with identifier: XU87047
2026-03-28 18:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012 with scrape type 1
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_a88e94022be5e55d0464e8b8989706fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_a88e94022be5e55d0464e8b8989706fa.jpg not downloaded yet
2026-03-28 18:46:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 039f92b0-a47d-513c-be79-1bdb93ea3dfd with identifier: YL33228
2026-03-28 18:46:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 039f92b0-a47d-513c-be79-1bdb93ea3dfd with identifier: YL33228
2026-03-28 18:46:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 039f92b0-a47d-513c-be79-1bdb93ea3dfd with identifier: YL33228 to the API
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YL33228>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:10:55Z',
 'fuel_type': 'diesel',
 'id': '039f92b0-a47d-513c-be79-1bdb93ea3dfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL33228',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 234778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_5071894dae4e111a50264af77a6c0848.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_94ed4f70cb40cb0bc448a87c8fbe6a8a.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_f462768a8f84f3152cbad41009768b0d.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_9a5cf64ee9f185118d73d9af0358c1fb.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_d96322cf8b2d753b5acf44697782d643.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_c243326381c798b0549d9c774842d190.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_4691101f4c047cca7d9c90c9f4e32d17.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_c4e8dfe23a7b568c077327da28b361d5.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_64d96d4d20865be87bc8999b59b2f81b.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_f3a065dd0867470b990171800f891391.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039f92b0-a47d-513c-be79-1bdb93ea3dfd/039f92b0-a47d-513c-be79-1bdb93ea3dfd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_5071894dae4e111a50264af77a6c0848.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039f92b0-a47d-513c-be79-1bdb93ea3dfd/039f92b0-a47d-513c-be79-1bdb93ea3dfd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_94ed4f70cb40cb0bc448a87c8fbe6a8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039f92b0-a47d-513c-be79-1bdb93ea3dfd/039f92b0-a47d-513c-be79-1bdb93ea3dfd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_f462768a8f84f3152cbad41009768b0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039f92b0-a47d-513c-be79-1bdb93ea3dfd/039f92b0-a47d-513c-be79-1bdb93ea3dfd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2724830,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_9a5cf64ee9f185118d73d9af0358c1fb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039f92b0-a47d-513c-be79-1bdb93ea3dfd/039f92b0-a47d-513c-be79-1bdb93ea3dfd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_d96322cf8b2d753b5acf44697782d643.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039f92b0-a47d-513c-be79-1bdb93ea3dfd/039f92b0-a47d-513c-be79-1bdb93ea3dfd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2554736,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_c243326381c798b0549d9c774842d190.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039f92b0-a47d-513c-be79-1bdb93ea3dfd/039f92b0-a47d-513c-be79-1bdb93ea3dfd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_4691101f4c047cca7d9c90c9f4e32d17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039f92b0-a47d-513c-be79-1bdb93ea3dfd/039f92b0-a47d-513c-be79-1bdb93ea3dfd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2514359,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_c4e8dfe23a7b568c077327da28b361d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039f92b0-a47d-513c-be79-1bdb93ea3dfd/039f92b0-a47d-513c-be79-1bdb93ea3dfd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_64d96d4d20865be87bc8999b59b2f81b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_039f92b0-a47d-513c-be79-1bdb93ea3dfd/039f92b0-a47d-513c-be79-1bdb93ea3dfd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea39bb38c213704f32a315489f89404/pa/YL33228_f3a065dd0867470b990171800f891391.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Soccer Trendline',
 'transmission': 'manual',
 'trim': 'Soccer Trendline',
 'year': 2014}
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL33228%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [auto1.de] INFO: Saving data for YL33228: {'created_time': 1774723598.824145, 'last_price_update_time': 1774723598.824156, 'auction_closing_time': 1774883455.0}
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL33228') HTTP/1.1" 204 0
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fea%252Fbcea9544407b890376d74181f12341f1%252Fpa%252FAX34662_efb273ebc46dd05e51761670008c252f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_efb273ebc46dd05e51761670008c252f.jpg not downloaded yet
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faa%252Ff4aa5453f5388deed471a213df2f9cb6%252Fpa%252FGC53202_2b168f08d67636f7026675d66e8e13e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_2b168f08d67636f7026675d66e8e13e6.jpg not downloaded yet
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_e076e6b922f4b97acd0983d2b88828e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_e076e6b922f4b97acd0983d2b88828e9.jpg not downloaded yet
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_1baf9636914c06e6b46bd51ebc5f8a62.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_1baf9636914c06e6b46bd51ebc5f8a62.jpg not downloaded yet
2026-03-28 18:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_d8abbce9b96fe54081888bd08466ff00.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_eb904572091eb4b0553578c58ec507cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fea%252Fbcea9544407b890376d74181f12341f1%252Fpa%252FAX34662_bc73d4544f756675a578d60416f700cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_bc73d4544f756675a578d60416f700cc.jpg not downloaded yet
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faa%252Ff4aa5453f5388deed471a213df2f9cb6%252Fpa%252FGC53202_d22cef3883ab29da1938ec104e708fed.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_d22cef3883ab29da1938ec104e708fed.jpg not downloaded yet
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_ef5a321021903364f0ec01c818357504.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_ef5a321021903364f0ec01c818357504.jpg not downloaded yet
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_b2be88fc7fa72f3a37197a9893c3f7db.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_b2be88fc7fa72f3a37197a9893c3f7db.jpg not downloaded yet
2026-03-28 18:46:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454813610>
2026-03-28 18:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_34ec1aace2918594ebf5d06017a80438.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_34ec1aace2918594ebf5d06017a80438.jpg saved to cache
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69e8735f-10e7-50ca-afdd-1830a5164945
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_46e336b35dc27004a8ef11e491c31283.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fea%252Fbcea9544407b890376d74181f12341f1%252Fpa%252FAX34662_1642262464493260ef2588ec2b620ac5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_1642262464493260ef2588ec2b620ac5.jpg not downloaded yet
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faa%252Ff4aa5453f5388deed471a213df2f9cb6%252Fpa%252FGC53202_c1ed7939023b7e0cee93af3674f76477.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_c1ed7939023b7e0cee93af3674f76477.jpg not downloaded yet
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_6696c4e8350c8323bad36c171d2872d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_6696c4e8350c8323bad36c171d2872d4.jpg not downloaded yet
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_b039570f922bbe059df1c6fbeab5b6d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_b039570f922bbe059df1c6fbeab5b6d4.jpg not downloaded yet
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564a3310>
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_d8abbce9b96fe54081888bd08466ff00.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_d8abbce9b96fe54081888bd08466ff00.jpg saved to cache
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76e6e21b-71ab-549d-a300-05d206ce7541
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547d1790>
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_eb904572091eb4b0553578c58ec507cd.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_eb904572091eb4b0553578c58ec507cd.jpg saved to cache
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76e6e21b-71ab-549d-a300-05d206ce7541
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fea%252Fbcea9544407b890376d74181f12341f1%252Fpa%252FAX34662_e625460ceb2aba572602526ae71552c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_e625460ceb2aba572602526ae71552c1.jpg not downloaded yet
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faa%252Ff4aa5453f5388deed471a213df2f9cb6%252Fpa%252FGC53202_720f790b0c75b15b1a595899cb3dbabd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_720f790b0c75b15b1a595899cb3dbabd.jpg not downloaded yet
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_bcdd0461a8c5970ca3dab922a4127074.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_bcdd0461a8c5970ca3dab922a4127074.jpg not downloaded yet
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_745889b98178a5a17263b02cf00544b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_745889b98178a5a17263b02cf00544b7.jpg not downloaded yet
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_cf627fc79a1ec3da8f814b4e41b58366.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_8fc340e8a09ccebc12021d6f0854e021.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_4e7d3806307d7babda1f1f0e82ee6274.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_710eb4cb639c128c8575ddebb21ea01e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_710eb4cb639c128c8575ddebb21ea01e.jpg not downloaded yet
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_c5d94637361062dc7002d8f1b3a2d064.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_c5d94637361062dc7002d8f1b3a2d064.jpg not downloaded yet
2026-03-28 18:46:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563636d0>
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_46e336b35dc27004a8ef11e491c31283.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_46e336b35dc27004a8ef11e491c31283.jpg saved to cache
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b36272d4-f016-51b1-bda0-5f905d11b176
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_15cb14d30b1943518408e3f050d88ea3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_15cb14d30b1943518408e3f050d88ea3.jpg not downloaded yet
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_7a8d226ebb8659ae9eb9ce5004517167.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_7a8d226ebb8659ae9eb9ce5004517167.jpg not downloaded yet
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_c45bd4dd22154a6d88c634271516bc78.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_c45bd4dd22154a6d88c634271516bc78.jpg not downloaded yet
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_2391ecd4bf9ca4c5916abb9c532f343c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_2391ecd4bf9ca4c5916abb9c532f343c.jpg not downloaded yet
2026-03-28 18:46:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456188890>
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_cf627fc79a1ec3da8f814b4e41b58366.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_cf627fc79a1ec3da8f814b4e41b58366.jpg saved to cache
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b36272d4-f016-51b1-bda0-5f905d11b176
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b88d0>
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_8fc340e8a09ccebc12021d6f0854e021.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_8fc340e8a09ccebc12021d6f0854e021.jpg saved to cache
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76e6e21b-71ab-549d-a300-05d206ce7541
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a6150>
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_4e7d3806307d7babda1f1f0e82ee6274.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_4e7d3806307d7babda1f1f0e82ee6274.jpg saved to cache
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76e6e21b-71ab-549d-a300-05d206ce7541
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_101d08ee2ec9213e0cf79f5011e6e6fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_3bb183dfb424ba63fc2fd67852ba4ca8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_127190633b6a6f52f15ca10433a5c1be.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_1e14bb07a17ea113a2f12a50904fe7d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_1e14bb07a17ea113a2f12a50904fe7d8.jpg not downloaded yet
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_d6c70240313216a8208136587ebc2b3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_d6c70240313216a8208136587ebc2b3c.jpg not downloaded yet
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_2653e17dc23416072c6e1ed86711d55f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_9ec7817a02ad449bf70e83c510372fc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_9ec7817a02ad449bf70e83c510372fc7.jpg not downloaded yet
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_9761bd1de61de76881deab4fa55f73ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_9761bd1de61de76881deab4fa55f73ff.jpg not downloaded yet
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_5f3fad21d31cb7f50bb2718aa7e60ad0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_b631349750b650b52204b26666fe2d1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_1baf9636914c06e6b46bd51ebc5f8a62.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_14f23f8d745c6e808ad5171e1e46145a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245651b710>
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_101d08ee2ec9213e0cf79f5011e6e6fb.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_101d08ee2ec9213e0cf79f5011e6e6fb.jpg saved to cache
2026-03-28 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69e8735f-10e7-50ca-afdd-1830a5164945
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_b39f3530b9a0f92174907be0db30a752.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_745889b98178a5a17263b02cf00544b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456096090>
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_3bb183dfb424ba63fc2fd67852ba4ca8.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_3bb183dfb424ba63fc2fd67852ba4ca8.jpg saved to cache
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b36272d4-f016-51b1-bda0-5f905d11b176
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245632db10>
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_127190633b6a6f52f15ca10433a5c1be.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_127190633b6a6f52f15ca10433a5c1be.jpg saved to cache
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69e8735f-10e7-50ca-afdd-1830a5164945
2026-03-28 18:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP32069> (referer: https://www.auto1.com/v1/car-details-view/VP32069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_e076e6b922f4b97acd0983d2b88828e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d3790>
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_2653e17dc23416072c6e1ed86711d55f.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_2653e17dc23416072c6e1ed86711d55f.jpg saved to cache
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b36272d4-f016-51b1-bda0-5f905d11b176
2026-03-28 18:46:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456430d10>
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_5f3fad21d31cb7f50bb2718aa7e60ad0.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_5f3fad21d31cb7f50bb2718aa7e60ad0.jpg saved to cache
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76e6e21b-71ab-549d-a300-05d206ce7541
2026-03-28 18:46:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456111550>
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_b631349750b650b52204b26666fe2d1f.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_b631349750b650b52204b26666fe2d1f.jpg saved to cache
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76e6e21b-71ab-549d-a300-05d206ce7541
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564e3ed0>
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_1baf9636914c06e6b46bd51ebc5f8a62.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_1baf9636914c06e6b46bd51ebc5f8a62.jpg saved to cache
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012
2026-03-28 18:46:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245603f410>
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_14f23f8d745c6e808ad5171e1e46145a.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_14f23f8d745c6e808ad5171e1e46145a.jpg saved to cache
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76e6e21b-71ab-549d-a300-05d206ce7541
2026-03-28 18:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_710eb4cb639c128c8575ddebb21ea01e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458904390>
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2455164e-0840-5ce2-b240-bc935f5ba72b/2455164e-0840-5ce2-b240-bc935f5ba72b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2c%252F0f2cf83c8f7c52bd64f3d72c6ed9e65b%252Fpa%252FDL01383_b39f3530b9a0f92174907be0db30a752.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_b39f3530b9a0f92174907be0db30a752.jpg saved to cache
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2455164e-0840-5ce2-b240-bc935f5ba72b
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245640b850>
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_745889b98178a5a17263b02cf00544b7.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_745889b98178a5a17263b02cf00544b7.jpg saved to cache
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012
2026-03-28 18:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e97dbadf-cdfb-5357-a7c4-f5aacc0dab40 with identifier: VP32069
2026-03-28 18:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40 with scrape type 1
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_89be946477c71b38f8eb12756ba699c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_89be946477c71b38f8eb12756ba699c2.jpg not downloaded yet
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563f4c50>
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_e076e6b922f4b97acd0983d2b88828e9.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_e076e6b922f4b97acd0983d2b88828e9.jpg saved to cache
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e82298f8-bcc5-582a-8136-30fec9e4cead
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_a30986b4274208887283a8200db1bec4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_a30986b4274208887283a8200db1bec4.jpg not downloaded yet
2026-03-28 18:46:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24571553d0>
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_710eb4cb639c128c8575ddebb21ea01e.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_710eb4cb639c128c8575ddebb21ea01e.jpg saved to cache
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e82298f8-bcc5-582a-8136-30fec9e4cead
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_2f212c303ba96aadb05450ae7ef8fcaa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_2f212c303ba96aadb05450ae7ef8fcaa.jpg not downloaded yet
2026-03-28 18:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_0795420750be3453a838d2d2e166ed96.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_d6c70240313216a8208136587ebc2b3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_a2151046cb78ce471d01e9e733243ab4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_a2151046cb78ce471d01e9e733243ab4.jpg not downloaded yet
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_0dca19c1c7aefabdd81e8530d0e6220d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_0dca19c1c7aefabdd81e8530d0e6220d.jpg not downloaded yet
2026-03-28 18:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_9ec7817a02ad449bf70e83c510372fc7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_bb0b879bd5562278ac4344bea22cf949.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_bb0b879bd5562278ac4344bea22cf949.jpg not downloaded yet
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_d90a57bc513199b9d0deda57eb787006.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_d90a57bc513199b9d0deda57eb787006.jpg not downloaded yet
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_04470faf4d10ddbffb70507f5ca380ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_04470faf4d10ddbffb70507f5ca380ae.jpg not downloaded yet
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_8312ff0ba8cfe0b18fab2ffd6164fedc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_8312ff0ba8cfe0b18fab2ffd6164fedc.jpg not downloaded yet
2026-03-28 18:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_1e14bb07a17ea113a2f12a50904fe7d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_91dc84589573c5baafbb1082b408d823.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_91dc84589573c5baafbb1082b408d823.jpg not downloaded yet
2026-03-28 18:46:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b7b50>
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff5%252F0ff520905bf9d62230c0b4d4b887921d%252Fpa%252FLT27218_0795420750be3453a838d2d2e166ed96.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_0795420750be3453a838d2d2e166ed96.jpg saved to cache
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76e6e21b-71ab-549d-a300-05d206ce7541
2026-03-28 18:46:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76e6e21b-71ab-549d-a300-05d206ce7541, skipping ID generation
2026-03-28 18:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76e6e21b-71ab-549d-a300-05d206ce7541 with scrape type 1
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76e6e21b-71ab-549d-a300-05d206ce7541 sending to next pipeline
2026-03-28 18:46:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76e6e21b-71ab-549d-a300-05d206ce7541, identifier: LT27218
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561ba250>
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_d6c70240313216a8208136587ebc2b3c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_d6c70240313216a8208136587ebc2b3c.jpg saved to cache
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012
2026-03-28 18:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_15cb14d30b1943518408e3f050d88ea3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76e6e21b-71ab-549d-a300-05d206ce7541 with identifier: LT27218
2026-03-28 18:46:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76e6e21b-71ab-549d-a300-05d206ce7541 with identifier: LT27218
2026-03-28 18:46:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76e6e21b-71ab-549d-a300-05d206ce7541 with identifier: LT27218 to the API
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_0795420750be3453a838d2d2e166ed96.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:05:18Z',
 'fuel_type': 'petrol',
 'id': '76e6e21b-71ab-549d-a300-05d206ce7541',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT27218',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'BMW',
 'model': '1er',
 'odometer': 179594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_0739cb039e49a27707dca80b78c897ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_81f73689d0f88ac3b2b9c1c6f06f14c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2603212,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_0795420750be3453a838d2d2e166ed96.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2794181,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_14f23f8d745c6e808ad5171e1e46145a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_d8abbce9b96fe54081888bd08466ff00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2782693,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_5f3fad21d31cb7f50bb2718aa7e60ad0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_eb904572091eb4b0553578c58ec507cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_4e7d3806307d7babda1f1f0e82ee6274.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2505209,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_b631349750b650b52204b26666fe2d1f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76e6e21b-71ab-549d-a300-05d206ce7541/76e6e21b-71ab-549d-a300-05d206ce7541_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/f5/0ff520905bf9d62230c0b4d4b887921d/pa/LT27218_8fc340e8a09ccebc12021d6f0854e021.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT27218%27 HTTP/1.1" 200 None
2026-03-28 18:46:41 [auto1.de] INFO: Saving data for LT27218: {'created_time': 1774723601.791712, 'last_price_update_time': 1774723601.791724, 'auction_closing_time': 1774883118.0}
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT27218') HTTP/1.1" 204 0
2026-03-28 18:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_7a8d226ebb8659ae9eb9ce5004517167.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_c45bd4dd22154a6d88c634271516bc78.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_bcdd0461a8c5970ca3dab922a4127074.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458560110>
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_9ec7817a02ad449bf70e83c510372fc7.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_9ec7817a02ad449bf70e83c510372fc7.jpg saved to cache
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e82298f8-bcc5-582a-8136-30fec9e4cead
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562f6ed0>
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_1e14bb07a17ea113a2f12a50904fe7d8.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_1e14bb07a17ea113a2f12a50904fe7d8.jpg saved to cache
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e82298f8-bcc5-582a-8136-30fec9e4cead
2026-03-28 18:46:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564ba310>
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_15cb14d30b1943518408e3f050d88ea3.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_15cb14d30b1943518408e3f050d88ea3.jpg saved to cache
2026-03-28 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e82298f8-bcc5-582a-8136-30fec9e4cead
2026-03-28 18:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_720f790b0c75b15b1a595899cb3dbabd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458560d50>
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_7a8d226ebb8659ae9eb9ce5004517167.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_7a8d226ebb8659ae9eb9ce5004517167.jpg saved to cache
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012
2026-03-28 18:46:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454662f90>
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_c45bd4dd22154a6d88c634271516bc78.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_c45bd4dd22154a6d88c634271516bc78.jpg saved to cache
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e82298f8-bcc5-582a-8136-30fec9e4cead
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855ce90>
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_bcdd0461a8c5970ca3dab922a4127074.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_bcdd0461a8c5970ca3dab922a4127074.jpg saved to cache
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e82298f8-bcc5-582a-8136-30fec9e4cead
2026-03-28 18:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_6696c4e8350c8323bad36c171d2872d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_c1ed7939023b7e0cee93af3674f76477.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_e625460ceb2aba572602526ae71552c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564ad190>
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f493106e-6d51-5e38-a23f-c7c6f4021320/f493106e-6d51-5e38-a23f-c7c6f4021320_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faa%252Ff4aa5453f5388deed471a213df2f9cb6%252Fpa%252FGC53202_720f790b0c75b15b1a595899cb3dbabd.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_720f790b0c75b15b1a595899cb3dbabd.jpg saved to cache
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f493106e-6d51-5e38-a23f-c7c6f4021320
2026-03-28 18:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_b039570f922bbe059df1c6fbeab5b6d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_c5d94637361062dc7002d8f1b3a2d064.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_9761bd1de61de76881deab4fa55f73ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_2391ecd4bf9ca4c5916abb9c532f343c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456325550>
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_6696c4e8350c8323bad36c171d2872d4.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_6696c4e8350c8323bad36c171d2872d4.jpg saved to cache
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e82298f8-bcc5-582a-8136-30fec9e4cead
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456402d10>
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f493106e-6d51-5e38-a23f-c7c6f4021320/f493106e-6d51-5e38-a23f-c7c6f4021320_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faa%252Ff4aa5453f5388deed471a213df2f9cb6%252Fpa%252FGC53202_c1ed7939023b7e0cee93af3674f76477.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_c1ed7939023b7e0cee93af3674f76477.jpg saved to cache
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f493106e-6d51-5e38-a23f-c7c6f4021320
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456194910>
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f57040be-5764-5b31-ac27-bf01704e375b/f57040be-5764-5b31-ac27-bf01704e375b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fea%252Fbcea9544407b890376d74181f12341f1%252Fpa%252FAX34662_e625460ceb2aba572602526ae71552c1.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_e625460ceb2aba572602526ae71552c1.jpg saved to cache
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f57040be-5764-5b31-ac27-bf01704e375b
2026-03-28 18:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_8312ff0ba8cfe0b18fab2ffd6164fedc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_0dca19c1c7aefabdd81e8530d0e6220d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d8ed0>
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_b039570f922bbe059df1c6fbeab5b6d4.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_b039570f922bbe059df1c6fbeab5b6d4.jpg saved to cache
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012
2026-03-28 18:46:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458556e90>
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_c5d94637361062dc7002d8f1b3a2d064.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_c5d94637361062dc7002d8f1b3a2d064.jpg saved to cache
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012
2026-03-28 18:46:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454829d50>
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_9761bd1de61de76881deab4fa55f73ff.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_9761bd1de61de76881deab4fa55f73ff.jpg saved to cache
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012
2026-03-28 18:46:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b8d10>
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_2391ecd4bf9ca4c5916abb9c532f343c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_2391ecd4bf9ca4c5916abb9c532f343c.jpg saved to cache
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012
2026-03-28 18:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_a2151046cb78ce471d01e9e733243ab4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245641b650>
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_8312ff0ba8cfe0b18fab2ffd6164fedc.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_8312ff0ba8cfe0b18fab2ffd6164fedc.jpg saved to cache
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561d2010>
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_0dca19c1c7aefabdd81e8530d0e6220d.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_0dca19c1c7aefabdd81e8530d0e6220d.jpg saved to cache
2026-03-28 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40
2026-03-28 18:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_89be946477c71b38f8eb12756ba699c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245640bb10>
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_a2151046cb78ce471d01e9e733243ab4.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_a2151046cb78ce471d01e9e733243ab4.jpg saved to cache
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_a30986b4274208887283a8200db1bec4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_b2be88fc7fa72f3a37197a9893c3f7db.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_2f212c303ba96aadb05450ae7ef8fcaa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_bb0b879bd5562278ac4344bea22cf949.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_91dc84589573c5baafbb1082b408d823.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_d90a57bc513199b9d0deda57eb787006.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_04470faf4d10ddbffb70507f5ca380ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_d22cef3883ab29da1938ec104e708fed.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547cc390>
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_89be946477c71b38f8eb12756ba699c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_89be946477c71b38f8eb12756ba699c2.jpg saved to cache
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_2b168f08d67636f7026675d66e8e13e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_efb273ebc46dd05e51761670008c252f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_bc73d4544f756675a578d60416f700cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_9a0fd66dad10d0cb47bb249f13316e70.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_ef5a321021903364f0ec01c818357504.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_1642262464493260ef2588ec2b620ac5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546a3cd0>
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_a30986b4274208887283a8200db1bec4.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_a30986b4274208887283a8200db1bec4.jpg saved to cache
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454813550>
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_b2be88fc7fa72f3a37197a9893c3f7db.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_b2be88fc7fa72f3a37197a9893c3f7db.jpg saved to cache
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012
2026-03-28 18:46:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245621bd90>
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_2f212c303ba96aadb05450ae7ef8fcaa.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_2f212c303ba96aadb05450ae7ef8fcaa.jpg saved to cache
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_eba60e1941bd4bc091539df9053f1ebe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_d309eca415b2dff2f376f37d20c89019.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564a2b10>
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_bb0b879bd5562278ac4344bea22cf949.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_bb0b879bd5562278ac4344bea22cf949.jpg saved to cache
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40
2026-03-28 18:46:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456296050>
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_91dc84589573c5baafbb1082b408d823.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_91dc84589573c5baafbb1082b408d823.jpg saved to cache
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40
2026-03-28 18:46:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456324e90>
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_d90a57bc513199b9d0deda57eb787006.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_d90a57bc513199b9d0deda57eb787006.jpg saved to cache
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40
2026-03-28 18:46:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547d1550>
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fff%252Fe0ff331aeb80689d059efd28e9b1d8c6%252Fpa%252FVP32069_04470faf4d10ddbffb70507f5ca380ae.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_04470faf4d10ddbffb70507f5ca380ae.jpg saved to cache
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40
2026-03-28 18:46:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e97dbadf-cdfb-5357-a7c4-f5aacc0dab40, skipping ID generation
2026-03-28 18:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40 with scrape type 1
2026-03-28 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40 sending to next pipeline
2026-03-28 18:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e97dbadf-cdfb-5357-a7c4-f5aacc0dab40, identifier: VP32069
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547cdf50>
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f493106e-6d51-5e38-a23f-c7c6f4021320/f493106e-6d51-5e38-a23f-c7c6f4021320_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faa%252Ff4aa5453f5388deed471a213df2f9cb6%252Fpa%252FGC53202_d22cef3883ab29da1938ec104e708fed.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_d22cef3883ab29da1938ec104e708fed.jpg saved to cache
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f493106e-6d51-5e38-a23f-c7c6f4021320
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245634fb90>
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f493106e-6d51-5e38-a23f-c7c6f4021320/f493106e-6d51-5e38-a23f-c7c6f4021320_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faa%252Ff4aa5453f5388deed471a213df2f9cb6%252Fpa%252FGC53202_2b168f08d67636f7026675d66e8e13e6.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_2b168f08d67636f7026675d66e8e13e6.jpg saved to cache
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f493106e-6d51-5e38-a23f-c7c6f4021320
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2457154e10>
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f57040be-5764-5b31-ac27-bf01704e375b/f57040be-5764-5b31-ac27-bf01704e375b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fea%252Fbcea9544407b890376d74181f12341f1%252Fpa%252FAX34662_efb273ebc46dd05e51761670008c252f.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_efb273ebc46dd05e51761670008c252f.jpg saved to cache
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f57040be-5764-5b31-ac27-bf01704e375b
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458558090>
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f57040be-5764-5b31-ac27-bf01704e375b/f57040be-5764-5b31-ac27-bf01704e375b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fea%252Fbcea9544407b890376d74181f12341f1%252Fpa%252FAX34662_bc73d4544f756675a578d60416f700cc.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_bc73d4544f756675a578d60416f700cc.jpg saved to cache
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f57040be-5764-5b31-ac27-bf01704e375b
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561fe4d0>
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f493106e-6d51-5e38-a23f-c7c6f4021320/f493106e-6d51-5e38-a23f-c7c6f4021320_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faa%252Ff4aa5453f5388deed471a213df2f9cb6%252Fpa%252FGC53202_9a0fd66dad10d0cb47bb249f13316e70.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_9a0fd66dad10d0cb47bb249f13316e70.jpg saved to cache
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f493106e-6d51-5e38-a23f-c7c6f4021320
2026-03-28 18:46:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f493106e-6d51-5e38-a23f-c7c6f4021320, skipping ID generation
2026-03-28 18:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f493106e-6d51-5e38-a23f-c7c6f4021320 with scrape type 1
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f493106e-6d51-5e38-a23f-c7c6f4021320 sending to next pipeline
2026-03-28 18:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f493106e-6d51-5e38-a23f-c7c6f4021320, identifier: GC53202
2026-03-28 18:46:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b4990>
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_ef5a321021903364f0ec01c818357504.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_ef5a321021903364f0ec01c818357504.jpg saved to cache
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e82298f8-bcc5-582a-8136-30fec9e4cead
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564a3190>
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f57040be-5764-5b31-ac27-bf01704e375b/f57040be-5764-5b31-ac27-bf01704e375b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fea%252Fbcea9544407b890376d74181f12341f1%252Fpa%252FAX34662_1642262464493260ef2588ec2b620ac5.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_1642262464493260ef2588ec2b620ac5.jpg saved to cache
2026-03-28 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f57040be-5764-5b31-ac27-bf01704e375b
2026-03-28 18:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e97dbadf-cdfb-5357-a7c4-f5aacc0dab40 with identifier: VP32069
2026-03-28 18:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e97dbadf-cdfb-5357-a7c4-f5aacc0dab40 with identifier: VP32069
2026-03-28 18:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e97dbadf-cdfb-5357-a7c4-f5aacc0dab40 with identifier: VP32069 to the API
2026-03-28 18:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_04470faf4d10ddbffb70507f5ca380ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:11:52Z',
 'fuel_type': 'petrol',
 'id': 'e97dbadf-cdfb-5357-a7c4-f5aacc0dab40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP32069',
 'listing': 'auction',
 'location': 'DE, Norderstedt',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 24954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_89be946477c71b38f8eb12756ba699c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578948,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_a30986b4274208887283a8200db1bec4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2617398,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_2f212c303ba96aadb05450ae7ef8fcaa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_a2151046cb78ce471d01e9e733243ab4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_0dca19c1c7aefabdd81e8530d0e6220d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577472,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_bb0b879bd5562278ac4344bea22cf949.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2571513,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_d90a57bc513199b9d0deda57eb787006.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2649970,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_04470faf4d10ddbffb70507f5ca380ae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_8312ff0ba8cfe0b18fab2ffd6164fedc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97dbadf-cdfb-5357-a7c4-f5aacc0dab40/e97dbadf-cdfb-5357-a7c4-f5aacc0dab40_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2705496,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/ff/e0ff331aeb80689d059efd28e9b1d8c6/pa/VP32069_91dc84589573c5baafbb1082b408d823.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Mild-Hybrid Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP32069%27 HTTP/1.1" 200 None
2026-03-28 18:46:45 [auto1.de] INFO: Saving data for VP32069: {'created_time': 1774723605.110484, 'last_price_update_time': 1774723605.110495, 'auction_closing_time': 1774883512.0}
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP32069') HTTP/1.1" 204 0
2026-03-28 18:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f493106e-6d51-5e38-a23f-c7c6f4021320 with identifier: GC53202
2026-03-28 18:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f493106e-6d51-5e38-a23f-c7c6f4021320 with identifier: GC53202
2026-03-28 18:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f493106e-6d51-5e38-a23f-c7c6f4021320 with identifier: GC53202 to the API
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_9a0fd66dad10d0cb47bb249f13316e70.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:52:59Z',
 'fuel_type': 'diesel',
 'id': 'f493106e-6d51-5e38-a23f-c7c6f4021320',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC53202',
 'listing': 'auction',
 'location': 'DE, Kaufbeuren',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 251780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493106e-6d51-5e38-a23f-c7c6f4021320/f493106e-6d51-5e38-a23f-c7c6f4021320_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_9a0fd66dad10d0cb47bb249f13316e70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493106e-6d51-5e38-a23f-c7c6f4021320/f493106e-6d51-5e38-a23f-c7c6f4021320_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_2b168f08d67636f7026675d66e8e13e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493106e-6d51-5e38-a23f-c7c6f4021320/f493106e-6d51-5e38-a23f-c7c6f4021320_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_d22cef3883ab29da1938ec104e708fed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493106e-6d51-5e38-a23f-c7c6f4021320/f493106e-6d51-5e38-a23f-c7c6f4021320_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_c1ed7939023b7e0cee93af3674f76477.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f493106e-6d51-5e38-a23f-c7c6f4021320/f493106e-6d51-5e38-a23f-c7c6f4021320_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/aa/f4aa5453f5388deed471a213df2f9cb6/pa/GC53202_720f790b0c75b15b1a595899cb3dbabd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC53202%27 HTTP/1.1" 200 None
2026-03-28 18:46:45 [auto1.de] INFO: Saving data for GC53202: {'created_time': 1774723605.512404, 'last_price_update_time': 1774723605.512415, 'auction_closing_time': 1774885979.0}
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC53202') HTTP/1.1" 204 0
2026-03-28 18:46:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546de790>
2026-03-28 18:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff6%252Fa3f66e7cd06c21f28e9c1f5245900791%252Fpa%252FZU11253_eba60e1941bd4bc091539df9053f1ebe.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_eba60e1941bd4bc091539df9053f1ebe.jpg saved to cache
2026-03-28 18:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e82298f8-bcc5-582a-8136-30fec9e4cead
2026-03-28 18:46:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e82298f8-bcc5-582a-8136-30fec9e4cead, skipping ID generation
2026-03-28 18:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e82298f8-bcc5-582a-8136-30fec9e4cead with scrape type 1
2026-03-28 18:46:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e82298f8-bcc5-582a-8136-30fec9e4cead sending to next pipeline
2026-03-28 18:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e82298f8-bcc5-582a-8136-30fec9e4cead, identifier: ZU11253
2026-03-28 18:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547126d0>
2026-03-28 18:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f57040be-5764-5b31-ac27-bf01704e375b/f57040be-5764-5b31-ac27-bf01704e375b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fea%252Fbcea9544407b890376d74181f12341f1%252Fpa%252FAX34662_d309eca415b2dff2f376f37d20c89019.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_d309eca415b2dff2f376f37d20c89019.jpg saved to cache
2026-03-28 18:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f57040be-5764-5b31-ac27-bf01704e375b
2026-03-28 18:46:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f57040be-5764-5b31-ac27-bf01704e375b, skipping ID generation
2026-03-28 18:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f57040be-5764-5b31-ac27-bf01704e375b with scrape type 1
2026-03-28 18:46:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f57040be-5764-5b31-ac27-bf01704e375b sending to next pipeline
2026-03-28 18:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f57040be-5764-5b31-ac27-bf01704e375b, identifier: AX34662
2026-03-28 18:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e82298f8-bcc5-582a-8136-30fec9e4cead with identifier: ZU11253
2026-03-28 18:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e82298f8-bcc5-582a-8136-30fec9e4cead with identifier: ZU11253
2026-03-28 18:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e82298f8-bcc5-582a-8136-30fec9e4cead with identifier: ZU11253 to the API
2026-03-28 18:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_eba60e1941bd4bc091539df9053f1ebe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:17:25Z',
 'fuel_type': 'petrol',
 'id': 'e82298f8-bcc5-582a-8136-30fec9e4cead',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU11253',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 65549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353823,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_eba60e1941bd4bc091539df9053f1ebe.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_e076e6b922f4b97acd0983d2b88828e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305362,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_ef5a321021903364f0ec01c818357504.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250857,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_6696c4e8350c8323bad36c171d2872d4.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_bcdd0461a8c5970ca3dab922a4127074.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315931,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_710eb4cb639c128c8575ddebb21ea01e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270356,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_15cb14d30b1943518408e3f050d88ea3.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318208,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_c45bd4dd22154a6d88c634271516bc78.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_1e14bb07a17ea113a2f12a50904fe7d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82298f8-bcc5-582a-8136-30fec9e4cead/e82298f8-bcc5-582a-8136-30fec9e4cead_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246141,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f6/a3f66e7cd06c21f28e9c1f5245900791/pa/ZU11253_9ec7817a02ad449bf70e83c510372fc7.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Team',
 'transmission': 'automatic',
 'trim': 'Team',
 'year': 2011}
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU11253%27 HTTP/1.1" 200 None
2026-03-28 18:46:46 [auto1.de] INFO: Saving data for ZU11253: {'created_time': 1774723606.369209, 'last_price_update_time': 1774723606.369226, 'auction_closing_time': 1774883845.0}
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU11253') HTTP/1.1" 204 0
2026-03-28 18:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f57040be-5764-5b31-ac27-bf01704e375b with identifier: AX34662
2026-03-28 18:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f57040be-5764-5b31-ac27-bf01704e375b with identifier: AX34662
2026-03-28 18:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f57040be-5764-5b31-ac27-bf01704e375b with identifier: AX34662 to the API
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_d309eca415b2dff2f376f37d20c89019.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:59:58Z',
 'fuel_type': 'petrol',
 'id': 'f57040be-5764-5b31-ac27-bf01704e375b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX34662',
 'listing': 'auction',
 'location': 'DE, Kamen',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 172583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57040be-5764-5b31-ac27-bf01704e375b/f57040be-5764-5b31-ac27-bf01704e375b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_d309eca415b2dff2f376f37d20c89019.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57040be-5764-5b31-ac27-bf01704e375b/f57040be-5764-5b31-ac27-bf01704e375b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_efb273ebc46dd05e51761670008c252f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57040be-5764-5b31-ac27-bf01704e375b/f57040be-5764-5b31-ac27-bf01704e375b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_bc73d4544f756675a578d60416f700cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57040be-5764-5b31-ac27-bf01704e375b/f57040be-5764-5b31-ac27-bf01704e375b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_1642262464493260ef2588ec2b620ac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57040be-5764-5b31-ac27-bf01704e375b/f57040be-5764-5b31-ac27-bf01704e375b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/ea/bcea9544407b890376d74181f12341f1/pa/AX34662_e625460ceb2aba572602526ae71552c1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Avensis 2.0 Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2004}
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34662%27 HTTP/1.1" 200 None
2026-03-28 18:46:46 [auto1.de] INFO: Saving data for AX34662: {'created_time': 1774723606.748095, 'last_price_update_time': 1774723606.748106, 'auction_closing_time': 1774886398.0}
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX34662') HTTP/1.1" 204 0
2026-03-28 18:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_d60a7e43654c19c1bbfe270046f42e49.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_701c400134403e26c6a927fd0f9bfae5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_49d2d3b557fa52313d23e74b0738631e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_ec1e7937235fcd075ef57a6cb6bccea9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546def90>
2026-03-28 18:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fdf%252F82df7ad621c7d5f07dca22defcf227a6%252Fpa%252FST78231_d60a7e43654c19c1bbfe270046f42e49.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_d60a7e43654c19c1bbfe270046f42e49.jpg saved to cache
2026-03-28 18:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43660542-0239-5791-b2d9-5bb568d20e7a
2026-03-28 18:46:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43660542-0239-5791-b2d9-5bb568d20e7a, skipping ID generation
2026-03-28 18:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43660542-0239-5791-b2d9-5bb568d20e7a with scrape type 1
2026-03-28 18:46:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43660542-0239-5791-b2d9-5bb568d20e7a sending to next pipeline
2026-03-28 18:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43660542-0239-5791-b2d9-5bb568d20e7a, identifier: ST78231
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456410250>
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_701c400134403e26c6a927fd0f9bfae5.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_701c400134403e26c6a927fd0f9bfae5.jpg saved to cache
2026-03-28 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6de7bc2-85b4-510d-af96-a22b58b32fc9
2026-03-28 18:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43660542-0239-5791-b2d9-5bb568d20e7a with identifier: ST78231
2026-03-28 18:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43660542-0239-5791-b2d9-5bb568d20e7a with identifier: ST78231
2026-03-28 18:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43660542-0239-5791-b2d9-5bb568d20e7a with identifier: ST78231 to the API
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_d60a7e43654c19c1bbfe270046f42e49.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:50:31Z',
 'fuel_type': 'petrol',
 'id': '43660542-0239-5791-b2d9-5bb568d20e7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST78231',
 'listing': 'auction',
 'location': 'DE, Aachen',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 68760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_d60a7e43654c19c1bbfe270046f42e49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_b45308105425bf4ff2a62835ca52f8c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_71fb0c972d1d803d719b627bcecea20d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_57b2b7d146d03500de4eea21a9f99abb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_a2c87b8cd668d8eb53508a0da0097bf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_b7e876cbfbfccf9480cea9d05dc2b7b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_7ff463214ed17ab7bb22077f1a56fbd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_3401882e61634a456710f9882bab440d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_8f90f84cfd45720196653c1a84954e84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43660542-0239-5791-b2d9-5bb568d20e7a/43660542-0239-5791-b2d9-5bb568d20e7a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/df/82df7ad621c7d5f07dca22defcf227a6/pa/ST78231_d271dfba01355c0f2e029c2d825c1f4e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78231%27 HTTP/1.1" 200 None
2026-03-28 18:46:47 [auto1.de] INFO: Saving data for ST78231: {'created_time': 1774723607.37564, 'last_price_update_time': 1774723607.375654, 'auction_closing_time': 1774885831.0}
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST78231') HTTP/1.1" 204 0
2026-03-28 18:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_9462edadb270826742c04ddbaea046db.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_11a19f3023721660a56661782e3edb08.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477e790>
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_49d2d3b557fa52313d23e74b0738631e.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_49d2d3b557fa52313d23e74b0738631e.jpg saved to cache
2026-03-28 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6de7bc2-85b4-510d-af96-a22b58b32fc9
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454710c50>
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2455164e-0840-5ce2-b240-bc935f5ba72b/2455164e-0840-5ce2-b240-bc935f5ba72b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2c%252F0f2cf83c8f7c52bd64f3d72c6ed9e65b%252Fpa%252FDL01383_ec1e7937235fcd075ef57a6cb6bccea9.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_ec1e7937235fcd075ef57a6cb6bccea9.jpg saved to cache
2026-03-28 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2455164e-0840-5ce2-b240-bc935f5ba72b
2026-03-28 18:46:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_90fea55ffb7230abafbe12522ffc6a3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_76de0c589d84510e1e072aff9a819d62.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_a88e94022be5e55d0464e8b8989706fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_4ed19b61835ec1d3cf1065d172a19f14.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456148b50>
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2455164e-0840-5ce2-b240-bc935f5ba72b/2455164e-0840-5ce2-b240-bc935f5ba72b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F2c%252F0f2cf83c8f7c52bd64f3d72c6ed9e65b%252Fpa%252FDL01383_9462edadb270826742c04ddbaea046db.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_9462edadb270826742c04ddbaea046db.jpg saved to cache
2026-03-28 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2455164e-0840-5ce2-b240-bc935f5ba72b
2026-03-28 18:46:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2455164e-0840-5ce2-b240-bc935f5ba72b, skipping ID generation
2026-03-28 18:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2455164e-0840-5ce2-b240-bc935f5ba72b with scrape type 1
2026-03-28 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2455164e-0840-5ce2-b240-bc935f5ba72b sending to next pipeline
2026-03-28 18:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2455164e-0840-5ce2-b240-bc935f5ba72b, identifier: DL01383
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456070d10>
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_11a19f3023721660a56661782e3edb08.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_11a19f3023721660a56661782e3edb08.jpg saved to cache
2026-03-28 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69e8735f-10e7-50ca-afdd-1830a5164945
2026-03-28 18:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2455164e-0840-5ce2-b240-bc935f5ba72b with identifier: DL01383
2026-03-28 18:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2455164e-0840-5ce2-b240-bc935f5ba72b with identifier: DL01383
2026-03-28 18:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2455164e-0840-5ce2-b240-bc935f5ba72b with identifier: DL01383 to the API
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_9462edadb270826742c04ddbaea046db.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:46:10Z',
 'fuel_type': 'petrol',
 'id': '2455164e-0840-5ce2-b240-bc935f5ba72b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL01383',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 186264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2455164e-0840-5ce2-b240-bc935f5ba72b/2455164e-0840-5ce2-b240-bc935f5ba72b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_9462edadb270826742c04ddbaea046db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2455164e-0840-5ce2-b240-bc935f5ba72b/2455164e-0840-5ce2-b240-bc935f5ba72b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_ec1e7937235fcd075ef57a6cb6bccea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2455164e-0840-5ce2-b240-bc935f5ba72b/2455164e-0840-5ce2-b240-bc935f5ba72b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_b39f3530b9a0f92174907be0db30a752.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2455164e-0840-5ce2-b240-bc935f5ba72b/2455164e-0840-5ce2-b240-bc935f5ba72b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_25c16e8fb962b4abdfce9dbe2814e595.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2455164e-0840-5ce2-b240-bc935f5ba72b/2455164e-0840-5ce2-b240-bc935f5ba72b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/2c/0f2cf83c8f7c52bd64f3d72c6ed9e65b/pa/DL01383_2238c9922fac1ddced4932a68b60d382.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2010}
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL01383%27 HTTP/1.1" 200 None
2026-03-28 18:46:48 [auto1.de] INFO: Saving data for DL01383: {'created_time': 1774723608.062685, 'last_price_update_time': 1774723608.062698, 'auction_closing_time': 1774885570.0}
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL01383') HTTP/1.1" 204 0
2026-03-28 18:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_c298be218fb9cd0849154896d5a4d22d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_905b82bd39cf298c52b8c370a41688e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_6c02703cdb23decb9d594df68e0780ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564934d0>
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_90fea55ffb7230abafbe12522ffc6a3d.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_90fea55ffb7230abafbe12522ffc6a3d.jpg saved to cache
2026-03-28 18:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6de7bc2-85b4-510d-af96-a22b58b32fc9
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564104d0>
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_76de0c589d84510e1e072aff9a819d62.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_76de0c589d84510e1e072aff9a819d62.jpg saved to cache
2026-03-28 18:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6de7bc2-85b4-510d-af96-a22b58b32fc9
2026-03-28 18:46:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456095a90>
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F40%252Fe040e66d3f8da321ef8e5199e60feeb9%252Fpa%252FXU87047_a88e94022be5e55d0464e8b8989706fa.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_a88e94022be5e55d0464e8b8989706fa.jpg saved to cache
2026-03-28 18:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012
2026-03-28 18:46:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 232f933d-bcce-5bd0-bdd5-1f0c6f66a012, skipping ID generation
2026-03-28 18:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012 with scrape type 1
2026-03-28 18:46:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012 sending to next pipeline
2026-03-28 18:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 232f933d-bcce-5bd0-bdd5-1f0c6f66a012, identifier: XU87047
2026-03-28 18:46:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561cde10>
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_4ed19b61835ec1d3cf1065d172a19f14.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_4ed19b61835ec1d3cf1065d172a19f14.jpg saved to cache
2026-03-28 18:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69e8735f-10e7-50ca-afdd-1830a5164945
2026-03-28 18:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 232f933d-bcce-5bd0-bdd5-1f0c6f66a012 with identifier: XU87047
2026-03-28 18:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 232f933d-bcce-5bd0-bdd5-1f0c6f66a012 with identifier: XU87047
2026-03-28 18:46:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 232f933d-bcce-5bd0-bdd5-1f0c6f66a012 with identifier: XU87047 to the API
2026-03-28 18:46:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_a88e94022be5e55d0464e8b8989706fa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:34:07Z',
 'fuel_type': 'petrol',
 'id': '232f933d-bcce-5bd0-bdd5-1f0c6f66a012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU87047',
 'listing': 'auction',
 'location': 'DE, Hamburg-Billstedt',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 152626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2770144,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_a88e94022be5e55d0464e8b8989706fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_1baf9636914c06e6b46bd51ebc5f8a62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_b2be88fc7fa72f3a37197a9893c3f7db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2484199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_b039570f922bbe059df1c6fbeab5b6d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_745889b98178a5a17263b02cf00544b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2471736,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_c5d94637361062dc7002d8f1b3a2d064.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_7a8d226ebb8659ae9eb9ce5004517167.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2642418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_2391ecd4bf9ca4c5916abb9c532f343c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_d6c70240313216a8208136587ebc2b3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232f933d-bcce-5bd0-bdd5-1f0c6f66a012/232f933d-bcce-5bd0-bdd5-1f0c6f66a012_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2496052,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/40/e040e66d3f8da321ef8e5199e60feeb9/pa/XU87047_9761bd1de61de76881deab4fa55f73ff.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 400 CGI 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic Avantgarde',
 'year': 2013}
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU87047%27 HTTP/1.1" 200 None
2026-03-28 18:46:49 [auto1.de] INFO: Saving data for XU87047: {'created_time': 1774723609.253384, 'last_price_update_time': 1774723609.253395, 'auction_closing_time': 1774884847.0}
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU87047') HTTP/1.1" 204 0
2026-03-28 18:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_ced839f66e8ded585a64c6318d891212.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZA94641/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT55955> (referer: https://www.auto1.com/v1/car-details-view/BT55955/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF84100> (referer: https://www.auto1.com/v1/car-details-view/RF84100/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK17224/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE09172/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245636ead0>
2026-03-28 18:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48827fb7-37ff-5368-b412-b99f8a5b3774/48827fb7-37ff-5368-b412-b99f8a5b3774_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F6d%252Fdf6d810b6b2d3664ec0d1089cfcef4de%252Fpa%252FGZ70356_c298be218fb9cd0849154896d5a4d22d.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_c298be218fb9cd0849154896d5a4d22d.jpg saved to cache
2026-03-28 18:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48827fb7-37ff-5368-b412-b99f8a5b3774
2026-03-28 18:46:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48827fb7-37ff-5368-b412-b99f8a5b3774, skipping ID generation
2026-03-28 18:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48827fb7-37ff-5368-b412-b99f8a5b3774 with scrape type 1
2026-03-28 18:46:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48827fb7-37ff-5368-b412-b99f8a5b3774 sending to next pipeline
2026-03-28 18:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48827fb7-37ff-5368-b412-b99f8a5b3774, identifier: GZ70356
2026-03-28 18:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546f7dd0>
2026-03-28 18:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fa5%252F70a5ea2374c57caa081bbc7f9207f8b8%252Fpa%252FJD07645_905b82bd39cf298c52b8c370a41688e0.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_905b82bd39cf298c52b8c370a41688e0.jpg saved to cache
2026-03-28 18:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6de7bc2-85b4-510d-af96-a22b58b32fc9
2026-03-28 18:46:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6de7bc2-85b4-510d-af96-a22b58b32fc9, skipping ID generation
2026-03-28 18:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6de7bc2-85b4-510d-af96-a22b58b32fc9 with scrape type 1
2026-03-28 18:46:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6de7bc2-85b4-510d-af96-a22b58b32fc9 sending to next pipeline
2026-03-28 18:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6de7bc2-85b4-510d-af96-a22b58b32fc9, identifier: JD07645
2026-03-28 18:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245620cb50>
2026-03-28 18:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_543adbdb-a892-5452-8308-8c50f14bfe76/543adbdb-a892-5452-8308-8c50f14bfe76_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fed%252F88ed499a6ac533abd609caa99c22183c%252Fpa%252FRX82336_6c02703cdb23decb9d594df68e0780ed.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_6c02703cdb23decb9d594df68e0780ed.jpg saved to cache
2026-03-28 18:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 543adbdb-a892-5452-8308-8c50f14bfe76
2026-03-28 18:46:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 543adbdb-a892-5452-8308-8c50f14bfe76, skipping ID generation
2026-03-28 18:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 543adbdb-a892-5452-8308-8c50f14bfe76 with scrape type 1
2026-03-28 18:46:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 543adbdb-a892-5452-8308-8c50f14bfe76 sending to next pipeline
2026-03-28 18:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 543adbdb-a892-5452-8308-8c50f14bfe76, identifier: RX82336
2026-03-28 18:46:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48827fb7-37ff-5368-b412-b99f8a5b3774 with identifier: GZ70356
2026-03-28 18:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48827fb7-37ff-5368-b412-b99f8a5b3774 with identifier: GZ70356
2026-03-28 18:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48827fb7-37ff-5368-b412-b99f8a5b3774 with identifier: GZ70356 to the API
2026-03-28 18:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_c298be218fb9cd0849154896d5a4d22d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:08:48Z',
 'fuel_type': 'diesel',
 'id': '48827fb7-37ff-5368-b412-b99f8a5b3774',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ70356',
 'listing': 'auction',
 'location': 'DE, Kumhausen',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 225154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48827fb7-37ff-5368-b412-b99f8a5b3774/48827fb7-37ff-5368-b412-b99f8a5b3774_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_e987588b92647a3c7416eaaf4c5e71ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48827fb7-37ff-5368-b412-b99f8a5b3774/48827fb7-37ff-5368-b412-b99f8a5b3774_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_a35a5e56672be19f712decd7bfc820d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48827fb7-37ff-5368-b412-b99f8a5b3774/48827fb7-37ff-5368-b412-b99f8a5b3774_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_356d209b97fc4a63dbf35ec3e22a864c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48827fb7-37ff-5368-b412-b99f8a5b3774/48827fb7-37ff-5368-b412-b99f8a5b3774_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_d80afa0c7c0b4fd969768656fdadcd2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48827fb7-37ff-5368-b412-b99f8a5b3774/48827fb7-37ff-5368-b412-b99f8a5b3774_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_c298be218fb9cd0849154896d5a4d22d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48827fb7-37ff-5368-b412-b99f8a5b3774/48827fb7-37ff-5368-b412-b99f8a5b3774_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/6d/df6d810b6b2d3664ec0d1089cfcef4de/pa/GZ70356_89361981a73dc712e6890085328e3551.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Spirit",
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2013}
2026-03-28 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ70356%27 HTTP/1.1" 200 None
2026-03-28 18:46:50 [auto1.de] INFO: Saving data for GZ70356: {'created_time': 1774723610.695857, 'last_price_update_time': 1774723610.69587, 'auction_closing_time': 1774883328.0}
2026-03-28 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ70356') HTTP/1.1" 204 0
2026-03-28 18:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6de7bc2-85b4-510d-af96-a22b58b32fc9 with identifier: JD07645
2026-03-28 18:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6de7bc2-85b4-510d-af96-a22b58b32fc9 with identifier: JD07645
2026-03-28 18:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6de7bc2-85b4-510d-af96-a22b58b32fc9 with identifier: JD07645 to the API
2026-03-28 18:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_905b82bd39cf298c52b8c370a41688e0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:54:39Z',
 'fuel_type': 'diesel',
 'id': 'c6de7bc2-85b4-510d-af96-a22b58b32fc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD07645',
 'listing': 'auction',
 'location': 'DE, Göppingen',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 179453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2852136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_1d39efe7aa6bd3e53c75e9de505ade10.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_eba6b9e6407d23bc60afb7275e2a1b0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_905b82bd39cf298c52b8c370a41688e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_76de0c589d84510e1e072aff9a819d62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_9012500fa5ded61a779dafc4c7914760.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_b5de2f908e954ff49638c9b464b9baf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_ccc0880af6a359479c52c433870dad1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_90fea55ffb7230abafbe12522ffc6a3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_49d2d3b557fa52313d23e74b0738631e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de7bc2-85b4-510d-af96-a22b58b32fc9/c6de7bc2-85b4-510d-af96-a22b58b32fc9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/a5/70a5ea2374c57caa081bbc7f9207f8b8/pa/JD07645_701c400134403e26c6a927fd0f9bfae5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD07645%27 HTTP/1.1" 200 None
2026-03-28 18:46:51 [auto1.de] INFO: Saving data for JD07645: {'created_time': 1774723611.075057, 'last_price_update_time': 1774723611.075069, 'auction_closing_time': 1774886079.0}
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD07645') HTTP/1.1" 204 0
2026-03-28 18:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 543adbdb-a892-5452-8308-8c50f14bfe76 with identifier: RX82336
2026-03-28 18:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 543adbdb-a892-5452-8308-8c50f14bfe76 with identifier: RX82336
2026-03-28 18:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 543adbdb-a892-5452-8308-8c50f14bfe76 with identifier: RX82336 to the API
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_6c02703cdb23decb9d594df68e0780ed.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:41:01Z',
 'fuel_type': 'petrol',
 'id': '543adbdb-a892-5452-8308-8c50f14bfe76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX82336',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 228162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_543adbdb-a892-5452-8308-8c50f14bfe76/543adbdb-a892-5452-8308-8c50f14bfe76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_4b431d0bc931e247b26ffde3bddc5491.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_543adbdb-a892-5452-8308-8c50f14bfe76/543adbdb-a892-5452-8308-8c50f14bfe76_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_24e6a4d0fba8168ccc9b240d753e3918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_543adbdb-a892-5452-8308-8c50f14bfe76/543adbdb-a892-5452-8308-8c50f14bfe76_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_e8560d13c75da55fcfe6736077fa9459.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_543adbdb-a892-5452-8308-8c50f14bfe76/543adbdb-a892-5452-8308-8c50f14bfe76_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_e834d285df9274eb950116669320826b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_543adbdb-a892-5452-8308-8c50f14bfe76/543adbdb-a892-5452-8308-8c50f14bfe76_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/ed/88ed499a6ac533abd609caa99c22183c/pa/RX82336_6c02703cdb23decb9d594df68e0780ed.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX82336%27 HTTP/1.1" 200 None
2026-03-28 18:46:51 [auto1.de] INFO: Saving data for RX82336: {'created_time': 1774723611.446621, 'last_price_update_time': 1774723611.446631, 'auction_closing_time': 1774885261.0}
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX82336') HTTP/1.1" 204 0
2026-03-28 18:46:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563f4c90>
2026-03-28 18:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd0%252Fd8d06a0f3b6cd5e9ed0e71f2ef6a1de9%252Fpa%252FWJ96014_ced839f66e8ded585a64c6318d891212.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_ced839f66e8ded585a64c6318d891212.jpg saved to cache
2026-03-28 18:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69e8735f-10e7-50ca-afdd-1830a5164945
2026-03-28 18:46:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69e8735f-10e7-50ca-afdd-1830a5164945, skipping ID generation
2026-03-28 18:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69e8735f-10e7-50ca-afdd-1830a5164945 with scrape type 1
2026-03-28 18:46:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69e8735f-10e7-50ca-afdd-1830a5164945 sending to next pipeline
2026-03-28 18:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69e8735f-10e7-50ca-afdd-1830a5164945, identifier: WJ96014
2026-03-28 18:46:51 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 6017 | hits on page: 40
2026-03-28 18:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9b961ea-ec5b-556d-8337-e84209cb427a with identifier: BT55955
2026-03-28 18:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9b961ea-ec5b-556d-8337-e84209cb427a with scrape type 1
2026-03-28 18:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9b961ea-ec5b-556d-8337-e84209cb427a
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_3fd7944c03b159844496cbe1d2c8243d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_3fd7944c03b159844496cbe1d2c8243d.jpg not downloaded yet
2026-03-28 18:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a6a20bb-8e47-55b5-a771-f23ea3483ecc with identifier: RF84100
2026-03-28 18:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a6a20bb-8e47-55b5-a771-f23ea3483ecc with scrape type 1
2026-03-28 18:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8a6a20bb-8e47-55b5-a771-f23ea3483ecc
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F48%252F534890bfc229e0d871957556897e13d3%252Fpa%252FRF84100_d51c1e17882b5836e627083bc7dc8631.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_d51c1e17882b5836e627083bc7dc8631.jpg not downloaded yet
2026-03-28 18:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69e8735f-10e7-50ca-afdd-1830a5164945 with identifier: WJ96014
2026-03-28 18:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69e8735f-10e7-50ca-afdd-1830a5164945 with identifier: WJ96014
2026-03-28 18:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69e8735f-10e7-50ca-afdd-1830a5164945 with identifier: WJ96014 to the API
2026-03-28 18:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_ced839f66e8ded585a64c6318d891212.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '4.2L',
 'engine_horse_power': 298,
 'expiration_date': '2026-03-30T15:52:14Z',
 'fuel_type': 'petrol',
 'id': '69e8735f-10e7-50ca-afdd-1830a5164945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ96014',
 'listing': 'auction',
 'location': 'DE, Norderstedt',
 'make': 'Jaguar',
 'model': 'XJ',
 'odometer': 235776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_11a19f3023721660a56661782e3edb08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2869622,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_ced839f66e8ded585a64c6318d891212.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2991387,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_4ed19b61835ec1d3cf1065d172a19f14.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_127190633b6a6f52f15ca10433a5c1be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_dd12fe2e333277491ac94493e31cd7ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_ce3f51f1a6d4f8951033f174a49ec9f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_35d1ab072d0acbcb9dbe33156aebba7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2505109,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_34ec1aace2918594ebf5d06017a80438.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_41bb0db7a9c023bce1bbc385fa068ff1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e8735f-10e7-50ca-afdd-1830a5164945/69e8735f-10e7-50ca-afdd-1830a5164945_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3028604,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d0/d8d06a0f3b6cd5e9ed0e71f2ef6a1de9/pa/WJ96014_101d08ee2ec9213e0cf79f5011e6e6fb.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XJ 4.2 V8 XJ8',
 'transmission': 'automatic',
 'trim': '8',
 'year': 2004}
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ96014%27 HTTP/1.1" 200 None
2026-03-28 18:46:52 [auto1.de] INFO: Saving data for WJ96014: {'created_time': 1774723612.801056, 'last_price_update_time': 1774723612.801067, 'auction_closing_time': 1774885934.0}
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ96014') HTTP/1.1" 204 0
2026-03-28 18:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_c1cd8b57be336c252dc15c015c21e16d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:52 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-28 18:46:52 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-28 18:46:52 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS10948%27 HTTP/1.1" 200 None
2026-03-28 18:46:52 [auto1.de] INFO: Scrape type for PS10948: 0
2026-03-28 18:46:52 [auto1.de] INFO: Found listing with ID: HF23324
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF23324%27 HTTP/1.1" 200 None
2026-03-28 18:46:52 [auto1.de] INFO: Scrape type for HF23324: 1
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_7af7f4f4e66c3456ee9efa1c5e95dbb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_7af7f4f4e66c3456ee9efa1c5e95dbb7.jpg not downloaded yet
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F48%252F534890bfc229e0d871957556897e13d3%252Fpa%252FRF84100_275fe19e5ec85688ad62ce22177312bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_275fe19e5ec85688ad62ce22177312bb.jpg not downloaded yet
2026-03-28 18:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_9b201b216b36c75b6637c6ef9f3e2a38.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_a7b811a2e6bfa704a9da1c8e97f3667c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:52 [auto1.de] INFO: Found listing with ID: XA19312
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA19312%27 HTTP/1.1" 200 None
2026-03-28 18:46:52 [auto1.de] INFO: Scrape type for XA19312: 2
2026-03-28 18:46:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with identifier: XA19312
2026-03-28 18:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with scrape type 2
2026-03-28 18:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with scrape type 2
2026-03-28 18:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5, identifier: XA19312
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_7c003347a100cf7bedf0b8448d291de3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_7c003347a100cf7bedf0b8448d291de3.jpg not downloaded yet
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F48%252F534890bfc229e0d871957556897e13d3%252Fpa%252FRF84100_deb867edbbde3a463bd9c9e627ce5fc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_deb867edbbde3a463bd9c9e627ce5fc1.jpg not downloaded yet
2026-03-28 18:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with identifier: XA19312
2026-03-28 18:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with identifier: XA19312
2026-03-28 18:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with identifier: XA19312 to the API
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:07:54Z',
 'fuel_type': 'petrol',
 'id': '2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA19312',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 89333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2018}
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA19312%27 HTTP/1.1" 200 None
2026-03-28 18:46:53 [auto1.de] INFO: Saving data for XA19312: {'auction_closing_time': 1774883274.0, 'created_time': 1774521577.153559, 'last_price_update_time': 1774723613.385181}
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA19312') HTTP/1.1" 204 0
2026-03-28 18:46:53 [auto1.de] INFO: Found listing with ID: UP26126
2026-03-28 18:46:53 [auto1.de] INFO: Found listing with ID: GP53136
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP53136%27 HTTP/1.1" 200 None
2026-03-28 18:46:53 [auto1.de] INFO: Scrape type for GP53136: 2
2026-03-28 18:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06cbf1e7-271c-59ea-b058-3b805f92c2d4 with identifier: GP53136
2026-03-28 18:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06cbf1e7-271c-59ea-b058-3b805f92c2d4 with scrape type 2
2026-03-28 18:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06cbf1e7-271c-59ea-b058-3b805f92c2d4 with scrape type 2
2026-03-28 18:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06cbf1e7-271c-59ea-b058-3b805f92c2d4, identifier: GP53136
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_d8e5d866ec58c7831ac249993b19a9e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_d8e5d866ec58c7831ac249993b19a9e5.jpg not downloaded yet
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F48%252F534890bfc229e0d871957556897e13d3%252Fpa%252FRF84100_206ae337608a7dce0f193eb0d121531c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_206ae337608a7dce0f193eb0d121531c.jpg not downloaded yet
2026-03-28 18:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06cbf1e7-271c-59ea-b058-3b805f92c2d4 with identifier: GP53136
2026-03-28 18:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06cbf1e7-271c-59ea-b058-3b805f92c2d4 with identifier: GP53136
2026-03-28 18:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06cbf1e7-271c-59ea-b058-3b805f92c2d4 with identifier: GP53136 to the API
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:25:23Z',
 'fuel_type': 'diesel',
 'id': '06cbf1e7-271c-59ea-b058-3b805f92c2d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP53136',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 132164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 SD V6 Autobiography Dynamic',
 'transmission': 'automatic',
 'trim': 'Autobiography Dynamic',
 'year': 2019}
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP53136%27 HTTP/1.1" 200 None
2026-03-28 18:46:53 [auto1.de] INFO: Saving data for GP53136: {'auction_closing_time': 1774884323.0, 'created_time': 1774552812.345501, 'last_price_update_time': 1774723613.879877}
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP53136') HTTP/1.1" 204 0
2026-03-28 18:46:53 [auto1.de] INFO: Found listing with ID: TV59519
2026-03-28 18:46:53 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL14326%27 HTTP/1.1" 200 None
2026-03-28 18:46:53 [auto1.de] INFO: Scrape type for XL14326: 2
2026-03-28 18:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9985bff2-c58c-50fc-9d36-e01348f844a9 with identifier: XL14326
2026-03-28 18:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9985bff2-c58c-50fc-9d36-e01348f844a9 with scrape type 2
2026-03-28 18:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9985bff2-c58c-50fc-9d36-e01348f844a9 with scrape type 2
2026-03-28 18:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9985bff2-c58c-50fc-9d36-e01348f844a9, identifier: XL14326
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_8e1673553d909ce0c9821495569ea96c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_8e1673553d909ce0c9821495569ea96c.jpg not downloaded yet
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F48%252F534890bfc229e0d871957556897e13d3%252Fpa%252FRF84100_ba1efa99000d696229bbc5cdde90d59c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_ba1efa99000d696229bbc5cdde90d59c.jpg not downloaded yet
2026-03-28 18:46:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245603ead0>
2026-03-28 18:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5f%252F345ff8b856f8811d6012fb291126f6d2%252Fpa%252FTG23617_c1cd8b57be336c252dc15c015c21e16d.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_c1cd8b57be336c252dc15c015c21e16d.jpg saved to cache
2026-03-28 18:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b36272d4-f016-51b1-bda0-5f905d11b176
2026-03-28 18:46:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b36272d4-f016-51b1-bda0-5f905d11b176, skipping ID generation
2026-03-28 18:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b36272d4-f016-51b1-bda0-5f905d11b176 with scrape type 1
2026-03-28 18:46:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b36272d4-f016-51b1-bda0-5f905d11b176 sending to next pipeline
2026-03-28 18:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b36272d4-f016-51b1-bda0-5f905d11b176, identifier: TG23617
2026-03-28 18:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475fd90>
2026-03-28 18:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_9b201b216b36c75b6637c6ef9f3e2a38.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_9b201b216b36c75b6637c6ef9f3e2a38.jpg saved to cache
2026-03-28 18:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512
2026-03-28 18:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456518090>
2026-03-28 18:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_a7b811a2e6bfa704a9da1c8e97f3667c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_a7b811a2e6bfa704a9da1c8e97f3667c.jpg saved to cache
2026-03-28 18:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512
2026-03-28 18:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9985bff2-c58c-50fc-9d36-e01348f844a9 with identifier: XL14326
2026-03-28 18:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9985bff2-c58c-50fc-9d36-e01348f844a9 with identifier: XL14326
2026-03-28 18:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9985bff2-c58c-50fc-9d36-e01348f844a9 with identifier: XL14326 to the API
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:31:51Z',
 'fuel_type': 'petrol',
 'id': '9985bff2-c58c-50fc-9d36-e01348f844a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL14326',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 55937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL14326%27 HTTP/1.1" 200 None
2026-03-28 18:46:54 [auto1.de] INFO: Saving data for XL14326: {'auction_closing_time': 1774884711.0, 'created_time': 1774553250.015074, 'last_price_update_time': 1774723614.6816}
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL14326') HTTP/1.1" 204 0
2026-03-28 18:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b36272d4-f016-51b1-bda0-5f905d11b176 with identifier: TG23617
2026-03-28 18:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b36272d4-f016-51b1-bda0-5f905d11b176 with identifier: TG23617
2026-03-28 18:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b36272d4-f016-51b1-bda0-5f905d11b176 with identifier: TG23617 to the API
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_c1cd8b57be336c252dc15c015c21e16d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:39:24Z',
 'fuel_type': 'diesel',
 'id': 'b36272d4-f016-51b1-bda0-5f905d11b176',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG23617',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 103298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3343993,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_c1cd8b57be336c252dc15c015c21e16d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_d897e913c7c03cbfb6760b3877a7daad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_3bb183dfb424ba63fc2fd67852ba4ca8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3472320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_46e336b35dc27004a8ef11e491c31283.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_2d456bd0064e2f07a93bbaa05cb8f9b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_9586fba3c536ed00e3ea28459c01551d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_8564c4f5e09c9ff270361f741eb4edde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3288498,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_cf627fc79a1ec3da8f814b4e41b58366.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_5e673bbc07d57faa4248d8b354af7aa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36272d4-f016-51b1-bda0-5f905d11b176/b36272d4-f016-51b1-bda0-5f905d11b176_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3257730,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5f/345ff8b856f8811d6012fb291126f6d2/pa/TG23617_2653e17dc23416072c6e1ed86711d55f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 308 2.0 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2009}
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG23617%27 HTTP/1.1" 200 None
2026-03-28 18:46:55 [auto1.de] INFO: Saving data for TG23617: {'created_time': 1774723615.053496, 'last_price_update_time': 1774723615.053506, 'auction_closing_time': 1774885164.0}
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG23617') HTTP/1.1" 204 0
2026-03-28 18:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_7af7f4f4e66c3456ee9efa1c5e95dbb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_275fe19e5ec85688ad62ce22177312bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:55 [auto1.de] INFO: Found listing with ID: AC34212
2026-03-28 18:46:55 [auto1.de] INFO: Found listing with ID: EW67018
2026-03-28 18:46:55 [auto1.de] INFO: Found listing with ID: KN87388
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN87388%27 HTTP/1.1" 200 None
2026-03-28 18:46:55 [auto1.de] INFO: Scrape type for KN87388: 2
2026-03-28 18:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a99b3d-b564-5f90-9910-4aeadf2f1978 with identifier: KN87388
2026-03-28 18:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a99b3d-b564-5f90-9910-4aeadf2f1978 with scrape type 2
2026-03-28 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7a99b3d-b564-5f90-9910-4aeadf2f1978 with scrape type 2
2026-03-28 18:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7a99b3d-b564-5f90-9910-4aeadf2f1978, identifier: KN87388
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_8f3cc75b1369f5c916c062f657f36dc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_8f3cc75b1369f5c916c062f657f36dc1.jpg not downloaded yet
2026-03-28 18:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW30345> (referer: https://www.auto1.com/v1/car-details-view/WW30345/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ98006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7a99b3d-b564-5f90-9910-4aeadf2f1978 with identifier: KN87388
2026-03-28 18:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7a99b3d-b564-5f90-9910-4aeadf2f1978 with identifier: KN87388
2026-03-28 18:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7a99b3d-b564-5f90-9910-4aeadf2f1978 with identifier: KN87388 to the API
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-30T15:10:57Z',
 'fuel_type': 'petrol',
 'id': 'b7a99b3d-b564-5f90-9910-4aeadf2f1978',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN87388',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 37240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-15',
 'seller_name': None,
 'title': 'Renault Megane 1.8 TCe R.S.',
 'transmission': 'automatic',
 'trim': 'R.S.',
 'year': 2020}
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN87388%27 HTTP/1.1" 200 None
2026-03-28 18:46:55 [auto1.de] INFO: Saving data for KN87388: {'auction_closing_time': 1774883457.0, 'created_time': 1774553010.64153, 'last_price_update_time': 1774723615.529543}
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN87388') HTTP/1.1" 204 0
2026-03-28 18:46:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:55 [auto1.de] INFO: Found listing with ID: MB20164
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB20164%27 HTTP/1.1" 200 None
2026-03-28 18:46:55 [auto1.de] INFO: Scrape type for MB20164: 1
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_29b7ee36be602073f8200d4b0112ffa5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_29b7ee36be602073f8200d4b0112ffa5.jpg not downloaded yet
2026-03-28 18:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL40501/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP30052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF58596/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547509d0>
2026-03-28 18:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_7af7f4f4e66c3456ee9efa1c5e95dbb7.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_7af7f4f4e66c3456ee9efa1c5e95dbb7.jpg saved to cache
2026-03-28 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9b961ea-ec5b-556d-8337-e84209cb427a
2026-03-28 18:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245479ead0>
2026-03-28 18:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6a20bb-8e47-55b5-a771-f23ea3483ecc/8a6a20bb-8e47-55b5-a771-f23ea3483ecc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F48%252F534890bfc229e0d871957556897e13d3%252Fpa%252FRF84100_275fe19e5ec85688ad62ce22177312bb.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_275fe19e5ec85688ad62ce22177312bb.jpg saved to cache
2026-03-28 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a6a20bb-8e47-55b5-a771-f23ea3483ecc
2026-03-28 18:46:55 [auto1.de] INFO: Found listing with ID: HL64703
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL64703%27 HTTP/1.1" 200 None
2026-03-28 18:46:55 [auto1.de] INFO: Scrape type for HL64703: 1
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_72d6d36845b582429ae3eb0c4018a32b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_72d6d36845b582429ae3eb0c4018a32b.jpg not downloaded yet
2026-03-28 18:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_206ae337608a7dce0f193eb0d121531c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8013093d-1580-5701-b07f-5bcbda13b8c9 with identifier: WW30345
2026-03-28 18:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8013093d-1580-5701-b07f-5bcbda13b8c9 with scrape type 1
2026-03-28 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8013093d-1580-5701-b07f-5bcbda13b8c9
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F2a%252F7a2a10637bc4d59142e1dba4b553c6f5%252Fpa%252FWW30345_485e8059ad5e82d8acf9cdea79dcf911.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_485e8059ad5e82d8acf9cdea79dcf911.jpg not downloaded yet
2026-03-28 18:46:55 [auto1.de] INFO: Found listing with ID: YW30232
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW30232%27 HTTP/1.1" 200 None
2026-03-28 18:46:55 [auto1.de] INFO: Scrape type for YW30232: 2
2026-03-28 18:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64c2f32e-1ae4-5122-9ec0-9e949c7035b5 with identifier: YW30232
2026-03-28 18:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64c2f32e-1ae4-5122-9ec0-9e949c7035b5 with scrape type 2
2026-03-28 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64c2f32e-1ae4-5122-9ec0-9e949c7035b5 with scrape type 2
2026-03-28 18:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64c2f32e-1ae4-5122-9ec0-9e949c7035b5, identifier: YW30232
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_cdb58a5a47568136f765ef8b8cb74ad0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_cdb58a5a47568136f765ef8b8cb74ad0.jpg not downloaded yet
2026-03-28 18:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_ba1efa99000d696229bbc5cdde90d59c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64c2f32e-1ae4-5122-9ec0-9e949c7035b5 with identifier: YW30232
2026-03-28 18:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64c2f32e-1ae4-5122-9ec0-9e949c7035b5 with identifier: YW30232
2026-03-28 18:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64c2f32e-1ae4-5122-9ec0-9e949c7035b5 with identifier: YW30232 to the API
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:10:26Z',
 'fuel_type': 'diesel',
 'id': '64c2f32e-1ae4-5122-9ec0-9e949c7035b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW30232',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 254359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-06',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Comfortline',
 'transmission': 'automatic',
 'trim': 'Maxi Comfortline',
 'year': 2013}
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW30232%27 HTTP/1.1" 200 None
2026-03-28 18:46:56 [auto1.de] INFO: Saving data for YW30232: {'auction_closing_time': 1774883426.0, 'created_time': 1774089589.641103, 'last_price_update_time': 1774723616.32178}
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW30232') HTTP/1.1" 204 0
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F2a%252F7a2a10637bc4d59142e1dba4b553c6f5%252Fpa%252FWW30345_45e03e71d1d52bc22ea81e136eeb5a60.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_45e03e71d1d52bc22ea81e136eeb5a60.jpg not downloaded yet
2026-03-28 18:46:56 [auto1.de] INFO: Found listing with ID: AL30364
2026-03-28 18:46:56 [auto1.de] INFO: Found listing with ID: FW19107
2026-03-28 18:46:56 [auto1.de] INFO: Found listing with ID: HF87037
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF87037%27 HTTP/1.1" 200 None
2026-03-28 18:46:56 [auto1.de] INFO: Scrape type for HF87037: 2
2026-03-28 18:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d with identifier: HF87037
2026-03-28 18:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d with scrape type 2
2026-03-28 18:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d with scrape type 2
2026-03-28 18:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d, identifier: HF87037
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_7f5b8ce76f801ec7a0e8872c2ce93e94.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_7f5b8ce76f801ec7a0e8872c2ce93e94.jpg not downloaded yet
2026-03-28 18:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_8e1673553d909ce0c9821495569ea96c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d with identifier: HF87037
2026-03-28 18:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d with identifier: HF87037
2026-03-28 18:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d with identifier: HF87037 to the API
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:45:58Z',
 'fuel_type': 'petrol',
 'id': '30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF87037',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 148700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-02',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2016}
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF87037%27 HTTP/1.1" 200 None
2026-03-28 18:46:56 [auto1.de] INFO: Saving data for HF87037: {'auction_closing_time': 1774885558.0, 'created_time': 1774350345.935275, 'last_price_update_time': 1774723616.81159}
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF87037') HTTP/1.1" 204 0
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F2a%252F7a2a10637bc4d59142e1dba4b553c6f5%252Fpa%252FWW30345_b8e37e3c96ecd2341cc4876f90c0981b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_b8e37e3c96ecd2341cc4876f90c0981b.jpg not downloaded yet
2026-03-28 18:46:56 [auto1.de] INFO: Found listing with ID: SJ02125
2026-03-28 18:46:56 [auto1.de] INFO: Found listing with ID: GZ99340
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ99340%27 HTTP/1.1" 200 None
2026-03-28 18:46:56 [auto1.de] INFO: Scrape type for GZ99340: 1
2026-03-28 18:46:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563f7390>
2026-03-28 18:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6a20bb-8e47-55b5-a771-f23ea3483ecc/8a6a20bb-8e47-55b5-a771-f23ea3483ecc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F48%252F534890bfc229e0d871957556897e13d3%252Fpa%252FRF84100_206ae337608a7dce0f193eb0d121531c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_206ae337608a7dce0f193eb0d121531c.jpg saved to cache
2026-03-28 18:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a6a20bb-8e47-55b5-a771-f23ea3483ecc
2026-03-28 18:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245610ead0>
2026-03-28 18:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6a20bb-8e47-55b5-a771-f23ea3483ecc/8a6a20bb-8e47-55b5-a771-f23ea3483ecc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F48%252F534890bfc229e0d871957556897e13d3%252Fpa%252FRF84100_ba1efa99000d696229bbc5cdde90d59c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_ba1efa99000d696229bbc5cdde90d59c.jpg saved to cache
2026-03-28 18:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a6a20bb-8e47-55b5-a771-f23ea3483ecc
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F2a%252F7a2a10637bc4d59142e1dba4b553c6f5%252Fpa%252FWW30345_21a0b5e31f186f8eaac862176b39dcfb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_21a0b5e31f186f8eaac862176b39dcfb.jpg not downloaded yet
2026-03-28 18:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_deb867edbbde3a463bd9c9e627ce5fc1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:56 [auto1.de] INFO: Found listing with ID: VL24807
2026-03-28 18:46:56 [auto1.de] INFO: Found listing with ID: FB16153
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB16153%27 HTTP/1.1" 200 None
2026-03-28 18:46:56 [auto1.de] INFO: Scrape type for FB16153: 1
2026-03-28 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F2a%252F7a2a10637bc4d59142e1dba4b553c6f5%252Fpa%252FWW30345_a09bd273e4fe931591d6385f92f1f6f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_a09bd273e4fe931591d6385f92f1f6f6.jpg not downloaded yet
2026-03-28 18:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564a2390>
2026-03-28 18:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_8e1673553d909ce0c9821495569ea96c.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_8e1673553d909ce0c9821495569ea96c.jpg saved to cache
2026-03-28 18:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9b961ea-ec5b-556d-8337-e84209cb427a
2026-03-28 18:46:57 [auto1.de] INFO: Found listing with ID: AX69067
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX69067%27 HTTP/1.1" 200 None
2026-03-28 18:46:57 [auto1.de] INFO: Scrape type for AX69067: 2
2026-03-28 18:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f90b2daf-04e2-5a3e-8bfe-93c0706d7dba with identifier: AX69067
2026-03-28 18:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90b2daf-04e2-5a3e-8bfe-93c0706d7dba with scrape type 2
2026-03-28 18:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f90b2daf-04e2-5a3e-8bfe-93c0706d7dba with scrape type 2
2026-03-28 18:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f90b2daf-04e2-5a3e-8bfe-93c0706d7dba, identifier: AX69067
2026-03-28 18:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f90b2daf-04e2-5a3e-8bfe-93c0706d7dba with identifier: AX69067
2026-03-28 18:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f90b2daf-04e2-5a3e-8bfe-93c0706d7dba with identifier: AX69067
2026-03-28 18:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f90b2daf-04e2-5a3e-8bfe-93c0706d7dba with identifier: AX69067 to the API
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:35:25Z',
 'fuel_type': 'petrol',
 'id': 'f90b2daf-04e2-5a3e-8bfe-93c0706d7dba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX69067',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 171659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-25',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX69067%27 HTTP/1.1" 200 None
2026-03-28 18:46:57 [auto1.de] INFO: Saving data for AX69067: {'auction_closing_time': 1774884925.0, 'created_time': 1773382519.363729, 'last_price_update_time': 1774723617.473916}
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX69067') HTTP/1.1" 204 0
2026-03-28 18:46:57 [auto1.de] INFO: Found listing with ID: CM63557
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM63557%27 HTTP/1.1" 200 None
2026-03-28 18:46:57 [auto1.de] INFO: Scrape type for CM63557: 2
2026-03-28 18:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afa20307-a790-55a2-a4e6-795516271113 with identifier: CM63557
2026-03-28 18:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afa20307-a790-55a2-a4e6-795516271113 with scrape type 2
2026-03-28 18:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afa20307-a790-55a2-a4e6-795516271113 with scrape type 2
2026-03-28 18:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afa20307-a790-55a2-a4e6-795516271113, identifier: CM63557
2026-03-28 18:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afa20307-a790-55a2-a4e6-795516271113 with identifier: CM63557
2026-03-28 18:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afa20307-a790-55a2-a4e6-795516271113 with identifier: CM63557
2026-03-28 18:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afa20307-a790-55a2-a4e6-795516271113 with identifier: CM63557 to the API
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:05:33Z',
 'fuel_type': 'petrol',
 'id': 'afa20307-a790-55a2-a4e6-795516271113',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM63557',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 105451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM63557%27 HTTP/1.1" 200 None
2026-03-28 18:46:58 [auto1.de] INFO: Saving data for CM63557: {'auction_closing_time': 1774883133.0, 'created_time': 1774350055.344002, 'last_price_update_time': 1774723618.023693}
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM63557') HTTP/1.1" 204 0
2026-03-28 18:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_7c003347a100cf7bedf0b8448d291de3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_29b7ee36be602073f8200d4b0112ffa5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: YR62229
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR62229%27 HTTP/1.1" 200 None
2026-03-28 18:46:58 [auto1.de] INFO: Scrape type for YR62229: 1
2026-03-28 18:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR58414/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561bb850>
2026-03-28 18:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6a20bb-8e47-55b5-a771-f23ea3483ecc/8a6a20bb-8e47-55b5-a771-f23ea3483ecc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F48%252F534890bfc229e0d871957556897e13d3%252Fpa%252FRF84100_deb867edbbde3a463bd9c9e627ce5fc1.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_deb867edbbde3a463bd9c9e627ce5fc1.jpg saved to cache
2026-03-28 18:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a6a20bb-8e47-55b5-a771-f23ea3483ecc
2026-03-28 18:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HF23324/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: NF97550
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: AR94395
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR94395%27 HTTP/1.1" 200 None
2026-03-28 18:46:58 [auto1.de] INFO: Scrape type for AR94395: 1
2026-03-28 18:46:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: RF06599
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF06599%27 HTTP/1.1" 200 None
2026-03-28 18:46:58 [auto1.de] INFO: Scrape type for RF06599: 1
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: AD51126
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD51126%27 HTTP/1.1" 200 None
2026-03-28 18:46:58 [auto1.de] INFO: Scrape type for AD51126: 1
2026-03-28 18:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456194790>
2026-03-28 18:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_7c003347a100cf7bedf0b8448d291de3.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_7c003347a100cf7bedf0b8448d291de3.jpg saved to cache
2026-03-28 18:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9b961ea-ec5b-556d-8337-e84209cb427a
2026-03-28 18:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245648bd10>
2026-03-28 18:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_29b7ee36be602073f8200d4b0112ffa5.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_29b7ee36be602073f8200d4b0112ffa5.jpg saved to cache
2026-03-28 18:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9b961ea-ec5b-556d-8337-e84209cb427a
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: ZA82087
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: PR51827
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: KU26816
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: LD78650
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78650%27 HTTP/1.1" 200 None
2026-03-28 18:46:58 [auto1.de] INFO: Scrape type for LD78650: 1
2026-03-28 18:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_21a0b5e31f186f8eaac862176b39dcfb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: KB26549
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB26549%27 HTTP/1.1" 200 None
2026-03-28 18:46:58 [auto1.de] INFO: Scrape type for KB26549: 1
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: VL06986
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06986%27 HTTP/1.1" 200 None
2026-03-28 18:46:58 [auto1.de] INFO: Scrape type for VL06986: 1
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: WB94106
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94106%27 HTTP/1.1" 200 None
2026-03-28 18:46:58 [auto1.de] INFO: Scrape type for WB94106: 1
2026-03-28 18:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_f2acc4c1e382e515519e8b19c104ebc5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_a09bd273e4fe931591d6385f92f1f6f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: ZP72952
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP72952%27 HTTP/1.1" 200 None
2026-03-28 18:46:58 [auto1.de] INFO: Scrape type for ZP72952: 2
2026-03-28 18:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 765aa777-690b-510d-b4de-f91cc4d7e533 with identifier: ZP72952
2026-03-28 18:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 765aa777-690b-510d-b4de-f91cc4d7e533 with scrape type 2
2026-03-28 18:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 765aa777-690b-510d-b4de-f91cc4d7e533 with scrape type 2
2026-03-28 18:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 765aa777-690b-510d-b4de-f91cc4d7e533, identifier: ZP72952
2026-03-28 18:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 765aa777-690b-510d-b4de-f91cc4d7e533 with identifier: ZP72952
2026-03-28 18:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 765aa777-690b-510d-b4de-f91cc4d7e533 with identifier: ZP72952
2026-03-28 18:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 765aa777-690b-510d-b4de-f91cc4d7e533 with identifier: ZP72952 to the API
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:42:15Z',
 'fuel_type': 'petrol',
 'id': '765aa777-690b-510d-b4de-f91cc4d7e533',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP72952',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 106356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-29',
 'seller_name': None,
 'title': 'Opel Agila 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP72952%27 HTTP/1.1" 200 None
2026-03-28 18:46:58 [auto1.de] INFO: Saving data for ZP72952: {'auction_closing_time': 1774885335.0, 'created_time': 1773426972.685849, 'last_price_update_time': 1774723618.779177}
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP72952') HTTP/1.1" 204 0
2026-03-28 18:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_cdb58a5a47568136f765ef8b8cb74ad0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: CM42106
2026-03-28 18:46:58 [auto1.de] INFO: Found listing with ID: UP78086
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP78086%27 HTTP/1.1" 200 None
2026-03-28 18:46:58 [auto1.de] INFO: Scrape type for UP78086: 1
2026-03-28 18:46:59 [auto1.de] INFO: Found listing with ID: WP34859
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP34859%27 HTTP/1.1" 200 None
2026-03-28 18:46:59 [auto1.de] INFO: Scrape type for WP34859: 1
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454812010>
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013093d-1580-5701-b07f-5bcbda13b8c9/8013093d-1580-5701-b07f-5bcbda13b8c9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F2a%252F7a2a10637bc4d59142e1dba4b553c6f5%252Fpa%252FWW30345_21a0b5e31f186f8eaac862176b39dcfb.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_21a0b5e31f186f8eaac862176b39dcfb.jpg saved to cache
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8013093d-1580-5701-b07f-5bcbda13b8c9
2026-03-28 18:46:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454809850>
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_f2acc4c1e382e515519e8b19c104ebc5.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_f2acc4c1e382e515519e8b19c104ebc5.jpg saved to cache
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245627efd0>
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013093d-1580-5701-b07f-5bcbda13b8c9/8013093d-1580-5701-b07f-5bcbda13b8c9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F2a%252F7a2a10637bc4d59142e1dba4b553c6f5%252Fpa%252FWW30345_a09bd273e4fe931591d6385f92f1f6f6.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_a09bd273e4fe931591d6385f92f1f6f6.jpg saved to cache
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8013093d-1580-5701-b07f-5bcbda13b8c9
2026-03-28 18:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP14986> (referer: https://www.auto1.com/v1/car-details-view/MP14986/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF58596> (referer: https://www.auto1.com/v1/car-details-view/WF58596/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245609d790>
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_cdb58a5a47568136f765ef8b8cb74ad0.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_cdb58a5a47568136f765ef8b8cb74ad0.jpg saved to cache
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9b961ea-ec5b-556d-8337-e84209cb427a
2026-03-28 18:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_78bb9fa8497e8c794898a41b250e6e51.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_6f83cc7785f26a1a22afddbc99391ca1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_5a62d3782a5dbf49aafc9a1028f08a3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_d8e5d866ec58c7831ac249993b19a9e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_8f3cc75b1369f5c916c062f657f36dc1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbec23ff-f10f-568f-8aca-93619b9d2662 with identifier: MP14986
2026-03-28 18:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbec23ff-f10f-568f-8aca-93619b9d2662 with scrape type 1
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cbec23ff-f10f-568f-8aca-93619b9d2662
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_f98e93547f3c6528fc48747effa9c8c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_f98e93547f3c6528fc48747effa9c8c0.jpg not downloaded yet
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_ca7dd8e23b31d5e72cabd9c0c24de299.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_ca7dd8e23b31d5e72cabd9c0c24de299.jpg not downloaded yet
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_b4780e437a506c01f84a6be06ad173a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_b4780e437a506c01f84a6be06ad173a1.jpg not downloaded yet
2026-03-28 18:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38aaa83e-a550-5222-a43c-bf09055b54ec with identifier: WF58596
2026-03-28 18:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38aaa83e-a550-5222-a43c-bf09055b54ec with scrape type 1
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38aaa83e-a550-5222-a43c-bf09055b54ec
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_67b3a995d0ce408c35640249d965f71b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_67b3a995d0ce408c35640249d965f71b.jpg not downloaded yet
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_a7a76722ed97fe71b412be9a69d02758.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_a7a76722ed97fe71b412be9a69d02758.jpg not downloaded yet
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_998f63146f90b747ac191806a172925f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_998f63146f90b747ac191806a172925f.jpg not downloaded yet
2026-03-28 18:46:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458559c10>
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_78bb9fa8497e8c794898a41b250e6e51.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_78bb9fa8497e8c794898a41b250e6e51.jpg saved to cache
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512
2026-03-28 18:46:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245652bcd0>
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_6f83cc7785f26a1a22afddbc99391ca1.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_6f83cc7785f26a1a22afddbc99391ca1.jpg saved to cache
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512
2026-03-28 18:46:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547ced90>
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F9e%252Fa69ed53a1e97279de335f2d2096a0be8%252Fpa%252FRL75454_5a62d3782a5dbf49aafc9a1028f08a3a.jpg') HTTP/1.1" 204 0
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_5a62d3782a5dbf49aafc9a1028f08a3a.jpg saved to cache
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512
2026-03-28 18:46:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e17c68c-c8d9-5f6f-a16e-b92948f10512, skipping ID generation
2026-03-28 18:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512 with scrape type 1
2026-03-28 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512 sending to next pipeline
2026-03-28 18:46:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e17c68c-c8d9-5f6f-a16e-b92948f10512, identifier: RL75454
2026-03-28 18:46:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547d2790>
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_d8e5d866ec58c7831ac249993b19a9e5.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_d8e5d866ec58c7831ac249993b19a9e5.jpg saved to cache
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9b961ea-ec5b-556d-8337-e84209cb427a
2026-03-28 18:47:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245634e2d0>
2026-03-28 18:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_8f3cc75b1369f5c916c062f657f36dc1.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_8f3cc75b1369f5c916c062f657f36dc1.jpg saved to cache
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9b961ea-ec5b-556d-8337-e84209cb427a
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_5f35790a482be4433e43dce770f9c3b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_5f35790a482be4433e43dce770f9c3b7.jpg not downloaded yet
2026-03-28 18:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e17c68c-c8d9-5f6f-a16e-b92948f10512 with identifier: RL75454
2026-03-28 18:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e17c68c-c8d9-5f6f-a16e-b92948f10512 with identifier: RL75454
2026-03-28 18:47:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e17c68c-c8d9-5f6f-a16e-b92948f10512 with identifier: RL75454 to the API
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_5a62d3782a5dbf49aafc9a1028f08a3a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:04:17Z',
 'fuel_type': 'petrol',
 'id': '5e17c68c-c8d9-5f6f-a16e-b92948f10512',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL75454',
 'listing': 'auction',
 'location': 'DE, Düsseldorf',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 124926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_a93a9f2a3a62aab1d6bee03d473f5a19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3288878,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_78bb9fa8497e8c794898a41b250e6e51.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_9b201b216b36c75b6637c6ef9f3e2a38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3452845,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_6f83cc7785f26a1a22afddbc99391ca1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3525784,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_5a62d3782a5dbf49aafc9a1028f08a3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_a7b811a2e6bfa704a9da1c8e97f3667c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_12f0db4e83950dac10d1627662fd9603.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3285730,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_e8eab9b86bae44ad0f9396522c4f3ce9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_25e22a8adcea53dbc411ba3f0fb6cf02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e17c68c-c8d9-5f6f-a16e-b92948f10512/5e17c68c-c8d9-5f6f-a16e-b92948f10512_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/9e/a69ed53a1e97279de335f2d2096a0be8/pa/RL75454_47f8acb6b254a83c0d60dba94d5e11ca.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2018}
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL75454%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [auto1.de] INFO: Saving data for RL75454: {'created_time': 1774723620.524612, 'last_price_update_time': 1774723620.524624, 'auction_closing_time': 1774883057.0}
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL75454') HTTP/1.1" 204 0
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_6ef7b56e1a542b09ce466b415ebf1d9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_6ef7b56e1a542b09ce466b415ebf1d9f.jpg not downloaded yet
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_b7250f822d37a93fbfe12751a1e79407.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_b7250f822d37a93fbfe12751a1e79407.jpg not downloaded yet
2026-03-28 18:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD51126/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR62229/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ99340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB16153/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_f1c385b0246b75d9ee285c98db370434.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_f1c385b0246b75d9ee285c98db370434.jpg not downloaded yet
2026-03-28 18:47:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_08afdf473eca3165236745676178bc2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_08afdf473eca3165236745676178bc2b.jpg not downloaded yet
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_8ce2f61d607b7a2b804f7f133a471eae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_8ce2f61d607b7a2b804f7f133a471eae.jpg not downloaded yet
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_53dab351b83d4d4a3ec34eeb7e761548.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_53dab351b83d4d4a3ec34eeb7e761548.jpg not downloaded yet
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_b7f54f8b1f03902b9cda512cf83af5d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_b7f54f8b1f03902b9cda512cf83af5d2.jpg not downloaded yet
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_d618a7c477daa58a5207626bfd6493cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_d618a7c477daa58a5207626bfd6493cd.jpg not downloaded yet
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_4d7548014d39460e2f11064702934395.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_4d7548014d39460e2f11064702934395.jpg not downloaded yet
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_39d74435208f350b1a4ce30243ddf54a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_39d74435208f350b1a4ce30243ddf54a.jpg not downloaded yet
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_595915fa73c921fabc44d663e7364fc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_595915fa73c921fabc44d663e7364fc4.jpg not downloaded yet
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_cf0593118c7d1f21606d696b1e4ec58a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_cf0593118c7d1f21606d696b1e4ec58a.jpg not downloaded yet
2026-03-28 18:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_a7a76722ed97fe71b412be9a69d02758.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_f7eb420a18a94ae1118f883f318c1a75.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_f7eb420a18a94ae1118f883f318c1a75.jpg not downloaded yet
2026-03-28 18:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_f98e93547f3c6528fc48747effa9c8c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_998f63146f90b747ac191806a172925f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_ca7dd8e23b31d5e72cabd9c0c24de299.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_5f35790a482be4433e43dce770f9c3b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456058d50>
2026-03-28 18:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_a7a76722ed97fe71b412be9a69d02758.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_a7a76722ed97fe71b412be9a69d02758.jpg saved to cache
2026-03-28 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cbec23ff-f10f-568f-8aca-93619b9d2662
2026-03-28 18:47:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245649c7d0>
2026-03-28 18:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_f98e93547f3c6528fc48747effa9c8c0.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_f98e93547f3c6528fc48747effa9c8c0.jpg saved to cache
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cbec23ff-f10f-568f-8aca-93619b9d2662
2026-03-28 18:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_67b3a995d0ce408c35640249d965f71b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456191cd0>
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_998f63146f90b747ac191806a172925f.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_998f63146f90b747ac191806a172925f.jpg saved to cache
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38aaa83e-a550-5222-a43c-bf09055b54ec
2026-03-28 18:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_cf0593118c7d1f21606d696b1e4ec58a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456158410>
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_ca7dd8e23b31d5e72cabd9c0c24de299.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_ca7dd8e23b31d5e72cabd9c0c24de299.jpg saved to cache
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cbec23ff-f10f-568f-8aca-93619b9d2662
2026-03-28 18:47:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458530f90>
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_5f35790a482be4433e43dce770f9c3b7.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_5f35790a482be4433e43dce770f9c3b7.jpg saved to cache
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cbec23ff-f10f-568f-8aca-93619b9d2662
2026-03-28 18:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB94106/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24582a64d0>
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_67b3a995d0ce408c35640249d965f71b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_67b3a995d0ce408c35640249d965f71b.jpg saved to cache
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38aaa83e-a550-5222-a43c-bf09055b54ec
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24586fc0d0>
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_cf0593118c7d1f21606d696b1e4ec58a.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_cf0593118c7d1f21606d696b1e4ec58a.jpg saved to cache
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38aaa83e-a550-5222-a43c-bf09055b54ec
2026-03-28 18:47:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_6ef7b56e1a542b09ce466b415ebf1d9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_f7eb420a18a94ae1118f883f318c1a75.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_b4780e437a506c01f84a6be06ad173a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP34859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB26549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HF23324> (referer: https://www.auto1.com/v1/car-details-view/HF23324/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP78086/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562c5550>
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_6ef7b56e1a542b09ce466b415ebf1d9f.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_6ef7b56e1a542b09ce466b415ebf1d9f.jpg saved to cache
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38aaa83e-a550-5222-a43c-bf09055b54ec
2026-03-28 18:47:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245615bc50>
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_f7eb420a18a94ae1118f883f318c1a75.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_f7eb420a18a94ae1118f883f318c1a75.jpg saved to cache
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38aaa83e-a550-5222-a43c-bf09055b54ec
2026-03-28 18:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL06986/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_595915fa73c921fabc44d663e7364fc4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b1fd0>
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_b4780e437a506c01f84a6be06ad173a1.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_b4780e437a506c01f84a6be06ad173a1.jpg saved to cache
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cbec23ff-f10f-568f-8aca-93619b9d2662
2026-03-28 18:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb08df1-1912-5353-a474-512edb6639c3 with identifier: HF23324
2026-03-28 18:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb08df1-1912-5353-a474-512edb6639c3 with scrape type 1
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item acb08df1-1912-5353-a474-512edb6639c3
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a8c8d0721e2215f90c7aaca1a0c296%252Fpa%252FHF23324_f8355462774a15c4d580d61a1498026d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_f8355462774a15c4d580d61a1498026d.jpg already downloaded
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a8c8d0721e2215f90c7aaca1a0c296%252Fpa%252FHF23324_7839ccc18d1221da8ec25a9cb8c2259d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_7839ccc18d1221da8ec25a9cb8c2259d.jpg already downloaded
2026-03-28 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a8c8d0721e2215f90c7aaca1a0c296%252Fpa%252FHF23324_1166b97b022d72bd4f6956ce03059cce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_1166b97b022d72bd4f6956ce03059cce.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a8c8d0721e2215f90c7aaca1a0c296%252Fpa%252FHF23324_f63175cebdcb4d6711ef0502c3b4d677.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_f63175cebdcb4d6711ef0502c3b4d677.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a8c8d0721e2215f90c7aaca1a0c296%252Fpa%252FHF23324_1a34b043eb0d3ec4c4cece303e6058bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_1a34b043eb0d3ec4c4cece303e6058bb.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a8c8d0721e2215f90c7aaca1a0c296%252Fpa%252FHF23324_80a03ae03d23da6722ee16fcb43dc68f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_80a03ae03d23da6722ee16fcb43dc68f.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a8c8d0721e2215f90c7aaca1a0c296%252Fpa%252FHF23324_de8c2ca480f9a34b4165c7b348ada334.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_de8c2ca480f9a34b4165c7b348ada334.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a8c8d0721e2215f90c7aaca1a0c296%252Fpa%252FHF23324_9ed82b49c01585cd38c2dd14822062ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_9ed82b49c01585cd38c2dd14822062ae.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a8c8d0721e2215f90c7aaca1a0c296%252Fpa%252FHF23324_14cc0429e3ead7df245a209966df680a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_14cc0429e3ead7df245a209966df680a.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fa8%252Fd6a8c8d0721e2215f90c7aaca1a0c296%252Fpa%252FHF23324_712eefda94ee4341ad95c6fbdbb0530d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_712eefda94ee4341ad95c6fbdbb0530d.jpg already downloaded
2026-03-28 18:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acb08df1-1912-5353-a474-512edb6639c3, identifier: HF23324
2026-03-28 18:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acb08df1-1912-5353-a474-512edb6639c3 with identifier: HF23324
2026-03-28 18:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acb08df1-1912-5353-a474-512edb6639c3 with identifier: HF23324
2026-03-28 18:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acb08df1-1912-5353-a474-512edb6639c3 with identifier: HF23324 to the API
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HF23324>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:03:31Z',
 'fuel_type': 'diesel',
 'id': 'acb08df1-1912-5353-a474-512edb6639c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF23324',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 155669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_f8355462774a15c4d580d61a1498026d.jpg',
                'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_7839ccc18d1221da8ec25a9cb8c2259d.jpg',
                'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_1166b97b022d72bd4f6956ce03059cce.jpg',
                'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_f63175cebdcb4d6711ef0502c3b4d677.jpg',
                'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_1a34b043eb0d3ec4c4cece303e6058bb.jpg',
                'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_80a03ae03d23da6722ee16fcb43dc68f.jpg',
                'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_de8c2ca480f9a34b4165c7b348ada334.jpg',
                'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_9ed82b49c01585cd38c2dd14822062ae.jpg',
                'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_14cc0429e3ead7df245a209966df680a.jpg',
                'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_712eefda94ee4341ad95c6fbdbb0530d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb08df1-1912-5353-a474-512edb6639c3/acb08df1-1912-5353-a474-512edb6639c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_f8355462774a15c4d580d61a1498026d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb08df1-1912-5353-a474-512edb6639c3/acb08df1-1912-5353-a474-512edb6639c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_7839ccc18d1221da8ec25a9cb8c2259d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb08df1-1912-5353-a474-512edb6639c3/acb08df1-1912-5353-a474-512edb6639c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_1166b97b022d72bd4f6956ce03059cce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb08df1-1912-5353-a474-512edb6639c3/acb08df1-1912-5353-a474-512edb6639c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3165316,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_f63175cebdcb4d6711ef0502c3b4d677.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb08df1-1912-5353-a474-512edb6639c3/acb08df1-1912-5353-a474-512edb6639c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_1a34b043eb0d3ec4c4cece303e6058bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb08df1-1912-5353-a474-512edb6639c3/acb08df1-1912-5353-a474-512edb6639c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_80a03ae03d23da6722ee16fcb43dc68f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb08df1-1912-5353-a474-512edb6639c3/acb08df1-1912-5353-a474-512edb6639c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_de8c2ca480f9a34b4165c7b348ada334.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb08df1-1912-5353-a474-512edb6639c3/acb08df1-1912-5353-a474-512edb6639c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_9ed82b49c01585cd38c2dd14822062ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb08df1-1912-5353-a474-512edb6639c3/acb08df1-1912-5353-a474-512edb6639c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_14cc0429e3ead7df245a209966df680a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb08df1-1912-5353-a474-512edb6639c3/acb08df1-1912-5353-a474-512edb6639c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a8c8d0721e2215f90c7aaca1a0c296/pa/HF23324_712eefda94ee4341ad95c6fbdbb0530d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 25d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF23324%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [auto1.de] INFO: Saving data for HF23324: {'created_time': 1774723622.551707, 'last_price_update_time': 1774723622.551721, 'auction_closing_time': 1774883011.0}
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF23324') HTTP/1.1" 204 0
2026-03-28 18:47:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN17555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a44d0>
2026-03-28 18:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_595915fa73c921fabc44d663e7364fc4.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_595915fa73c921fabc44d663e7364fc4.jpg saved to cache
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38aaa83e-a550-5222-a43c-bf09055b54ec
2026-03-28 18:47:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB16153> (referer: https://www.auto1.com/v1/car-details-view/FB16153/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_39d74435208f350b1a4ce30243ddf54a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_8ce2f61d607b7a2b804f7f133a471eae.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be15c46f-f9a8-5a0b-a8a5-22412a33c0fc with identifier: FB16153
2026-03-28 18:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be15c46f-f9a8-5a0b-a8a5-22412a33c0fc with scrape type 1
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be15c46f-f9a8-5a0b-a8a5-22412a33c0fc
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F9d%252F169d768f3cfe35cc6a16819cdf019669%252Fpa%252FFB16153_ef34eca0e531592ca4a9dcf1e5a4850a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_ef34eca0e531592ca4a9dcf1e5a4850a.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F9d%252F169d768f3cfe35cc6a16819cdf019669%252Fpa%252FFB16153_2d444765b158057df920c2429475de88.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_2d444765b158057df920c2429475de88.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F9d%252F169d768f3cfe35cc6a16819cdf019669%252Fpa%252FFB16153_0f6adf4e781d1f8306b537871837c53e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_0f6adf4e781d1f8306b537871837c53e.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F9d%252F169d768f3cfe35cc6a16819cdf019669%252Fpa%252FFB16153_da56cfbc7c46674a88a9d7e2dd368e5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_da56cfbc7c46674a88a9d7e2dd368e5f.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F9d%252F169d768f3cfe35cc6a16819cdf019669%252Fpa%252FFB16153_903b1c12df09afc2ef3d1990d128e8c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_903b1c12df09afc2ef3d1990d128e8c5.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F9d%252F169d768f3cfe35cc6a16819cdf019669%252Fpa%252FFB16153_4f02f674de34a9f7db6658f4cbf68993.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_4f02f674de34a9f7db6658f4cbf68993.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F9d%252F169d768f3cfe35cc6a16819cdf019669%252Fpa%252FFB16153_12462f34a74e32418964653216d38766.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_12462f34a74e32418964653216d38766.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F9d%252F169d768f3cfe35cc6a16819cdf019669%252Fpa%252FFB16153_86ca91c12f662beea6acb0e792fc251d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_86ca91c12f662beea6acb0e792fc251d.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F9d%252F169d768f3cfe35cc6a16819cdf019669%252Fpa%252FFB16153_db4824bd8f3f4c2d14ebd0df37156670.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_db4824bd8f3f4c2d14ebd0df37156670.jpg already downloaded
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F9d%252F169d768f3cfe35cc6a16819cdf019669%252Fpa%252FFB16153_b3c31abf6e96945c92c427659d9c022c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_b3c31abf6e96945c92c427659d9c022c.jpg already downloaded
2026-03-28 18:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be15c46f-f9a8-5a0b-a8a5-22412a33c0fc, identifier: FB16153
2026-03-28 18:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be15c46f-f9a8-5a0b-a8a5-22412a33c0fc with identifier: FB16153
2026-03-28 18:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be15c46f-f9a8-5a0b-a8a5-22412a33c0fc with identifier: FB16153
2026-03-28 18:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be15c46f-f9a8-5a0b-a8a5-22412a33c0fc with identifier: FB16153 to the API
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FB16153>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:14:00Z',
 'fuel_type': 'petrol',
 'id': 'be15c46f-f9a8-5a0b-a8a5-22412a33c0fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB16153',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 151724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_ef34eca0e531592ca4a9dcf1e5a4850a.jpg',
                'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_2d444765b158057df920c2429475de88.jpg',
                'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_0f6adf4e781d1f8306b537871837c53e.jpg',
                'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_da56cfbc7c46674a88a9d7e2dd368e5f.jpg',
                'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_903b1c12df09afc2ef3d1990d128e8c5.jpg',
                'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_4f02f674de34a9f7db6658f4cbf68993.jpg',
                'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_12462f34a74e32418964653216d38766.jpg',
                'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_86ca91c12f662beea6acb0e792fc251d.jpg',
                'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_db4824bd8f3f4c2d14ebd0df37156670.jpg',
                'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_b3c31abf6e96945c92c427659d9c022c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be15c46f-f9a8-5a0b-a8a5-22412a33c0fc/be15c46f-f9a8-5a0b-a8a5-22412a33c0fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2803307,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_ef34eca0e531592ca4a9dcf1e5a4850a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be15c46f-f9a8-5a0b-a8a5-22412a33c0fc/be15c46f-f9a8-5a0b-a8a5-22412a33c0fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2850187,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_2d444765b158057df920c2429475de88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be15c46f-f9a8-5a0b-a8a5-22412a33c0fc/be15c46f-f9a8-5a0b-a8a5-22412a33c0fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2693780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_0f6adf4e781d1f8306b537871837c53e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be15c46f-f9a8-5a0b-a8a5-22412a33c0fc/be15c46f-f9a8-5a0b-a8a5-22412a33c0fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2894770,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_da56cfbc7c46674a88a9d7e2dd368e5f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be15c46f-f9a8-5a0b-a8a5-22412a33c0fc/be15c46f-f9a8-5a0b-a8a5-22412a33c0fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2662661,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_903b1c12df09afc2ef3d1990d128e8c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be15c46f-f9a8-5a0b-a8a5-22412a33c0fc/be15c46f-f9a8-5a0b-a8a5-22412a33c0fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2749749,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_4f02f674de34a9f7db6658f4cbf68993.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be15c46f-f9a8-5a0b-a8a5-22412a33c0fc/be15c46f-f9a8-5a0b-a8a5-22412a33c0fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3063073,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_12462f34a74e32418964653216d38766.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be15c46f-f9a8-5a0b-a8a5-22412a33c0fc/be15c46f-f9a8-5a0b-a8a5-22412a33c0fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2875379,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_86ca91c12f662beea6acb0e792fc251d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be15c46f-f9a8-5a0b-a8a5-22412a33c0fc/be15c46f-f9a8-5a0b-a8a5-22412a33c0fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2707494,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_db4824bd8f3f4c2d14ebd0df37156670.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be15c46f-f9a8-5a0b-a8a5-22412a33c0fc/be15c46f-f9a8-5a0b-a8a5-22412a33c0fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2694491,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/9d/169d768f3cfe35cc6a16819cdf019669/pa/FB16153_b3c31abf6e96945c92c427659d9c022c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.5 TSI ACT sport',
 'transmission': 'automatic',
 'trim': 'sport',
 'year': 2017}
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB16153%27 HTTP/1.1" 200 None
2026-03-28 18:47:03 [auto1.de] INFO: Saving data for FB16153: {'created_time': 1774723623.338452, 'last_price_update_time': 1774723623.338464, 'auction_closing_time': 1774883640.0}
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB16153') HTTP/1.1" 204 0
2026-03-28 18:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_f1c385b0246b75d9ee285c98db370434.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_b7f54f8b1f03902b9cda512cf83af5d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_53dab351b83d4d4a3ec34eeb7e761548.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD51126> (referer: https://www.auto1.com/v1/car-details-view/AD51126/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458531a90>
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_39d74435208f350b1a4ce30243ddf54a.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_39d74435208f350b1a4ce30243ddf54a.jpg saved to cache
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cbec23ff-f10f-568f-8aca-93619b9d2662
2026-03-28 18:47:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245608ef10>
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_8ce2f61d607b7a2b804f7f133a471eae.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_8ce2f61d607b7a2b804f7f133a471eae.jpg saved to cache
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38aaa83e-a550-5222-a43c-bf09055b54ec
2026-03-28 18:47:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ99340> (referer: https://www.auto1.com/v1/car-details-view/GZ99340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR62229> (referer: https://www.auto1.com/v1/car-details-view/YR62229/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456418090>
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_f1c385b0246b75d9ee285c98db370434.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_f1c385b0246b75d9ee285c98db370434.jpg saved to cache
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38aaa83e-a550-5222-a43c-bf09055b54ec
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561efb90>
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_b7f54f8b1f03902b9cda512cf83af5d2.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_b7f54f8b1f03902b9cda512cf83af5d2.jpg saved to cache
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38aaa83e-a550-5222-a43c-bf09055b54ec
2026-03-28 18:47:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245605d7d0>
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_53dab351b83d4d4a3ec34eeb7e761548.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_53dab351b83d4d4a3ec34eeb7e761548.jpg saved to cache
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cbec23ff-f10f-568f-8aca-93619b9d2662
2026-03-28 18:47:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6aa35e4-015b-57f9-aaa8-3ab46062da82 with identifier: AD51126
2026-03-28 18:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6aa35e4-015b-57f9-aaa8-3ab46062da82 with scrape type 1
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6aa35e4-015b-57f9-aaa8-3ab46062da82
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F5d%252F5e5d888668e280240e9a1fa547c801d0%252Fpa%252FAD51126_fc9688d21cc607f11992533757a1a93a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_fc9688d21cc607f11992533757a1a93a.jpg already downloaded
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F5d%252F5e5d888668e280240e9a1fa547c801d0%252Fpa%252FAD51126_388e37968752b033427b1ca9b9c039df.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_388e37968752b033427b1ca9b9c039df.jpg already downloaded
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F5d%252F5e5d888668e280240e9a1fa547c801d0%252Fpa%252FAD51126_0e1d8b6e3a62623f2621d0dacccc73fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_0e1d8b6e3a62623f2621d0dacccc73fb.jpg already downloaded
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F5d%252F5e5d888668e280240e9a1fa547c801d0%252Fpa%252FAD51126_46164e46209629e6e7ad788ca6af5180.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_46164e46209629e6e7ad788ca6af5180.jpg already downloaded
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F5d%252F5e5d888668e280240e9a1fa547c801d0%252Fpa%252FAD51126_e736ff90a505d803968c1299bf21db4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_e736ff90a505d803968c1299bf21db4d.jpg already downloaded
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F5d%252F5e5d888668e280240e9a1fa547c801d0%252Fpa%252FAD51126_489850ef9f1ba4aa748fef34f92153a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_489850ef9f1ba4aa748fef34f92153a1.jpg already downloaded
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F5d%252F5e5d888668e280240e9a1fa547c801d0%252Fpa%252FAD51126_b995b09c838c8fe80f48e8a3dc3dd4c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_b995b09c838c8fe80f48e8a3dc3dd4c8.jpg already downloaded
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F5d%252F5e5d888668e280240e9a1fa547c801d0%252Fpa%252FAD51126_c5f029b78ee814d38fedd34159c5538b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_c5f029b78ee814d38fedd34159c5538b.jpg already downloaded
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F5d%252F5e5d888668e280240e9a1fa547c801d0%252Fpa%252FAD51126_82a99d0c1dd41dde0ce0f4b5f334bf04.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_82a99d0c1dd41dde0ce0f4b5f334bf04.jpg already downloaded
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F5d%252F5e5d888668e280240e9a1fa547c801d0%252Fpa%252FAD51126_5ca65554fba4e84490fb053d9a08ae25.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_5ca65554fba4e84490fb053d9a08ae25.jpg already downloaded
2026-03-28 18:47:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6aa35e4-015b-57f9-aaa8-3ab46062da82, identifier: AD51126
2026-03-28 18:47:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6aa35e4-015b-57f9-aaa8-3ab46062da82 with identifier: AD51126
2026-03-28 18:47:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6aa35e4-015b-57f9-aaa8-3ab46062da82 with identifier: AD51126
2026-03-28 18:47:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6aa35e4-015b-57f9-aaa8-3ab46062da82 with identifier: AD51126 to the API
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AD51126>
{'auction_title': '',
 'c_o_2_emission_value': 385,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '6.2L',
 'engine_horse_power': 710,
 'expiration_date': '2026-03-30T15:05:31Z',
 'fuel_type': 'petrol',
 'id': 'e6aa35e4-015b-57f9-aaa8-3ab46062da82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD51126',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 116099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_fc9688d21cc607f11992533757a1a93a.jpg',
                'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_388e37968752b033427b1ca9b9c039df.jpg',
                'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_0e1d8b6e3a62623f2621d0dacccc73fb.jpg',
                'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_46164e46209629e6e7ad788ca6af5180.jpg',
                'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_e736ff90a505d803968c1299bf21db4d.jpg',
                'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_489850ef9f1ba4aa748fef34f92153a1.jpg',
                'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_b995b09c838c8fe80f48e8a3dc3dd4c8.jpg',
                'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_c5f029b78ee814d38fedd34159c5538b.jpg',
                'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_82a99d0c1dd41dde0ce0f4b5f334bf04.jpg',
                'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_5ca65554fba4e84490fb053d9a08ae25.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6aa35e4-015b-57f9-aaa8-3ab46062da82/e6aa35e4-015b-57f9-aaa8-3ab46062da82_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3136624,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_fc9688d21cc607f11992533757a1a93a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6aa35e4-015b-57f9-aaa8-3ab46062da82/e6aa35e4-015b-57f9-aaa8-3ab46062da82_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3198076,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_388e37968752b033427b1ca9b9c039df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6aa35e4-015b-57f9-aaa8-3ab46062da82/e6aa35e4-015b-57f9-aaa8-3ab46062da82_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_0e1d8b6e3a62623f2621d0dacccc73fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6aa35e4-015b-57f9-aaa8-3ab46062da82/e6aa35e4-015b-57f9-aaa8-3ab46062da82_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3202235,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_46164e46209629e6e7ad788ca6af5180.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6aa35e4-015b-57f9-aaa8-3ab46062da82/e6aa35e4-015b-57f9-aaa8-3ab46062da82_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_e736ff90a505d803968c1299bf21db4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6aa35e4-015b-57f9-aaa8-3ab46062da82/e6aa35e4-015b-57f9-aaa8-3ab46062da82_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_489850ef9f1ba4aa748fef34f92153a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6aa35e4-015b-57f9-aaa8-3ab46062da82/e6aa35e4-015b-57f9-aaa8-3ab46062da82_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3022688,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_b995b09c838c8fe80f48e8a3dc3dd4c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6aa35e4-015b-57f9-aaa8-3ab46062da82/e6aa35e4-015b-57f9-aaa8-3ab46062da82_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_c5f029b78ee814d38fedd34159c5538b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6aa35e4-015b-57f9-aaa8-3ab46062da82/e6aa35e4-015b-57f9-aaa8-3ab46062da82_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3150995,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_82a99d0c1dd41dde0ce0f4b5f334bf04.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6aa35e4-015b-57f9-aaa8-3ab46062da82/e6aa35e4-015b-57f9-aaa8-3ab46062da82_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3138498,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/5d/5e5d888668e280240e9a1fa547c801d0/pa/AD51126_5ca65554fba4e84490fb053d9a08ae25.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 6.2 V8 Trailhawk',
 'transmission': 'automatic',
 'trim': 'Trailhawk',
 'year': 2019}
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD51126%27 HTTP/1.1" 200 None
2026-03-28 18:47:04 [auto1.de] INFO: Saving data for AD51126: {'created_time': 1774723624.390742, 'last_price_update_time': 1774723624.390754, 'auction_closing_time': 1774883131.0}
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD51126') HTTP/1.1" 204 0
2026-03-28 18:47:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL06986> (referer: https://www.auto1.com/v1/car-details-view/VL06986/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 109b3c28-e239-5f37-a909-b2f358343f59 with identifier: GZ99340
2026-03-28 18:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 109b3c28-e239-5f37-a909-b2f358343f59 with scrape type 1
2026-03-28 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 109b3c28-e239-5f37-a909-b2f358343f59
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F31%252Fda31766eb8a9b71a80952bddac754747%252Fpa%252FGZ99340_d2e5de78d42bc324719be761e0c2ac81.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_d2e5de78d42bc324719be761e0c2ac81.jpg not downloaded yet
2026-03-28 18:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a22b2a9-efa7-551d-b149-cba5156e9165 with identifier: YR62229
2026-03-28 18:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a22b2a9-efa7-551d-b149-cba5156e9165 with scrape type 1
2026-03-28 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a22b2a9-efa7-551d-b149-cba5156e9165
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fb7%252Fc0b7795997667d9ba5af8f2533ad285f%252Fpa%252FYR62229_283de040f325a31a3f3c22256deccede.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_283de040f325a31a3f3c22256deccede.jpg already downloaded
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fb7%252Fc0b7795997667d9ba5af8f2533ad285f%252Fpa%252FYR62229_1e8484e9cffa93c95399cddd8fe16867.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_1e8484e9cffa93c95399cddd8fe16867.jpg already downloaded
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fb7%252Fc0b7795997667d9ba5af8f2533ad285f%252Fpa%252FYR62229_d3c74402abedf9a42198b1ebc8a8166f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_d3c74402abedf9a42198b1ebc8a8166f.jpg already downloaded
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fb7%252Fc0b7795997667d9ba5af8f2533ad285f%252Fpa%252FYR62229_9a1f5509051178c77707517fe33c4a9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_9a1f5509051178c77707517fe33c4a9a.jpg already downloaded
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fb7%252Fc0b7795997667d9ba5af8f2533ad285f%252Fpa%252FYR62229_3830f607d81efc2bbf62ad41070c310e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_3830f607d81efc2bbf62ad41070c310e.jpg already downloaded
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fb7%252Fc0b7795997667d9ba5af8f2533ad285f%252Fpa%252FYR62229_bb8bb1ed3aa6b07e7a77cf4b4d78f3bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_bb8bb1ed3aa6b07e7a77cf4b4d78f3bc.jpg already downloaded
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fb7%252Fc0b7795997667d9ba5af8f2533ad285f%252Fpa%252FYR62229_9c870357e607dfc97733f30f85dd995d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_9c870357e607dfc97733f30f85dd995d.jpg already downloaded
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fb7%252Fc0b7795997667d9ba5af8f2533ad285f%252Fpa%252FYR62229_cadacaf22d414952a54bf46d6564da65.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_cadacaf22d414952a54bf46d6564da65.jpg already downloaded
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fb7%252Fc0b7795997667d9ba5af8f2533ad285f%252Fpa%252FYR62229_9aca4ef6bb08d8aa0bbe7b7b885dd1ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_9aca4ef6bb08d8aa0bbe7b7b885dd1ab.jpg already downloaded
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fb7%252Fc0b7795997667d9ba5af8f2533ad285f%252Fpa%252FYR62229_8ed8280245ab73017372eece30b0edee.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_8ed8280245ab73017372eece30b0edee.jpg already downloaded
2026-03-28 18:47:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a22b2a9-efa7-551d-b149-cba5156e9165, identifier: YR62229
2026-03-28 18:47:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB94106> (referer: https://www.auto1.com/v1/car-details-view/WB94106/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a22b2a9-efa7-551d-b149-cba5156e9165 with identifier: YR62229
2026-03-28 18:47:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a22b2a9-efa7-551d-b149-cba5156e9165 with identifier: YR62229
2026-03-28 18:47:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a22b2a9-efa7-551d-b149-cba5156e9165 with identifier: YR62229 to the API
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YR62229>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 310,
 'expiration_date': '2026-03-30T15:10:27Z',
 'fuel_type': 'petrol',
 'id': '8a22b2a9-efa7-551d-b149-cba5156e9165',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR62229',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'make': 'Audi',
 'model': 'S3 Sportback',
 'odometer': 97955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_283de040f325a31a3f3c22256deccede.jpg',
                'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_1e8484e9cffa93c95399cddd8fe16867.jpg',
                'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_d3c74402abedf9a42198b1ebc8a8166f.jpg',
                'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_9a1f5509051178c77707517fe33c4a9a.jpg',
                'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_3830f607d81efc2bbf62ad41070c310e.jpg',
                'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_bb8bb1ed3aa6b07e7a77cf4b4d78f3bc.jpg',
                'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_9c870357e607dfc97733f30f85dd995d.jpg',
                'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_cadacaf22d414952a54bf46d6564da65.jpg',
                'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_9aca4ef6bb08d8aa0bbe7b7b885dd1ab.jpg',
                'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_8ed8280245ab73017372eece30b0edee.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a22b2a9-efa7-551d-b149-cba5156e9165/8a22b2a9-efa7-551d-b149-cba5156e9165_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_283de040f325a31a3f3c22256deccede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a22b2a9-efa7-551d-b149-cba5156e9165/8a22b2a9-efa7-551d-b149-cba5156e9165_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_1e8484e9cffa93c95399cddd8fe16867.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a22b2a9-efa7-551d-b149-cba5156e9165/8a22b2a9-efa7-551d-b149-cba5156e9165_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_d3c74402abedf9a42198b1ebc8a8166f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a22b2a9-efa7-551d-b149-cba5156e9165/8a22b2a9-efa7-551d-b149-cba5156e9165_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_9a1f5509051178c77707517fe33c4a9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a22b2a9-efa7-551d-b149-cba5156e9165/8a22b2a9-efa7-551d-b149-cba5156e9165_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_3830f607d81efc2bbf62ad41070c310e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a22b2a9-efa7-551d-b149-cba5156e9165/8a22b2a9-efa7-551d-b149-cba5156e9165_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_bb8bb1ed3aa6b07e7a77cf4b4d78f3bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a22b2a9-efa7-551d-b149-cba5156e9165/8a22b2a9-efa7-551d-b149-cba5156e9165_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_9c870357e607dfc97733f30f85dd995d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a22b2a9-efa7-551d-b149-cba5156e9165/8a22b2a9-efa7-551d-b149-cba5156e9165_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_cadacaf22d414952a54bf46d6564da65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a22b2a9-efa7-551d-b149-cba5156e9165/8a22b2a9-efa7-551d-b149-cba5156e9165_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_9aca4ef6bb08d8aa0bbe7b7b885dd1ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a22b2a9-efa7-551d-b149-cba5156e9165/8a22b2a9-efa7-551d-b149-cba5156e9165_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/b7/c0b7795997667d9ba5af8f2533ad285f/pa/YR62229_8ed8280245ab73017372eece30b0edee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi S3 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR62229%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [auto1.de] INFO: Saving data for YR62229: {'created_time': 1774723625.147496, 'last_price_update_time': 1774723625.147507, 'auction_closing_time': 1774883427.0}
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR62229') HTTP/1.1" 204 0
2026-03-28 18:47:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F31%252Fda31766eb8a9b71a80952bddac754747%252Fpa%252FGZ99340_8a7123a252e22f7d69b4f7b322af3a8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_8a7123a252e22f7d69b4f7b322af3a8b.jpg not downloaded yet
2026-03-28 18:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_b8e37e3c96ecd2341cc4876f90c0981b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP78086> (referer: https://www.auto1.com/v1/car-details-view/UP78086/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F31%252Fda31766eb8a9b71a80952bddac754747%252Fpa%252FGZ99340_d7605103eefb19b27754edb02a3407e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_d7605103eefb19b27754edb02a3407e2.jpg not downloaded yet
2026-03-28 18:47:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB26549> (referer: https://www.auto1.com/v1/car-details-view/KB26549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f758484-a291-5788-ad42-3b6ac222f6e8 with identifier: VL06986
2026-03-28 18:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f758484-a291-5788-ad42-3b6ac222f6e8 with scrape type 1
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f758484-a291-5788-ad42-3b6ac222f6e8
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_948a9509c703e378df2408dc59eb849a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_948a9509c703e378df2408dc59eb849a.jpg not downloaded yet
2026-03-28 18:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705 with identifier: WB94106
2026-03-28 18:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705 with scrape type 1
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_283d4f9f95271d0ee34b93422e7981bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_283d4f9f95271d0ee34b93422e7981bf.jpg not downloaded yet
2026-03-28 18:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_08afdf473eca3165236745676178bc2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F31%252Fda31766eb8a9b71a80952bddac754747%252Fpa%252FGZ99340_1c7fcfd4d15b4e4668cd32358217db13.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_1c7fcfd4d15b4e4668cd32358217db13.jpg not downloaded yet
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_a749ce2854ccc811ae299b518ef6846e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_a749ce2854ccc811ae299b518ef6846e.jpg not downloaded yet
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_9cda81f2bb159ffc3e2c9af2a5a8dd04.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_9cda81f2bb159ffc3e2c9af2a5a8dd04.jpg not downloaded yet
2026-03-28 18:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_4d7548014d39460e2f11064702934395.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_d2e5de78d42bc324719be761e0c2ac81.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F31%252Fda31766eb8a9b71a80952bddac754747%252Fpa%252FGZ99340_57084ffaf15002e5abdfc9755a1489f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_57084ffaf15002e5abdfc9755a1489f4.jpg not downloaded yet
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_2e6f91b98a902c47f3b98cdd085cddd9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_2e6f91b98a902c47f3b98cdd085cddd9.jpg not downloaded yet
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_1ba3eee28c905b469002638dbc72aeb4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_1ba3eee28c905b469002638dbc72aeb4.jpg not downloaded yet
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245614ab10>
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013093d-1580-5701-b07f-5bcbda13b8c9/8013093d-1580-5701-b07f-5bcbda13b8c9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F2a%252F7a2a10637bc4d59142e1dba4b553c6f5%252Fpa%252FWW30345_b8e37e3c96ecd2341cc4876f90c0981b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_b8e37e3c96ecd2341cc4876f90c0981b.jpg saved to cache
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8013093d-1580-5701-b07f-5bcbda13b8c9
2026-03-28 18:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e94baef6-b842-55e6-923c-72dfd63cd195 with identifier: UP78086
2026-03-28 18:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e94baef6-b842-55e6-923c-72dfd63cd195 with scrape type 1
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e94baef6-b842-55e6-923c-72dfd63cd195
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_326fa1811a7420c9791c1b93bc6be286.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_326fa1811a7420c9791c1b93bc6be286.jpg not downloaded yet
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_cc27a3ae48ec66ae3ce2a800c25af80b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_cc27a3ae48ec66ae3ce2a800c25af80b.jpg not downloaded yet
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_1fb6ad9faf8b18cbf90d6cf9e2e2940a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_1fb6ad9faf8b18cbf90d6cf9e2e2940a.jpg not downloaded yet
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_ffd0536ebd15b7a5a756b249e3c55709.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_ffd0536ebd15b7a5a756b249e3c55709.jpg not downloaded yet
2026-03-28 18:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25717195-72f7-597e-b717-9518c2f31283 with identifier: KB26549
2026-03-28 18:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25717195-72f7-597e-b717-9518c2f31283 with scrape type 1
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25717195-72f7-597e-b717-9518c2f31283
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_837d1cd1e97372fccff970d415faf9b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_837d1cd1e97372fccff970d415faf9b4.jpg not downloaded yet
2026-03-28 18:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_d7605103eefb19b27754edb02a3407e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_8a7123a252e22f7d69b4f7b322af3a8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_3a265799a5401a011022ee6b6fe4199c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_3a265799a5401a011022ee6b6fe4199c.jpg not downloaded yet
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_8ab7ff42f30a4c10e3997d86440771a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_8ab7ff42f30a4c10e3997d86440771a9.jpg not downloaded yet
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_e96bac1664868f1fee233a3aeba0555c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_e96bac1664868f1fee233a3aeba0555c.jpg not downloaded yet
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_30ab27d346ed256b03a53d735a4f758c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_30ab27d346ed256b03a53d735a4f758c.jpg not downloaded yet
2026-03-28 18:47:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561ffdd0>
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_08afdf473eca3165236745676178bc2b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_08afdf473eca3165236745676178bc2b.jpg saved to cache
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cbec23ff-f10f-568f-8aca-93619b9d2662
2026-03-28 18:47:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bbb90>
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fef%252F7befab9738ce6eb00fbb0731cfdcc6bc%252Fpa%252FWF58596_4d7548014d39460e2f11064702934395.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_4d7548014d39460e2f11064702934395.jpg saved to cache
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38aaa83e-a550-5222-a43c-bf09055b54ec
2026-03-28 18:47:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38aaa83e-a550-5222-a43c-bf09055b54ec, skipping ID generation
2026-03-28 18:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38aaa83e-a550-5222-a43c-bf09055b54ec with scrape type 1
2026-03-28 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38aaa83e-a550-5222-a43c-bf09055b54ec sending to next pipeline
2026-03-28 18:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38aaa83e-a550-5222-a43c-bf09055b54ec, identifier: WF58596
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245610ec10>
2026-03-28 18:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109b3c28-e239-5f37-a909-b2f358343f59/109b3c28-e239-5f37-a909-b2f358343f59_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F31%252Fda31766eb8a9b71a80952bddac754747%252Fpa%252FGZ99340_d2e5de78d42bc324719be761e0c2ac81.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_d2e5de78d42bc324719be761e0c2ac81.jpg saved to cache
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 109b3c28-e239-5f37-a909-b2f358343f59
2026-03-28 18:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38aaa83e-a550-5222-a43c-bf09055b54ec with identifier: WF58596
2026-03-28 18:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38aaa83e-a550-5222-a43c-bf09055b54ec with identifier: WF58596
2026-03-28 18:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38aaa83e-a550-5222-a43c-bf09055b54ec with identifier: WF58596 to the API
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_4d7548014d39460e2f11064702934395.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:27:27Z',
 'fuel_type': 'petrol',
 'id': '38aaa83e-a550-5222-a43c-bf09055b54ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF58596',
 'listing': 'auction',
 'location': 'DE, Jena',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 150802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2631849,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_67b3a995d0ce408c35640249d965f71b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_998f63146f90b747ac191806a172925f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2436225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_6ef7b56e1a542b09ce466b415ebf1d9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_f1c385b0246b75d9ee285c98db370434.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2626667,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_8ce2f61d607b7a2b804f7f133a471eae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_b7f54f8b1f03902b9cda512cf83af5d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2642448,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_4d7548014d39460e2f11064702934395.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_595915fa73c921fabc44d663e7364fc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_cf0593118c7d1f21606d696b1e4ec58a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38aaa83e-a550-5222-a43c-bf09055b54ec/38aaa83e-a550-5222-a43c-bf09055b54ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2768407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/ef/7befab9738ce6eb00fbb0731cfdcc6bc/pa/WF58596_f7eb420a18a94ae1118f883f318c1a75.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.2 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2010}
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF58596%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [auto1.de] INFO: Saving data for WF58596: {'created_time': 1774723626.412123, 'last_price_update_time': 1774723626.412135, 'auction_closing_time': 1774884447.0}
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF58596') HTTP/1.1" 204 0
2026-03-28 18:47:06 [scrapy.extensions.logstats] INFO: Crawled 529 pages (at 79 pages/min), scraped 769 items (at 52 items/min)
2026-03-28 18:47:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 197MiB
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_bdcdf287dbd2516b365f7536698f069f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_bdcdf287dbd2516b365f7536698f069f.jpg not downloaded yet
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_82a318dea8f8ebe9da03757751ae8340.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_82a318dea8f8ebe9da03757751ae8340.jpg not downloaded yet
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_3f7ec5ebd012fb0c3f2e1d916490ec4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_3f7ec5ebd012fb0c3f2e1d916490ec4c.jpg not downloaded yet
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_41462d4716622c23db714a80453b8712.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_41462d4716622c23db714a80453b8712.jpg not downloaded yet
2026-03-28 18:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF06599/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD78650/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP34859> (referer: https://www.auto1.com/v1/car-details-view/WP34859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_20c73b78763a6ed508dd960c726e4b01.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_20c73b78763a6ed508dd960c726e4b01.jpg not downloaded yet
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_4d2c2951dc2ea34deb16bfe356f17f79.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_4d2c2951dc2ea34deb16bfe356f17f79.jpg not downloaded yet
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_b995e380133171c86bc5e9b0ea938ad3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_b995e380133171c86bc5e9b0ea938ad3.jpg not downloaded yet
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_8d03ee505a1e3f164e70ec8c46d668ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_8d03ee505a1e3f164e70ec8c46d668ac.jpg not downloaded yet
2026-03-28 18:47:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR58414> (referer: https://www.auto1.com/v1/car-details-view/LR58414/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560d05d0>
2026-03-28 18:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109b3c28-e239-5f37-a909-b2f358343f59/109b3c28-e239-5f37-a909-b2f358343f59_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F31%252Fda31766eb8a9b71a80952bddac754747%252Fpa%252FGZ99340_d7605103eefb19b27754edb02a3407e2.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_d7605103eefb19b27754edb02a3407e2.jpg saved to cache
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 109b3c28-e239-5f37-a909-b2f358343f59
2026-03-28 18:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563e8490>
2026-03-28 18:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109b3c28-e239-5f37-a909-b2f358343f59/109b3c28-e239-5f37-a909-b2f358343f59_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F31%252Fda31766eb8a9b71a80952bddac754747%252Fpa%252FGZ99340_8a7123a252e22f7d69b4f7b322af3a8b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_8a7123a252e22f7d69b4f7b322af3a8b.jpg saved to cache
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 109b3c28-e239-5f37-a909-b2f358343f59
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_17279768bd0d83a9c2f5fa181ee5492f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_17279768bd0d83a9c2f5fa181ee5492f.jpg not downloaded yet
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_63ae17a91528f783c5194d0f131c320a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_63ae17a91528f783c5194d0f131c320a.jpg not downloaded yet
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_c5cd9ea18f0115bcaeea18d43afbd7f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_c5cd9ea18f0115bcaeea18d43afbd7f2.jpg not downloaded yet
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_f54d61bfe46661bbf778e1a5ab4bdb91.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_f54d61bfe46661bbf778e1a5ab4bdb91.jpg not downloaded yet
2026-03-28 18:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6 with identifier: WP34859
2026-03-28 18:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6 with scrape type 1
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fb2%252Fc2b2de8554ec88899955c9374fc357c4%252Fpa%252FWP34859_c24e86396ea57a439bb8902ad31719da.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_c24e86396ea57a439bb8902ad31719da.jpg already downloaded
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fb2%252Fc2b2de8554ec88899955c9374fc357c4%252Fpa%252FWP34859_f29a1e46f1b00d2543054b94156abd0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_f29a1e46f1b00d2543054b94156abd0b.jpg already downloaded
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fb2%252Fc2b2de8554ec88899955c9374fc357c4%252Fpa%252FWP34859_3450e4d2a6b9a5f538913e6770000389.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_3450e4d2a6b9a5f538913e6770000389.jpg already downloaded
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fb2%252Fc2b2de8554ec88899955c9374fc357c4%252Fpa%252FWP34859_64bd6f4a8b804ddc0b1b71f93ed01061.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_64bd6f4a8b804ddc0b1b71f93ed01061.jpg already downloaded
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fb2%252Fc2b2de8554ec88899955c9374fc357c4%252Fpa%252FWP34859_0c362aa749798cbd9e0cbf387452ef3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_0c362aa749798cbd9e0cbf387452ef3c.jpg already downloaded
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fb2%252Fc2b2de8554ec88899955c9374fc357c4%252Fpa%252FWP34859_ad24fc672544b1fe1039450920fc1a9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_ad24fc672544b1fe1039450920fc1a9c.jpg already downloaded
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fb2%252Fc2b2de8554ec88899955c9374fc357c4%252Fpa%252FWP34859_523d55435109d6962a51986ccbff05fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_523d55435109d6962a51986ccbff05fa.jpg already downloaded
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fb2%252Fc2b2de8554ec88899955c9374fc357c4%252Fpa%252FWP34859_9220741aaa2fa6575aeaec3798cd6889.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_9220741aaa2fa6575aeaec3798cd6889.jpg already downloaded
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fb2%252Fc2b2de8554ec88899955c9374fc357c4%252Fpa%252FWP34859_8fe5ef339ac64d45b247b27fefcd3a85.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_8fe5ef339ac64d45b247b27fefcd3a85.jpg already downloaded
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fb2%252Fc2b2de8554ec88899955c9374fc357c4%252Fpa%252FWP34859_dfd5b32e2cd1dff25b6031fc868e9505.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_dfd5b32e2cd1dff25b6031fc868e9505.jpg already downloaded
2026-03-28 18:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6, identifier: WP34859
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_cd0c66d5db6f3401e372a9d7dc0dbb1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_cd0c66d5db6f3401e372a9d7dc0dbb1b.jpg not downloaded yet
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_54b75c2d7510f88e9231aa40b9f29935.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_54b75c2d7510f88e9231aa40b9f29935.jpg not downloaded yet
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_d13b9e10ceae6a96d94422675cfa5efe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_d13b9e10ceae6a96d94422675cfa5efe.jpg not downloaded yet
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_5f3fb705d4e1329247c58397b66e2f32.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_5f3fb705d4e1329247c58397b66e2f32.jpg not downloaded yet
2026-03-28 18:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6 with identifier: WP34859
2026-03-28 18:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6 with identifier: WP34859
2026-03-28 18:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6 with identifier: WP34859 to the API
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WP34859>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:16:38Z',
 'fuel_type': 'petrol',
 'id': '2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP34859',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 131525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_c24e86396ea57a439bb8902ad31719da.jpg',
                'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_f29a1e46f1b00d2543054b94156abd0b.jpg',
                'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_3450e4d2a6b9a5f538913e6770000389.jpg',
                'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_64bd6f4a8b804ddc0b1b71f93ed01061.jpg',
                'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_0c362aa749798cbd9e0cbf387452ef3c.jpg',
                'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_ad24fc672544b1fe1039450920fc1a9c.jpg',
                'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_523d55435109d6962a51986ccbff05fa.jpg',
                'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_9220741aaa2fa6575aeaec3798cd6889.jpg',
                'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_8fe5ef339ac64d45b247b27fefcd3a85.jpg',
                'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_dfd5b32e2cd1dff25b6031fc868e9505.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6/2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_c24e86396ea57a439bb8902ad31719da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6/2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_f29a1e46f1b00d2543054b94156abd0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6/2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_3450e4d2a6b9a5f538913e6770000389.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6/2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_64bd6f4a8b804ddc0b1b71f93ed01061.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6/2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_0c362aa749798cbd9e0cbf387452ef3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6/2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_ad24fc672544b1fe1039450920fc1a9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6/2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_523d55435109d6962a51986ccbff05fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6/2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_9220741aaa2fa6575aeaec3798cd6889.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6/2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_8fe5ef339ac64d45b247b27fefcd3a85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6/2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/b2/c2b2de8554ec88899955c9374fc357c4/pa/WP34859_dfd5b32e2cd1dff25b6031fc868e9505.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2014}
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP34859%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [auto1.de] INFO: Saving data for WP34859: {'created_time': 1774723627.372419, 'last_price_update_time': 1774723627.37243, 'auction_closing_time': 1774883798.0}
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP34859') HTTP/1.1" 204 0
2026-03-28 18:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_41462d4716622c23db714a80453b8712.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_30ab27d346ed256b03a53d735a4f758c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_8ab7ff42f30a4c10e3997d86440771a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_4b2e5f2cdf97b43718acd41b5404ac1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_4b2e5f2cdf97b43718acd41b5404ac1e.jpg not downloaded yet
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_3f987165aead6464799cef76f0e64da9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_3f987165aead6464799cef76f0e64da9.jpg not downloaded yet
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_e66dc95f130827d1d66f2290d7fabb9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_e66dc95f130827d1d66f2290d7fabb9d.jpg not downloaded yet
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_b871237e5470250f401d59a643648718.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_b871237e5470250f401d59a643648718.jpg not downloaded yet
2026-03-28 18:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN17555> (referer: https://www.auto1.com/v1/car-details-view/EN17555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e37dacc-9c41-52a3-90cf-4c72a4137ca0 with identifier: LR58414
2026-03-28 18:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e37dacc-9c41-52a3-90cf-4c72a4137ca0 with scrape type 1
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e37dacc-9c41-52a3-90cf-4c72a4137ca0
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe1%252F0ae19a7bc026a544b3bea8e262fbbed6%252Fpa%252FLR58414_b8671fb189fde0cc3b256b53f5f5495e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_b8671fb189fde0cc3b256b53f5f5495e.jpg already downloaded
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe1%252F0ae19a7bc026a544b3bea8e262fbbed6%252Fpa%252FLR58414_c9aecd22b5302484fde106bbfee32a48.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_c9aecd22b5302484fde106bbfee32a48.jpg already downloaded
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe1%252F0ae19a7bc026a544b3bea8e262fbbed6%252Fpa%252FLR58414_e810ffd704b9dbb6d70b2acbf58d6eb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_e810ffd704b9dbb6d70b2acbf58d6eb8.jpg already downloaded
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe1%252F0ae19a7bc026a544b3bea8e262fbbed6%252Fpa%252FLR58414_bbee71e9d948d222351fb2b61f51d03b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_bbee71e9d948d222351fb2b61f51d03b.jpg already downloaded
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe1%252F0ae19a7bc026a544b3bea8e262fbbed6%252Fpa%252FLR58414_1166be913292134a9b25d0f875a49e96.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_1166be913292134a9b25d0f875a49e96.jpg already downloaded
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe1%252F0ae19a7bc026a544b3bea8e262fbbed6%252Fpa%252FLR58414_c77ca8cb2a7c81a0af7f98c9d6154f2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_c77ca8cb2a7c81a0af7f98c9d6154f2d.jpg already downloaded
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe1%252F0ae19a7bc026a544b3bea8e262fbbed6%252Fpa%252FLR58414_45af0b9976f1b2905873b33463128155.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_45af0b9976f1b2905873b33463128155.jpg already downloaded
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe1%252F0ae19a7bc026a544b3bea8e262fbbed6%252Fpa%252FLR58414_78897cd2d76d5b00d487dfc9516694c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_78897cd2d76d5b00d487dfc9516694c3.jpg already downloaded
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe1%252F0ae19a7bc026a544b3bea8e262fbbed6%252Fpa%252FLR58414_2fd7b4b292864d16c7e6d9fa4c0b89c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_2fd7b4b292864d16c7e6d9fa4c0b89c4.jpg already downloaded
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe1%252F0ae19a7bc026a544b3bea8e262fbbed6%252Fpa%252FLR58414_7b6e61612db50550e21c0042f78a9076.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_7b6e61612db50550e21c0042f78a9076.jpg already downloaded
2026-03-28 18:47:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e37dacc-9c41-52a3-90cf-4c72a4137ca0, identifier: LR58414
2026-03-28 18:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR94395/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e37dacc-9c41-52a3-90cf-4c72a4137ca0 with identifier: LR58414
2026-03-28 18:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e37dacc-9c41-52a3-90cf-4c72a4137ca0 with identifier: LR58414
2026-03-28 18:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e37dacc-9c41-52a3-90cf-4c72a4137ca0 with identifier: LR58414 to the API
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LR58414>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:45:16Z',
 'fuel_type': 'diesel',
 'id': '1e37dacc-9c41-52a3-90cf-4c72a4137ca0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR58414',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Opel',
 'model': 'Insignia Country Tourer',
 'odometer': 124598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_b8671fb189fde0cc3b256b53f5f5495e.jpg',
                'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_c9aecd22b5302484fde106bbfee32a48.jpg',
                'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_e810ffd704b9dbb6d70b2acbf58d6eb8.jpg',
                'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_bbee71e9d948d222351fb2b61f51d03b.jpg',
                'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_1166be913292134a9b25d0f875a49e96.jpg',
                'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_c77ca8cb2a7c81a0af7f98c9d6154f2d.jpg',
                'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_45af0b9976f1b2905873b33463128155.jpg',
                'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_78897cd2d76d5b00d487dfc9516694c3.jpg',
                'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_2fd7b4b292864d16c7e6d9fa4c0b89c4.jpg',
                'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_7b6e61612db50550e21c0042f78a9076.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e37dacc-9c41-52a3-90cf-4c72a4137ca0/1e37dacc-9c41-52a3-90cf-4c72a4137ca0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_b8671fb189fde0cc3b256b53f5f5495e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e37dacc-9c41-52a3-90cf-4c72a4137ca0/1e37dacc-9c41-52a3-90cf-4c72a4137ca0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_c9aecd22b5302484fde106bbfee32a48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e37dacc-9c41-52a3-90cf-4c72a4137ca0/1e37dacc-9c41-52a3-90cf-4c72a4137ca0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_e810ffd704b9dbb6d70b2acbf58d6eb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e37dacc-9c41-52a3-90cf-4c72a4137ca0/1e37dacc-9c41-52a3-90cf-4c72a4137ca0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_bbee71e9d948d222351fb2b61f51d03b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e37dacc-9c41-52a3-90cf-4c72a4137ca0/1e37dacc-9c41-52a3-90cf-4c72a4137ca0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_1166be913292134a9b25d0f875a49e96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e37dacc-9c41-52a3-90cf-4c72a4137ca0/1e37dacc-9c41-52a3-90cf-4c72a4137ca0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_c77ca8cb2a7c81a0af7f98c9d6154f2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e37dacc-9c41-52a3-90cf-4c72a4137ca0/1e37dacc-9c41-52a3-90cf-4c72a4137ca0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_45af0b9976f1b2905873b33463128155.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e37dacc-9c41-52a3-90cf-4c72a4137ca0/1e37dacc-9c41-52a3-90cf-4c72a4137ca0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_78897cd2d76d5b00d487dfc9516694c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e37dacc-9c41-52a3-90cf-4c72a4137ca0/1e37dacc-9c41-52a3-90cf-4c72a4137ca0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_2fd7b4b292864d16c7e6d9fa4c0b89c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e37dacc-9c41-52a3-90cf-4c72a4137ca0/1e37dacc-9c41-52a3-90cf-4c72a4137ca0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e1/0ae19a7bc026a544b3bea8e262fbbed6/pa/LR58414_7b6e61612db50550e21c0042f78a9076.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Country Tourer 2.0 CDTI Basis 4x4',
 'transmission': 'automatic',
 'trim': 'Basis 4x4',
 'year': 2020}
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR58414%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [auto1.de] INFO: Saving data for LR58414: {'created_time': 1774723628.08083, 'last_price_update_time': 1774723628.080841, 'auction_closing_time': 1774885516.0}
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR58414') HTTP/1.1" 204 0
2026-03-28 18:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_3a265799a5401a011022ee6b6fe4199c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_b307f97dba70c2ab62e452e0717593af.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_b307f97dba70c2ab62e452e0717593af.jpg not downloaded yet
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_73fb77616f19245e2d80c79002508a4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_73fb77616f19245e2d80c79002508a4c.jpg not downloaded yet
2026-03-28 18:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_bdcdf287dbd2516b365f7536698f069f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP30052> (referer: https://www.auto1.com/v1/car-details-view/HP30052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_3f7ec5ebd012fb0c3f2e1d916490ec4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_d5762c10a3c9285ae2b4d2744ee3d82d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_d5762c10a3c9285ae2b4d2744ee3d82d.jpg not downloaded yet
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_3563e9145aae660c966b67e33c1b3399.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_3563e9145aae660c966b67e33c1b3399.jpg not downloaded yet
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245615ae90>
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_41462d4716622c23db714a80453b8712.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_41462d4716622c23db714a80453b8712.jpg saved to cache
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25717195-72f7-597e-b717-9518c2f31283
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562c6f50>
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_30ab27d346ed256b03a53d735a4f758c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_30ab27d346ed256b03a53d735a4f758c.jpg saved to cache
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25717195-72f7-597e-b717-9518c2f31283
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560964d0>
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_8ab7ff42f30a4c10e3997d86440771a9.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_8ab7ff42f30a4c10e3997d86440771a9.jpg saved to cache
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705
2026-03-28 18:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac with identifier: EN17555
2026-03-28 18:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac with scrape type 1
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F70431b82519eb2497fc03a55df8176be%252Fpa%252FEN17555_dbfea706310a68a4ef9f373de626b1c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_dbfea706310a68a4ef9f373de626b1c5.jpg not downloaded yet
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_b3fa98e54fe5e3105da26bb98439ec65.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_b3fa98e54fe5e3105da26bb98439ec65.jpg not downloaded yet
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F70431b82519eb2497fc03a55df8176be%252Fpa%252FEN17555_06619575072cf6b4241e6b1caf3e4073.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_06619575072cf6b4241e6b1caf3e4073.jpg not downloaded yet
2026-03-28 18:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_b7250f822d37a93fbfe12751a1e79407.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456433190>
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_3a265799a5401a011022ee6b6fe4199c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_3a265799a5401a011022ee6b6fe4199c.jpg saved to cache
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f758484-a291-5788-ad42-3b6ac222f6e8
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bd610>
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_bdcdf287dbd2516b365f7536698f069f.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_bdcdf287dbd2516b365f7536698f069f.jpg saved to cache
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f758484-a291-5788-ad42-3b6ac222f6e8
2026-03-28 18:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dacbc264-ffe0-58ec-b786-e41a842ba298 with identifier: HP30052
2026-03-28 18:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dacbc264-ffe0-58ec-b786-e41a842ba298 with scrape type 1
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item dacbc264-ffe0-58ec-b786-e41a842ba298
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F24%252F912473f5ad47f8e368399c454eab3dbf%252Fpa%252FHP30052_e42c5938e7579cd522ed38a6f9e50c82.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_e42c5938e7579cd522ed38a6f9e50c82.jpg already downloaded
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F24%252F912473f5ad47f8e368399c454eab3dbf%252Fpa%252FHP30052_81db36f5f2eabee2ac48cd3cf009bbbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_81db36f5f2eabee2ac48cd3cf009bbbf.jpg already downloaded
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F24%252F912473f5ad47f8e368399c454eab3dbf%252Fpa%252FHP30052_e814692b7c6312d17ae422f2e9d4640b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_e814692b7c6312d17ae422f2e9d4640b.jpg already downloaded
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F24%252F912473f5ad47f8e368399c454eab3dbf%252Fpa%252FHP30052_5b7352a1858f9dadaf6bd7a2802c030c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_5b7352a1858f9dadaf6bd7a2802c030c.jpg already downloaded
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F24%252F912473f5ad47f8e368399c454eab3dbf%252Fpa%252FHP30052_0e2aff62fe8683bce44fdd2cea861b4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_0e2aff62fe8683bce44fdd2cea861b4c.jpg already downloaded
2026-03-28 18:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dacbc264-ffe0-58ec-b786-e41a842ba298, identifier: HP30052
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456096e50>
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_3f7ec5ebd012fb0c3f2e1d916490ec4c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_3f7ec5ebd012fb0c3f2e1d916490ec4c.jpg saved to cache
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e94baef6-b842-55e6-923c-72dfd63cd195
2026-03-28 18:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_5f3fb705d4e1329247c58397b66e2f32.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F70431b82519eb2497fc03a55df8176be%252Fpa%252FEN17555_302f7cccf0752e3a5eb8a402c9ed87ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_302f7cccf0752e3a5eb8a402c9ed87ab.jpg not downloaded yet
2026-03-28 18:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dacbc264-ffe0-58ec-b786-e41a842ba298 with identifier: HP30052
2026-03-28 18:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dacbc264-ffe0-58ec-b786-e41a842ba298 with identifier: HP30052
2026-03-28 18:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dacbc264-ffe0-58ec-b786-e41a842ba298 with identifier: HP30052 to the API
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HP30052>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:22:49Z',
 'fuel_type': 'petrol',
 'id': 'dacbc264-ffe0-58ec-b786-e41a842ba298',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP30052',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 111011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_e42c5938e7579cd522ed38a6f9e50c82.jpg',
                'https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_81db36f5f2eabee2ac48cd3cf009bbbf.jpg',
                'https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_e814692b7c6312d17ae422f2e9d4640b.jpg',
                'https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_5b7352a1858f9dadaf6bd7a2802c030c.jpg',
                'https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_0e2aff62fe8683bce44fdd2cea861b4c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dacbc264-ffe0-58ec-b786-e41a842ba298/dacbc264-ffe0-58ec-b786-e41a842ba298_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_e42c5938e7579cd522ed38a6f9e50c82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dacbc264-ffe0-58ec-b786-e41a842ba298/dacbc264-ffe0-58ec-b786-e41a842ba298_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_81db36f5f2eabee2ac48cd3cf009bbbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dacbc264-ffe0-58ec-b786-e41a842ba298/dacbc264-ffe0-58ec-b786-e41a842ba298_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_e814692b7c6312d17ae422f2e9d4640b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dacbc264-ffe0-58ec-b786-e41a842ba298/dacbc264-ffe0-58ec-b786-e41a842ba298_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_5b7352a1858f9dadaf6bd7a2802c030c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dacbc264-ffe0-58ec-b786-e41a842ba298/dacbc264-ffe0-58ec-b786-e41a842ba298_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/24/912473f5ad47f8e368399c454eab3dbf/pa/HP30052_0e2aff62fe8683bce44fdd2cea861b4c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP30052%27 HTTP/1.1" 200 None
2026-03-28 18:47:09 [auto1.de] INFO: Saving data for HP30052: {'created_time': 1774723629.071012, 'last_price_update_time': 1774723629.071023, 'auction_closing_time': 1774884169.0}
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP30052') HTTP/1.1" 204 0
2026-03-28 18:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_d13b9e10ceae6a96d94422675cfa5efe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_54b75c2d7510f88e9231aa40b9f29935.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F70431b82519eb2497fc03a55df8176be%252Fpa%252FEN17555_0981f0c039ddd4b3dded33ae688fa160.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_0981f0c039ddd4b3dded33ae688fa160.jpg not downloaded yet
2026-03-28 18:47:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454710210>
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_b7250f822d37a93fbfe12751a1e79407.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_b7250f822d37a93fbfe12751a1e79407.jpg saved to cache
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cbec23ff-f10f-568f-8aca-93619b9d2662
2026-03-28 18:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_b871237e5470250f401d59a643648718.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL40501> (referer: https://www.auto1.com/v1/car-details-view/AL40501/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546e0410>
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_5f3fb705d4e1329247c58397b66e2f32.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_5f3fb705d4e1329247c58397b66e2f32.jpg saved to cache
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25717195-72f7-597e-b717-9518c2f31283
2026-03-28 18:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_d618a7c477daa58a5207626bfd6493cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F70431b82519eb2497fc03a55df8176be%252Fpa%252FEN17555_62ee9da4b16615d6c42a5a4672d79f92.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_62ee9da4b16615d6c42a5a4672d79f92.jpg not downloaded yet
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546615d0>
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_d13b9e10ceae6a96d94422675cfa5efe.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_d13b9e10ceae6a96d94422675cfa5efe.jpg saved to cache
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e94baef6-b842-55e6-923c-72dfd63cd195
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245649aa50>
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_54b75c2d7510f88e9231aa40b9f29935.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_54b75c2d7510f88e9231aa40b9f29935.jpg saved to cache
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705
2026-03-28 18:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_73fb77616f19245e2d80c79002508a4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638c950>
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_b871237e5470250f401d59a643648718.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_b871237e5470250f401d59a643648718.jpg saved to cache
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25717195-72f7-597e-b717-9518c2f31283
2026-03-28 18:47:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20e7b8cf-e483-5612-9da2-b577de5a4306 with identifier: AL40501
2026-03-28 18:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e7b8cf-e483-5612-9da2-b577de5a4306 with scrape type 1
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20e7b8cf-e483-5612-9da2-b577de5a4306
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_0f5c8eec8277f0bea30241e5b0d81738.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_0f5c8eec8277f0bea30241e5b0d81738.jpg not downloaded yet
2026-03-28 18:47:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618f950>
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6a%252Fe46a638e210f9531f4e08d168db40248%252Fpa%252FMP14986_d618a7c477daa58a5207626bfd6493cd.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_d618a7c477daa58a5207626bfd6493cd.jpg saved to cache
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cbec23ff-f10f-568f-8aca-93619b9d2662
2026-03-28 18:47:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cbec23ff-f10f-568f-8aca-93619b9d2662, skipping ID generation
2026-03-28 18:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbec23ff-f10f-568f-8aca-93619b9d2662 with scrape type 1
2026-03-28 18:47:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cbec23ff-f10f-568f-8aca-93619b9d2662 sending to next pipeline
2026-03-28 18:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbec23ff-f10f-568f-8aca-93619b9d2662, identifier: MP14986
2026-03-28 18:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbec23ff-f10f-568f-8aca-93619b9d2662 with identifier: MP14986
2026-03-28 18:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbec23ff-f10f-568f-8aca-93619b9d2662 with identifier: MP14986
2026-03-28 18:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbec23ff-f10f-568f-8aca-93619b9d2662 with identifier: MP14986 to the API
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_d618a7c477daa58a5207626bfd6493cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:29Z',
 'fuel_type': 'petrol',
 'id': 'cbec23ff-f10f-568f-8aca-93619b9d2662',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP14986',
 'listing': 'auction',
 'location': 'DE, Tradein',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 114148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3362063,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_f98e93547f3c6528fc48747effa9c8c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3262539,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_ca7dd8e23b31d5e72cabd9c0c24de299.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2435827,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_b4780e437a506c01f84a6be06ad173a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_a7a76722ed97fe71b412be9a69d02758.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2230855,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_5f35790a482be4433e43dce770f9c3b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542889,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_b7250f822d37a93fbfe12751a1e79407.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2089330,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_08afdf473eca3165236745676178bc2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2500541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_53dab351b83d4d4a3ec34eeb7e761548.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3296885,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_d618a7c477daa58a5207626bfd6493cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbec23ff-f10f-568f-8aca-93619b9d2662/cbec23ff-f10f-568f-8aca-93619b9d2662_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2128255,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6a/e46a638e210f9531f4e08d168db40248/pa/MP14986_39d74435208f350b1a4ce30243ddf54a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP14986%27 HTTP/1.1" 200 None
2026-03-28 18:47:10 [auto1.de] INFO: Saving data for MP14986: {'created_time': 1774723630.062835, 'last_price_update_time': 1774723630.062847, 'auction_closing_time': 1774883069.0}
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP14986') HTTP/1.1" 204 0
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_38eb9969f7837c64c07bc6fee35c2803.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_38eb9969f7837c64c07bc6fee35c2803.jpg not downloaded yet
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_3f987165aead6464799cef76f0e64da9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_06619575072cf6b4241e6b1caf3e4073.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638ecd0>
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_73fb77616f19245e2d80c79002508a4c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_73fb77616f19245e2d80c79002508a4c.jpg saved to cache
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25717195-72f7-597e-b717-9518c2f31283
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_ebffc44cd3c6d3407603c3b94e828f55.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_ebffc44cd3c6d3407603c3b94e828f55.jpg not downloaded yet
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_4b2e5f2cdf97b43718acd41b5404ac1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_8bf875f4b086f1801c8bf1c9feee4eda.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_8bf875f4b086f1801c8bf1c9feee4eda.jpg not downloaded yet
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_47989783480cd6e35262abd939d96f2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_47989783480cd6e35262abd939d96f2f.jpg not downloaded yet
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_b3fa98e54fe5e3105da26bb98439ec65.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_0e50c3843a7f57cae64df2d2d0dc3d12.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_0e50c3843a7f57cae64df2d2d0dc3d12.jpg not downloaded yet
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_947ce2a94f0a5dd8051c161f8790ff1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_947ce2a94f0a5dd8051c161f8790ff1d.jpg not downloaded yet
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456193190>
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_3f987165aead6464799cef76f0e64da9.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_3f987165aead6464799cef76f0e64da9.jpg saved to cache
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547d20d0>
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b8ba5d-a6d6-5007-a0e8-625995e9b2ac/43b8ba5d-a6d6-5007-a0e8-625995e9b2ac_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F70431b82519eb2497fc03a55df8176be%252Fpa%252FEN17555_06619575072cf6b4241e6b1caf3e4073.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_06619575072cf6b4241e6b1caf3e4073.jpg saved to cache
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_e51bda988338da39cd402e1f08a060df.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_e51bda988338da39cd402e1f08a060df.jpg not downloaded yet
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_dbfea706310a68a4ef9f373de626b1c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_964df0df57eaca18662f8dfcef24a349.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_964df0df57eaca18662f8dfcef24a349.jpg not downloaded yet
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_efca9789d6d225b3592a0bcbe6f58506.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_efca9789d6d225b3592a0bcbe6f58506.jpg not downloaded yet
2026-03-28 18:47:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560d3690>
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_4b2e5f2cdf97b43718acd41b5404ac1e.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_4b2e5f2cdf97b43718acd41b5404ac1e.jpg saved to cache
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f758484-a291-5788-ad42-3b6ac222f6e8
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b27d0>
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_b3fa98e54fe5e3105da26bb98439ec65.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_b3fa98e54fe5e3105da26bb98439ec65.jpg saved to cache
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25717195-72f7-597e-b717-9518c2f31283
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_302f7cccf0752e3a5eb8a402c9ed87ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_0981f0c039ddd4b3dded33ae688fa160.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_3563e9145aae660c966b67e33c1b3399.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_7f5b8ce76f801ec7a0e8872c2ce93e94.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456193050>
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b8ba5d-a6d6-5007-a0e8-625995e9b2ac/43b8ba5d-a6d6-5007-a0e8-625995e9b2ac_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F70431b82519eb2497fc03a55df8176be%252Fpa%252FEN17555_dbfea706310a68a4ef9f373de626b1c5.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_dbfea706310a68a4ef9f373de626b1c5.jpg saved to cache
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_e96bac1664868f1fee233a3aeba0555c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_0f5c8eec8277f0bea30241e5b0d81738.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_82a318dea8f8ebe9da03757751ae8340.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_e66dc95f130827d1d66f2290d7fabb9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_b307f97dba70c2ab62e452e0717593af.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245610e910>
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b8ba5d-a6d6-5007-a0e8-625995e9b2ac/43b8ba5d-a6d6-5007-a0e8-625995e9b2ac_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F70431b82519eb2497fc03a55df8176be%252Fpa%252FEN17555_302f7cccf0752e3a5eb8a402c9ed87ab.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_302f7cccf0752e3a5eb8a402c9ed87ab.jpg saved to cache
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561d8b50>
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b8ba5d-a6d6-5007-a0e8-625995e9b2ac/43b8ba5d-a6d6-5007-a0e8-625995e9b2ac_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F70431b82519eb2497fc03a55df8176be%252Fpa%252FEN17555_0981f0c039ddd4b3dded33ae688fa160.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_0981f0c039ddd4b3dded33ae688fa160.jpg saved to cache
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245630ae10>
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_3563e9145aae660c966b67e33c1b3399.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_3563e9145aae660c966b67e33c1b3399.jpg saved to cache
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25717195-72f7-597e-b717-9518c2f31283
2026-03-28 18:47:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b5b90>
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_7f5b8ce76f801ec7a0e8872c2ce93e94.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_7f5b8ce76f801ec7a0e8872c2ce93e94.jpg saved to cache
2026-03-28 18:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9b961ea-ec5b-556d-8337-e84209cb427a
2026-03-28 18:47:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561da010>
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_e96bac1664868f1fee233a3aeba0555c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_e96bac1664868f1fee233a3aeba0555c.jpg saved to cache
2026-03-28 18:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e94baef6-b842-55e6-923c-72dfd63cd195
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245608ded0>
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_0f5c8eec8277f0bea30241e5b0d81738.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_0f5c8eec8277f0bea30241e5b0d81738.jpg saved to cache
2026-03-28 18:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20e7b8cf-e483-5612-9da2-b577de5a4306
2026-03-28 18:47:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546625d0>
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_82a318dea8f8ebe9da03757751ae8340.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_82a318dea8f8ebe9da03757751ae8340.jpg saved to cache
2026-03-28 18:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705
2026-03-28 18:47:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456535410>
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_e66dc95f130827d1d66f2290d7fabb9d.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_e66dc95f130827d1d66f2290d7fabb9d.jpg saved to cache
2026-03-28 18:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e94baef6-b842-55e6-923c-72dfd63cd195
2026-03-28 18:47:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561da190>
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_b307f97dba70c2ab62e452e0717593af.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_b307f97dba70c2ab62e452e0717593af.jpg saved to cache
2026-03-28 18:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e94baef6-b842-55e6-923c-72dfd63cd195
2026-03-28 18:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_62ee9da4b16615d6c42a5a4672d79f92.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_e51bda988338da39cd402e1f08a060df.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR94395> (referer: https://www.auto1.com/v1/car-details-view/AR94395/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_d5762c10a3c9285ae2b4d2744ee3d82d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_efca9789d6d225b3592a0bcbe6f58506.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_947ce2a94f0a5dd8051c161f8790ff1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_47989783480cd6e35262abd939d96f2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_964df0df57eaca18662f8dfcef24a349.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_ebffc44cd3c6d3407603c3b94e828f55.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561a6410>
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b8ba5d-a6d6-5007-a0e8-625995e9b2ac/43b8ba5d-a6d6-5007-a0e8-625995e9b2ac_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F43%252F70431b82519eb2497fc03a55df8176be%252Fpa%252FEN17555_62ee9da4b16615d6c42a5a4672d79f92.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_62ee9da4b16615d6c42a5a4672d79f92.jpg saved to cache
2026-03-28 18:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac
2026-03-28 18:47:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac, skipping ID generation
2026-03-28 18:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac with scrape type 1
2026-03-28 18:47:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac sending to next pipeline
2026-03-28 18:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac, identifier: EN17555
2026-03-28 18:47:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac with identifier: EN17555
2026-03-28 18:47:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac with identifier: EN17555
2026-03-28 18:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac with identifier: EN17555 to the API
2026-03-28 18:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_62ee9da4b16615d6c42a5a4672d79f92.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:07:30Z',
 'fuel_type': 'petrol',
 'id': '43b8ba5d-a6d6-5007-a0e8-625995e9b2ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN17555',
 'listing': 'auction',
 'location': 'DE, Hamburg-Billstedt',
 'make': 'Volkswagen',
 'model': 'Fox',
 'odometer': 120654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b8ba5d-a6d6-5007-a0e8-625995e9b2ac/43b8ba5d-a6d6-5007-a0e8-625995e9b2ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_dbfea706310a68a4ef9f373de626b1c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b8ba5d-a6d6-5007-a0e8-625995e9b2ac/43b8ba5d-a6d6-5007-a0e8-625995e9b2ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_06619575072cf6b4241e6b1caf3e4073.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b8ba5d-a6d6-5007-a0e8-625995e9b2ac/43b8ba5d-a6d6-5007-a0e8-625995e9b2ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_302f7cccf0752e3a5eb8a402c9ed87ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b8ba5d-a6d6-5007-a0e8-625995e9b2ac/43b8ba5d-a6d6-5007-a0e8-625995e9b2ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_0981f0c039ddd4b3dded33ae688fa160.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b8ba5d-a6d6-5007-a0e8-625995e9b2ac/43b8ba5d-a6d6-5007-a0e8-625995e9b2ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/43/70431b82519eb2497fc03a55df8176be/pa/EN17555_62ee9da4b16615d6c42a5a4672d79f92.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Fox 1.2 Refresh',
 'transmission': 'manual',
 'trim': 'Refresh',
 'year': 2010}
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN17555%27 HTTP/1.1" 200 None
2026-03-28 18:47:12 [auto1.de] INFO: Saving data for EN17555: {'created_time': 1774723632.221541, 'last_price_update_time': 1774723632.221553, 'auction_closing_time': 1774883250.0}
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN17555') HTTP/1.1" 204 0
2026-03-28 18:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_0e50c3843a7f57cae64df2d2d0dc3d12.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_8bf875f4b086f1801c8bf1c9feee4eda.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_f54d61bfe46661bbf778e1a5ab4bdb91.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561a4390>
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_e51bda988338da39cd402e1f08a060df.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_e51bda988338da39cd402e1f08a060df.jpg saved to cache
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20e7b8cf-e483-5612-9da2-b577de5a4306
2026-03-28 18:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e78c6449-b93f-5723-804c-e569d07b8637 with identifier: AR94395
2026-03-28 18:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78c6449-b93f-5723-804c-e569d07b8637 with scrape type 1
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e78c6449-b93f-5723-804c-e569d07b8637
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345ee83d339469400470870eb4947d4d%252Fpa%252FAR94395_f6de4af1f8da4d1f9356d85214527414.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_f6de4af1f8da4d1f9356d85214527414.jpg already downloaded
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345ee83d339469400470870eb4947d4d%252Fpa%252FAR94395_c97ecdaa4b8f5ac89d69324f91dc940a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_c97ecdaa4b8f5ac89d69324f91dc940a.jpg already downloaded
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345ee83d339469400470870eb4947d4d%252Fpa%252FAR94395_bec8fc189f97c5814fc5862200dd9ff2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_bec8fc189f97c5814fc5862200dd9ff2.jpg already downloaded
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345ee83d339469400470870eb4947d4d%252Fpa%252FAR94395_f81c8c07e2df7d0debc4a89e3aaeeabb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_f81c8c07e2df7d0debc4a89e3aaeeabb.jpg already downloaded
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345ee83d339469400470870eb4947d4d%252Fpa%252FAR94395_387942bca8e2f8e8c6cd59f0ea8cb5f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_387942bca8e2f8e8c6cd59f0ea8cb5f9.jpg already downloaded
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345ee83d339469400470870eb4947d4d%252Fpa%252FAR94395_42aa97bd855ad3a579736cb382733884.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_42aa97bd855ad3a579736cb382733884.jpg already downloaded
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345ee83d339469400470870eb4947d4d%252Fpa%252FAR94395_f00c4663027571ce82ab34fa5dace24f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_f00c4663027571ce82ab34fa5dace24f.jpg already downloaded
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345ee83d339469400470870eb4947d4d%252Fpa%252FAR94395_0603895ddc9eef0ed1c715dcc18b0bb3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_0603895ddc9eef0ed1c715dcc18b0bb3.jpg already downloaded
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345ee83d339469400470870eb4947d4d%252Fpa%252FAR94395_d7dcede29f719a93cba8dd9becb9520e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_d7dcede29f719a93cba8dd9becb9520e.jpg already downloaded
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345ee83d339469400470870eb4947d4d%252Fpa%252FAR94395_5237cff7177dcb25fbb5a6d1da6330f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_5237cff7177dcb25fbb5a6d1da6330f8.jpg already downloaded
2026-03-28 18:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e78c6449-b93f-5723-804c-e569d07b8637, identifier: AR94395
2026-03-28 18:47:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245628fad0>
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_d5762c10a3c9285ae2b4d2744ee3d82d.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_d5762c10a3c9285ae2b4d2744ee3d82d.jpg saved to cache
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e94baef6-b842-55e6-923c-72dfd63cd195
2026-03-28 18:47:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245624f650>
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_efca9789d6d225b3592a0bcbe6f58506.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_efca9789d6d225b3592a0bcbe6f58506.jpg saved to cache
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20e7b8cf-e483-5612-9da2-b577de5a4306
2026-03-28 18:47:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245627f350>
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_947ce2a94f0a5dd8051c161f8790ff1d.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_947ce2a94f0a5dd8051c161f8790ff1d.jpg saved to cache
2026-03-28 18:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20e7b8cf-e483-5612-9da2-b577de5a4306
2026-03-28 18:47:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562e2510>
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_47989783480cd6e35262abd939d96f2f.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_47989783480cd6e35262abd939d96f2f.jpg saved to cache
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20e7b8cf-e483-5612-9da2-b577de5a4306
2026-03-28 18:47:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456274050>
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_964df0df57eaca18662f8dfcef24a349.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_964df0df57eaca18662f8dfcef24a349.jpg saved to cache
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20e7b8cf-e483-5612-9da2-b577de5a4306
2026-03-28 18:47:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454665950>
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_ebffc44cd3c6d3407603c3b94e828f55.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_ebffc44cd3c6d3407603c3b94e828f55.jpg saved to cache
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20e7b8cf-e483-5612-9da2-b577de5a4306
2026-03-28 18:47:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e78c6449-b93f-5723-804c-e569d07b8637 with identifier: AR94395
2026-03-28 18:47:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e78c6449-b93f-5723-804c-e569d07b8637 with identifier: AR94395
2026-03-28 18:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e78c6449-b93f-5723-804c-e569d07b8637 with identifier: AR94395 to the API
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AR94395>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:37:07Z',
 'fuel_type': 'petrol',
 'id': 'e78c6449-b93f-5723-804c-e569d07b8637',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR94395',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 61273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_f6de4af1f8da4d1f9356d85214527414.jpg',
                'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_c97ecdaa4b8f5ac89d69324f91dc940a.jpg',
                'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_bec8fc189f97c5814fc5862200dd9ff2.jpg',
                'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_f81c8c07e2df7d0debc4a89e3aaeeabb.jpg',
                'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_387942bca8e2f8e8c6cd59f0ea8cb5f9.jpg',
                'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_42aa97bd855ad3a579736cb382733884.jpg',
                'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_f00c4663027571ce82ab34fa5dace24f.jpg',
                'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_0603895ddc9eef0ed1c715dcc18b0bb3.jpg',
                'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_d7dcede29f719a93cba8dd9becb9520e.jpg',
                'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_5237cff7177dcb25fbb5a6d1da6330f8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78c6449-b93f-5723-804c-e569d07b8637/e78c6449-b93f-5723-804c-e569d07b8637_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_f6de4af1f8da4d1f9356d85214527414.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78c6449-b93f-5723-804c-e569d07b8637/e78c6449-b93f-5723-804c-e569d07b8637_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_c97ecdaa4b8f5ac89d69324f91dc940a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78c6449-b93f-5723-804c-e569d07b8637/e78c6449-b93f-5723-804c-e569d07b8637_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_bec8fc189f97c5814fc5862200dd9ff2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78c6449-b93f-5723-804c-e569d07b8637/e78c6449-b93f-5723-804c-e569d07b8637_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_f81c8c07e2df7d0debc4a89e3aaeeabb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78c6449-b93f-5723-804c-e569d07b8637/e78c6449-b93f-5723-804c-e569d07b8637_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_387942bca8e2f8e8c6cd59f0ea8cb5f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78c6449-b93f-5723-804c-e569d07b8637/e78c6449-b93f-5723-804c-e569d07b8637_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_42aa97bd855ad3a579736cb382733884.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78c6449-b93f-5723-804c-e569d07b8637/e78c6449-b93f-5723-804c-e569d07b8637_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_f00c4663027571ce82ab34fa5dace24f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78c6449-b93f-5723-804c-e569d07b8637/e78c6449-b93f-5723-804c-e569d07b8637_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_0603895ddc9eef0ed1c715dcc18b0bb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78c6449-b93f-5723-804c-e569d07b8637/e78c6449-b93f-5723-804c-e569d07b8637_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_d7dcede29f719a93cba8dd9becb9520e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78c6449-b93f-5723-804c-e569d07b8637/e78c6449-b93f-5723-804c-e569d07b8637_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345ee83d339469400470870eb4947d4d/pa/AR94395_5237cff7177dcb25fbb5a6d1da6330f8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.2 YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2017}
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR94395%27 HTTP/1.1" 200 None
2026-03-28 18:47:13 [auto1.de] INFO: Saving data for AR94395: {'created_time': 1774723633.629855, 'last_price_update_time': 1774723633.629868, 'auction_closing_time': 1774885027.0}
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR94395') HTTP/1.1" 204 0
2026-03-28 18:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_cd0c66d5db6f3401e372a9d7dc0dbb1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_17279768bd0d83a9c2f5fa181ee5492f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245648b390>
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_0e50c3843a7f57cae64df2d2d0dc3d12.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_0e50c3843a7f57cae64df2d2d0dc3d12.jpg saved to cache
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20e7b8cf-e483-5612-9da2-b577de5a4306
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561911d0>
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_8bf875f4b086f1801c8bf1c9feee4eda.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_8bf875f4b086f1801c8bf1c9feee4eda.jpg saved to cache
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20e7b8cf-e483-5612-9da2-b577de5a4306
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456418c90>
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_f54d61bfe46661bbf778e1a5ab4bdb91.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_f54d61bfe46661bbf778e1a5ab4bdb91.jpg saved to cache
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25717195-72f7-597e-b717-9518c2f31283
2026-03-28 18:47:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245620d2d0>
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_cd0c66d5db6f3401e372a9d7dc0dbb1b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_cd0c66d5db6f3401e372a9d7dc0dbb1b.jpg saved to cache
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f758484-a291-5788-ad42-3b6ac222f6e8
2026-03-28 18:47:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855bcd0>
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_17279768bd0d83a9c2f5fa181ee5492f.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_17279768bd0d83a9c2f5fa181ee5492f.jpg saved to cache
2026-03-28 18:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f758484-a291-5788-ad42-3b6ac222f6e8
2026-03-28 18:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_8d03ee505a1e3f164e70ec8c46d668ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_837d1cd1e97372fccff970d415faf9b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_b995e380133171c86bc5e9b0ea938ad3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_20c73b78763a6ed508dd960c726e4b01.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_63ae17a91528f783c5194d0f131c320a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_c5cd9ea18f0115bcaeea18d43afbd7f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_38eb9969f7837c64c07bc6fee35c2803.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_4d2c2951dc2ea34deb16bfe356f17f79.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563e94d0>
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_8d03ee505a1e3f164e70ec8c46d668ac.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_8d03ee505a1e3f164e70ec8c46d668ac.jpg saved to cache
2026-03-28 18:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25717195-72f7-597e-b717-9518c2f31283
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563e8490>
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F0a%252F670a7fd02a7e39cd460b77f1f2e34aa4%252Fpa%252FKB26549_837d1cd1e97372fccff970d415faf9b4.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_837d1cd1e97372fccff970d415faf9b4.jpg saved to cache
2026-03-28 18:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25717195-72f7-597e-b717-9518c2f31283
2026-03-28 18:47:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25717195-72f7-597e-b717-9518c2f31283, skipping ID generation
2026-03-28 18:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25717195-72f7-597e-b717-9518c2f31283 with scrape type 1
2026-03-28 18:47:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25717195-72f7-597e-b717-9518c2f31283 sending to next pipeline
2026-03-28 18:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25717195-72f7-597e-b717-9518c2f31283, identifier: KB26549
2026-03-28 18:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_57084ffaf15002e5abdfc9755a1489f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25717195-72f7-597e-b717-9518c2f31283 with identifier: KB26549
2026-03-28 18:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25717195-72f7-597e-b717-9518c2f31283 with identifier: KB26549
2026-03-28 18:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25717195-72f7-597e-b717-9518c2f31283 with identifier: KB26549 to the API
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_837d1cd1e97372fccff970d415faf9b4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:09:19Z',
 'fuel_type': 'petrol',
 'id': '25717195-72f7-597e-b717-9518c2f31283',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB26549',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 129297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_837d1cd1e97372fccff970d415faf9b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_30ab27d346ed256b03a53d735a4f758c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_41462d4716622c23db714a80453b8712.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_8d03ee505a1e3f164e70ec8c46d668ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_f54d61bfe46661bbf778e1a5ab4bdb91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_5f3fb705d4e1329247c58397b66e2f32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_b871237e5470250f401d59a643648718.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_73fb77616f19245e2d80c79002508a4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_3563e9145aae660c966b67e33c1b3399.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25717195-72f7-597e-b717-9518c2f31283/25717195-72f7-597e-b717-9518c2f31283_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/0a/670a7fd02a7e39cd460b77f1f2e34aa4/pa/KB26549_b3fa98e54fe5e3105da26bb98439ec65.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Duster 1.6 Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2011}
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB26549%27 HTTP/1.1" 200 None
2026-03-28 18:47:14 [auto1.de] INFO: Saving data for KB26549: {'created_time': 1774723634.643612, 'last_price_update_time': 1774723634.643626, 'auction_closing_time': 1774883359.0}
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB26549') HTTP/1.1" 204 0
2026-03-28 18:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_cc27a3ae48ec66ae3ce2a800c25af80b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_ffd0536ebd15b7a5a756b249e3c55709.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245641b990>
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_b995e380133171c86bc5e9b0ea938ad3.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_b995e380133171c86bc5e9b0ea938ad3.jpg saved to cache
2026-03-28 18:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e94baef6-b842-55e6-923c-72dfd63cd195
2026-03-28 18:47:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b6450>
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_20c73b78763a6ed508dd960c726e4b01.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_20c73b78763a6ed508dd960c726e4b01.jpg saved to cache
2026-03-28 18:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f758484-a291-5788-ad42-3b6ac222f6e8
2026-03-28 18:47:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561d3790>
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_63ae17a91528f783c5194d0f131c320a.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_63ae17a91528f783c5194d0f131c320a.jpg saved to cache
2026-03-28 18:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705
2026-03-28 18:47:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562c4f90>
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_c5cd9ea18f0115bcaeea18d43afbd7f2.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_c5cd9ea18f0115bcaeea18d43afbd7f2.jpg saved to cache
2026-03-28 18:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e94baef6-b842-55e6-923c-72dfd63cd195
2026-03-28 18:47:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245467d850>
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F5f%252Fc05fff8f456c580d5d9cea3c504cee35%252Fpa%252FAL40501_38eb9969f7837c64c07bc6fee35c2803.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_38eb9969f7837c64c07bc6fee35c2803.jpg saved to cache
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20e7b8cf-e483-5612-9da2-b577de5a4306
2026-03-28 18:47:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20e7b8cf-e483-5612-9da2-b577de5a4306, skipping ID generation
2026-03-28 18:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e7b8cf-e483-5612-9da2-b577de5a4306 with scrape type 1
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20e7b8cf-e483-5612-9da2-b577de5a4306 sending to next pipeline
2026-03-28 18:47:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20e7b8cf-e483-5612-9da2-b577de5a4306, identifier: AL40501
2026-03-28 18:47:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477fad0>
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_4d2c2951dc2ea34deb16bfe356f17f79.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_4d2c2951dc2ea34deb16bfe356f17f79.jpg saved to cache
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705
2026-03-28 18:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_2e6f91b98a902c47f3b98cdd085cddd9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD78650> (referer: https://www.auto1.com/v1/car-details-view/LD78650/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20e7b8cf-e483-5612-9da2-b577de5a4306 with identifier: AL40501
2026-03-28 18:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20e7b8cf-e483-5612-9da2-b577de5a4306 with identifier: AL40501
2026-03-28 18:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20e7b8cf-e483-5612-9da2-b577de5a4306 with identifier: AL40501 to the API
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_38eb9969f7837c64c07bc6fee35c2803.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:58:03Z',
 'fuel_type': 'petrol',
 'id': '20e7b8cf-e483-5612-9da2-b577de5a4306',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL40501',
 'listing': 'auction',
 'location': 'DE, Kaiserslautern',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 100078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_0f5c8eec8277f0bea30241e5b0d81738.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3128702,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_38eb9969f7837c64c07bc6fee35c2803.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3441294,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_ebffc44cd3c6d3407603c3b94e828f55.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_8bf875f4b086f1801c8bf1c9feee4eda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3139122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_47989783480cd6e35262abd939d96f2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_0e50c3843a7f57cae64df2d2d0dc3d12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3222620,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_947ce2a94f0a5dd8051c161f8790ff1d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_e51bda988338da39cd402e1f08a060df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3292921,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_964df0df57eaca18662f8dfcef24a349.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20e7b8cf-e483-5612-9da2-b577de5a4306/20e7b8cf-e483-5612-9da2-b577de5a4306_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2840856,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/5f/c05fff8f456c580d5d9cea3c504cee35/pa/AL40501_efca9789d6d225b3592a0bcbe6f58506.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2015}
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL40501%27 HTTP/1.1" 200 None
2026-03-28 18:47:15 [auto1.de] INFO: Saving data for AL40501: {'created_time': 1774723635.69187, 'last_price_update_time': 1774723635.691882, 'auction_closing_time': 1774886283.0}
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL40501') HTTP/1.1" 204 0
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564b9b90>
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109b3c28-e239-5f37-a909-b2f358343f59/109b3c28-e239-5f37-a909-b2f358343f59_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F31%252Fda31766eb8a9b71a80952bddac754747%252Fpa%252FGZ99340_57084ffaf15002e5abdfc9755a1489f4.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_57084ffaf15002e5abdfc9755a1489f4.jpg saved to cache
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 109b3c28-e239-5f37-a909-b2f358343f59
2026-03-28 18:47:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_1c7fcfd4d15b4e4668cd32358217db13.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24571561d0>
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_cc27a3ae48ec66ae3ce2a800c25af80b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_cc27a3ae48ec66ae3ce2a800c25af80b.jpg saved to cache
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f758484-a291-5788-ad42-3b6ac222f6e8
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456307550>
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_ffd0536ebd15b7a5a756b249e3c55709.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_ffd0536ebd15b7a5a756b249e3c55709.jpg saved to cache
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e94baef6-b842-55e6-923c-72dfd63cd195
2026-03-28 18:47:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245616d090>
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_2e6f91b98a902c47f3b98cdd085cddd9.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_2e6f91b98a902c47f3b98cdd085cddd9.jpg saved to cache
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f758484-a291-5788-ad42-3b6ac222f6e8
2026-03-28 18:47:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88ce754-852f-5da3-9957-03cc9318eaf1 with identifier: LD78650
2026-03-28 18:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88ce754-852f-5da3-9957-03cc9318eaf1 with scrape type 1
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e88ce754-852f-5da3-9957-03cc9318eaf1
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_c45c76a7124958082875373c29ca2f0e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_c45c76a7124958082875373c29ca2f0e.jpg not downloaded yet
2026-03-28 18:47:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_6ecd4e9e5f40e6868ed562aa26721f1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_6ecd4e9e5f40e6868ed562aa26721f1b.jpg not downloaded yet
2026-03-28 18:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_a749ce2854ccc811ae299b518ef6846e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_d45a6aa3e02cdf7062a61188292e5466.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_d45a6aa3e02cdf7062a61188292e5466.jpg not downloaded yet
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561f8510>
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_109b3c28-e239-5f37-a909-b2f358343f59/109b3c28-e239-5f37-a909-b2f358343f59_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F31%252Fda31766eb8a9b71a80952bddac754747%252Fpa%252FGZ99340_1c7fcfd4d15b4e4668cd32358217db13.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_1c7fcfd4d15b4e4668cd32358217db13.jpg saved to cache
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 109b3c28-e239-5f37-a909-b2f358343f59
2026-03-28 18:47:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 109b3c28-e239-5f37-a909-b2f358343f59, skipping ID generation
2026-03-28 18:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 109b3c28-e239-5f37-a909-b2f358343f59 with scrape type 1
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 109b3c28-e239-5f37-a909-b2f358343f59 sending to next pipeline
2026-03-28 18:47:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 109b3c28-e239-5f37-a909-b2f358343f59, identifier: GZ99340
2026-03-28 18:47:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 109b3c28-e239-5f37-a909-b2f358343f59 with identifier: GZ99340
2026-03-28 18:47:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 109b3c28-e239-5f37-a909-b2f358343f59 with identifier: GZ99340
2026-03-28 18:47:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 109b3c28-e239-5f37-a909-b2f358343f59 with identifier: GZ99340 to the API
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_1c7fcfd4d15b4e4668cd32358217db13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:26:04Z',
 'fuel_type': 'petrol',
 'id': '109b3c28-e239-5f37-a909-b2f358343f59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ99340',
 'listing': 'auction',
 'location': 'DE, Zweibrücken',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 193964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109b3c28-e239-5f37-a909-b2f358343f59/109b3c28-e239-5f37-a909-b2f358343f59_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_d2e5de78d42bc324719be761e0c2ac81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109b3c28-e239-5f37-a909-b2f358343f59/109b3c28-e239-5f37-a909-b2f358343f59_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_8a7123a252e22f7d69b4f7b322af3a8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109b3c28-e239-5f37-a909-b2f358343f59/109b3c28-e239-5f37-a909-b2f358343f59_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_d7605103eefb19b27754edb02a3407e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109b3c28-e239-5f37-a909-b2f358343f59/109b3c28-e239-5f37-a909-b2f358343f59_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_1c7fcfd4d15b4e4668cd32358217db13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_109b3c28-e239-5f37-a909-b2f358343f59/109b3c28-e239-5f37-a909-b2f358343f59_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/31/da31766eb8a9b71a80952bddac754747/pa/GZ99340_57084ffaf15002e5abdfc9755a1489f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ99340%27 HTTP/1.1" 200 None
2026-03-28 18:47:16 [auto1.de] INFO: Saving data for GZ99340: {'created_time': 1774723636.504507, 'last_price_update_time': 1774723636.504519, 'auction_closing_time': 1774884364.0}
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ99340') HTTP/1.1" 204 0
2026-03-28 18:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_283d4f9f95271d0ee34b93422e7981bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_cb9b22a861a222c0fb2496705b31b92c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_cb9b22a861a222c0fb2496705b31b92c.jpg not downloaded yet
2026-03-28 18:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_45e03e71d1d52bc22ea81e136eeb5a60.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_1fb6ad9faf8b18cbf90d6cf9e2e2940a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_485e8059ad5e82d8acf9cdea79dcf911.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_62a18fecfdada6e39abc6bbda77a938d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_62a18fecfdada6e39abc6bbda77a938d.jpg not downloaded yet
2026-03-28 18:47:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546df110>
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_a749ce2854ccc811ae299b518ef6846e.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_a749ce2854ccc811ae299b518ef6846e.jpg saved to cache
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f758484-a291-5788-ad42-3b6ac222f6e8
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_9dfa5fe39edbc3ed5dbe9bcdad33dd5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_9dfa5fe39edbc3ed5dbe9bcdad33dd5e.jpg not downloaded yet
2026-03-28 18:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_948a9509c703e378df2408dc59eb849a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_6ecd4e9e5f40e6868ed562aa26721f1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_aedfa0772b10bfc491415d0537398299.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_aedfa0772b10bfc491415d0537398299.jpg not downloaded yet
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245603ded0>
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_283d4f9f95271d0ee34b93422e7981bf.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_283d4f9f95271d0ee34b93422e7981bf.jpg saved to cache
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705
2026-03-28 18:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_d45a6aa3e02cdf7062a61188292e5466.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_d9b8eb1066682ace9c9ac2b756c85a3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_d9b8eb1066682ace9c9ac2b756c85a3d.jpg not downloaded yet
2026-03-28 18:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_c45c76a7124958082875373c29ca2f0e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458622650>
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013093d-1580-5701-b07f-5bcbda13b8c9/8013093d-1580-5701-b07f-5bcbda13b8c9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F2a%252F7a2a10637bc4d59142e1dba4b553c6f5%252Fpa%252FWW30345_45e03e71d1d52bc22ea81e136eeb5a60.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_45e03e71d1d52bc22ea81e136eeb5a60.jpg saved to cache
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8013093d-1580-5701-b07f-5bcbda13b8c9
2026-03-28 18:47:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562750d0>
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_1fb6ad9faf8b18cbf90d6cf9e2e2940a.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_1fb6ad9faf8b18cbf90d6cf9e2e2940a.jpg saved to cache
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456307890>
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8013093d-1580-5701-b07f-5bcbda13b8c9/8013093d-1580-5701-b07f-5bcbda13b8c9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F2a%252F7a2a10637bc4d59142e1dba4b553c6f5%252Fpa%252FWW30345_485e8059ad5e82d8acf9cdea79dcf911.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_485e8059ad5e82d8acf9cdea79dcf911.jpg saved to cache
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8013093d-1580-5701-b07f-5bcbda13b8c9
2026-03-28 18:47:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8013093d-1580-5701-b07f-5bcbda13b8c9, skipping ID generation
2026-03-28 18:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8013093d-1580-5701-b07f-5bcbda13b8c9 with scrape type 1
2026-03-28 18:47:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8013093d-1580-5701-b07f-5bcbda13b8c9 sending to next pipeline
2026-03-28 18:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8013093d-1580-5701-b07f-5bcbda13b8c9, identifier: WW30345
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_27e15aa599acf60ac4413e421ee8d700.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_27e15aa599acf60ac4413e421ee8d700.jpg not downloaded yet
2026-03-28 18:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8013093d-1580-5701-b07f-5bcbda13b8c9 with identifier: WW30345
2026-03-28 18:47:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8013093d-1580-5701-b07f-5bcbda13b8c9 with identifier: WW30345
2026-03-28 18:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8013093d-1580-5701-b07f-5bcbda13b8c9 with identifier: WW30345 to the API
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_485e8059ad5e82d8acf9cdea79dcf911.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:23:40Z',
 'fuel_type': 'diesel',
 'id': '8013093d-1580-5701-b07f-5bcbda13b8c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW30345',
 'listing': 'auction',
 'location': 'DE, Mainz',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 442990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013093d-1580-5701-b07f-5bcbda13b8c9/8013093d-1580-5701-b07f-5bcbda13b8c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_485e8059ad5e82d8acf9cdea79dcf911.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013093d-1580-5701-b07f-5bcbda13b8c9/8013093d-1580-5701-b07f-5bcbda13b8c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_45e03e71d1d52bc22ea81e136eeb5a60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013093d-1580-5701-b07f-5bcbda13b8c9/8013093d-1580-5701-b07f-5bcbda13b8c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_b8e37e3c96ecd2341cc4876f90c0981b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013093d-1580-5701-b07f-5bcbda13b8c9/8013093d-1580-5701-b07f-5bcbda13b8c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_21a0b5e31f186f8eaac862176b39dcfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8013093d-1580-5701-b07f-5bcbda13b8c9/8013093d-1580-5701-b07f-5bcbda13b8c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/2a/7a2a10637bc4d59142e1dba4b553c6f5/pa/WW30345_a09bd273e4fe931591d6385f92f1f6f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.5 V6 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW30345%27 HTTP/1.1" 200 None
2026-03-28 18:47:17 [auto1.de] INFO: Saving data for WW30345: {'created_time': 1774723637.388471, 'last_price_update_time': 1774723637.388483, 'auction_closing_time': 1774884220.0}
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW30345') HTTP/1.1" 204 0
2026-03-28 18:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_cb9b22a861a222c0fb2496705b31b92c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_72d6d36845b582429ae3eb0c4018a32b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_62a18fecfdada6e39abc6bbda77a938d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_9dfa5fe39edbc3ed5dbe9bcdad33dd5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_7a496ad3178aad660f8285264b5159af.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_7a496ad3178aad660f8285264b5159af.jpg not downloaded yet
2026-03-28 18:47:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456305e90>
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fe4%252Ff1e40fb901b37ec35939fcc779f0c0c1%252Fpa%252FVL06986_948a9509c703e378df2408dc59eb849a.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_948a9509c703e378df2408dc59eb849a.jpg saved to cache
2026-03-28 18:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f758484-a291-5788-ad42-3b6ac222f6e8
2026-03-28 18:47:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f758484-a291-5788-ad42-3b6ac222f6e8, skipping ID generation
2026-03-28 18:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f758484-a291-5788-ad42-3b6ac222f6e8 with scrape type 1
2026-03-28 18:47:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f758484-a291-5788-ad42-3b6ac222f6e8 sending to next pipeline
2026-03-28 18:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f758484-a291-5788-ad42-3b6ac222f6e8, identifier: VL06986
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561585d0>
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_6ecd4e9e5f40e6868ed562aa26721f1b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_6ecd4e9e5f40e6868ed562aa26721f1b.jpg saved to cache
2026-03-28 18:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e88ce754-852f-5da3-9957-03cc9318eaf1
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546451d0>
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_d45a6aa3e02cdf7062a61188292e5466.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_d45a6aa3e02cdf7062a61188292e5466.jpg saved to cache
2026-03-28 18:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e88ce754-852f-5da3-9957-03cc9318eaf1
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245467fb90>
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_c45c76a7124958082875373c29ca2f0e.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_c45c76a7124958082875373c29ca2f0e.jpg saved to cache
2026-03-28 18:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e88ce754-852f-5da3-9957-03cc9318eaf1
2026-03-28 18:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_aedfa0772b10bfc491415d0537398299.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF06599> (referer: https://www.auto1.com/v1/car-details-view/RF06599/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ98006> (referer: https://www.auto1.com/v1/car-details-view/NZ98006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f758484-a291-5788-ad42-3b6ac222f6e8 with identifier: VL06986
2026-03-28 18:47:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f758484-a291-5788-ad42-3b6ac222f6e8 with identifier: VL06986
2026-03-28 18:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f758484-a291-5788-ad42-3b6ac222f6e8 with identifier: VL06986 to the API
2026-03-28 18:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_948a9509c703e378df2408dc59eb849a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:16:30Z',
 'fuel_type': 'petrol',
 'id': '6f758484-a291-5788-ad42-3b6ac222f6e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL06986',
 'listing': 'auction',
 'location': 'DE, Sulzbach-Rosenberg',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 135621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337218,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_948a9509c703e378df2408dc59eb849a.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346021,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_a749ce2854ccc811ae299b518ef6846e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295072,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_2e6f91b98a902c47f3b98cdd085cddd9.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_cc27a3ae48ec66ae3ce2a800c25af80b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299319,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_3a265799a5401a011022ee6b6fe4199c.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_bdcdf287dbd2516b365f7536698f069f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282868,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_20c73b78763a6ed508dd960c726e4b01.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386876,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_17279768bd0d83a9c2f5fa181ee5492f.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322154,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_cd0c66d5db6f3401e372a9d7dc0dbb1b.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f758484-a291-5788-ad42-3b6ac222f6e8/6f758484-a291-5788-ad42-3b6ac222f6e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341345,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/e4/f1e40fb901b37ec35939fcc779f0c0c1/pa/VL06986_4b2e5f2cdf97b43718acd41b5404ac1e.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TSI Exclusive Sport BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Exclusive Sport BlueMotion Tech',
 'year': 2015}
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06986%27 HTTP/1.1" 200 None
2026-03-28 18:47:18 [auto1.de] INFO: Saving data for VL06986: {'created_time': 1774723638.155645, 'last_price_update_time': 1774723638.155658, 'auction_closing_time': 1774883790.0}
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL06986') HTTP/1.1" 204 0
2026-03-28 18:47:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL64703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562c5410>
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_cb9b22a861a222c0fb2496705b31b92c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_cb9b22a861a222c0fb2496705b31b92c.jpg saved to cache
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e88ce754-852f-5da3-9957-03cc9318eaf1
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456299090>
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_72d6d36845b582429ae3eb0c4018a32b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_72d6d36845b582429ae3eb0c4018a32b.jpg saved to cache
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9b961ea-ec5b-556d-8337-e84209cb427a
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618e650>
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_62a18fecfdada6e39abc6bbda77a938d.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_62a18fecfdada6e39abc6bbda77a938d.jpg saved to cache
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e88ce754-852f-5da3-9957-03cc9318eaf1
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458558750>
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_9dfa5fe39edbc3ed5dbe9bcdad33dd5e.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_9dfa5fe39edbc3ed5dbe9bcdad33dd5e.jpg saved to cache
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e88ce754-852f-5da3-9957-03cc9318eaf1
2026-03-28 18:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_d51c1e17882b5836e627083bc7dc8631.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_d9b8eb1066682ace9c9ac2b756c85a3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454663ad0>
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_aedfa0772b10bfc491415d0537398299.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_aedfa0772b10bfc491415d0537398299.jpg saved to cache
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e88ce754-852f-5da3-9957-03cc9318eaf1
2026-03-28 18:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09a062e2-e388-5656-abb9-ce6b16a8a82c with identifier: RF06599
2026-03-28 18:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09a062e2-e388-5656-abb9-ce6b16a8a82c with scrape type 1
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09a062e2-e388-5656-abb9-ce6b16a8a82c
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F40%252F1a4068967b10fa515884d122790c477c%252Fpa%252FRF06599_d19b72e7fb4372544fa8cbd21dc234f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_d19b72e7fb4372544fa8cbd21dc234f7.jpg already downloaded
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F40%252F1a4068967b10fa515884d122790c477c%252Fpa%252FRF06599_cfa8709ca0af7092a84b199b1c7571ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_cfa8709ca0af7092a84b199b1c7571ff.jpg already downloaded
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F40%252F1a4068967b10fa515884d122790c477c%252Fpa%252FRF06599_ec054c574119ac681f1e150b2fc599b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_ec054c574119ac681f1e150b2fc599b7.jpg already downloaded
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F40%252F1a4068967b10fa515884d122790c477c%252Fpa%252FRF06599_d6e3cca94170dda3d3ba02a0655c0186.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_d6e3cca94170dda3d3ba02a0655c0186.jpg already downloaded
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F40%252F1a4068967b10fa515884d122790c477c%252Fpa%252FRF06599_bf2751ce9da2ba5deff74872742f37a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_bf2751ce9da2ba5deff74872742f37a2.jpg already downloaded
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F40%252F1a4068967b10fa515884d122790c477c%252Fpa%252FRF06599_88f0392c70f185b9e612504577400c29.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_88f0392c70f185b9e612504577400c29.jpg already downloaded
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F40%252F1a4068967b10fa515884d122790c477c%252Fpa%252FRF06599_8027873710536ac5cfa3ff9c11e9e969.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_8027873710536ac5cfa3ff9c11e9e969.jpg already downloaded
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F40%252F1a4068967b10fa515884d122790c477c%252Fpa%252FRF06599_296e5ebf7941d42517cd767297be4a44.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_296e5ebf7941d42517cd767297be4a44.jpg already downloaded
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F40%252F1a4068967b10fa515884d122790c477c%252Fpa%252FRF06599_ee06280406f8596832e6dabb45e0d43f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_ee06280406f8596832e6dabb45e0d43f.jpg already downloaded
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F40%252F1a4068967b10fa515884d122790c477c%252Fpa%252FRF06599_4d02c2494a0da5d899a17212fe74730f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_4d02c2494a0da5d899a17212fe74730f.jpg already downloaded
2026-03-28 18:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09a062e2-e388-5656-abb9-ce6b16a8a82c, identifier: RF06599
2026-03-28 18:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0 with identifier: NZ98006
2026-03-28 18:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0 with scrape type 1
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F05%252F2d051f72f5cf0606ff73dbf7d239c4a4%252Fpa%252FNZ98006_7dcfc4bbfafd0dce79a599061f2ca7cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_7dcfc4bbfafd0dce79a599061f2ca7cf.jpg not downloaded yet
2026-03-28 18:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_3fd7944c03b159844496cbe1d2c8243d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_27e15aa599acf60ac4413e421ee8d700.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB20164/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09a062e2-e388-5656-abb9-ce6b16a8a82c with identifier: RF06599
2026-03-28 18:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09a062e2-e388-5656-abb9-ce6b16a8a82c with identifier: RF06599
2026-03-28 18:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09a062e2-e388-5656-abb9-ce6b16a8a82c with identifier: RF06599 to the API
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RF06599>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:50:21Z',
 'fuel_type': 'petrol',
 'id': '09a062e2-e388-5656-abb9-ce6b16a8a82c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF06599',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 128087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_d19b72e7fb4372544fa8cbd21dc234f7.jpg',
                'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_cfa8709ca0af7092a84b199b1c7571ff.jpg',
                'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_ec054c574119ac681f1e150b2fc599b7.jpg',
                'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_d6e3cca94170dda3d3ba02a0655c0186.jpg',
                'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_bf2751ce9da2ba5deff74872742f37a2.jpg',
                'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_88f0392c70f185b9e612504577400c29.jpg',
                'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_8027873710536ac5cfa3ff9c11e9e969.jpg',
                'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_296e5ebf7941d42517cd767297be4a44.jpg',
                'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_ee06280406f8596832e6dabb45e0d43f.jpg',
                'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_4d02c2494a0da5d899a17212fe74730f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a062e2-e388-5656-abb9-ce6b16a8a82c/09a062e2-e388-5656-abb9-ce6b16a8a82c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3034459,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_d19b72e7fb4372544fa8cbd21dc234f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a062e2-e388-5656-abb9-ce6b16a8a82c/09a062e2-e388-5656-abb9-ce6b16a8a82c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2801557,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_cfa8709ca0af7092a84b199b1c7571ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a062e2-e388-5656-abb9-ce6b16a8a82c/09a062e2-e388-5656-abb9-ce6b16a8a82c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3031504,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_ec054c574119ac681f1e150b2fc599b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a062e2-e388-5656-abb9-ce6b16a8a82c/09a062e2-e388-5656-abb9-ce6b16a8a82c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_d6e3cca94170dda3d3ba02a0655c0186.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a062e2-e388-5656-abb9-ce6b16a8a82c/09a062e2-e388-5656-abb9-ce6b16a8a82c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_bf2751ce9da2ba5deff74872742f37a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a062e2-e388-5656-abb9-ce6b16a8a82c/09a062e2-e388-5656-abb9-ce6b16a8a82c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_88f0392c70f185b9e612504577400c29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a062e2-e388-5656-abb9-ce6b16a8a82c/09a062e2-e388-5656-abb9-ce6b16a8a82c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3190016,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_8027873710536ac5cfa3ff9c11e9e969.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a062e2-e388-5656-abb9-ce6b16a8a82c/09a062e2-e388-5656-abb9-ce6b16a8a82c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_296e5ebf7941d42517cd767297be4a44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a062e2-e388-5656-abb9-ce6b16a8a82c/09a062e2-e388-5656-abb9-ce6b16a8a82c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_ee06280406f8596832e6dabb45e0d43f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a062e2-e388-5656-abb9-ce6b16a8a82c/09a062e2-e388-5656-abb9-ce6b16a8a82c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3130579,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/40/1a4068967b10fa515884d122790c477c/pa/RF06599_4d02c2494a0da5d899a17212fe74730f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.8 TSI Joy',
 'transmission': 'manual',
 'trim': 'Joy',
 'year': 2016}
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF06599%27 HTTP/1.1" 200 None
2026-03-28 18:47:19 [auto1.de] INFO: Saving data for RF06599: {'created_time': 1774723639.040246, 'last_price_update_time': 1774723639.040258, 'auction_closing_time': 1774885821.0}
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF06599') HTTP/1.1" 204 0
2026-03-28 18:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_7a496ad3178aad660f8285264b5159af.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F05%252F2d051f72f5cf0606ff73dbf7d239c4a4%252Fpa%252FNZ98006_ade1a3059b3bd1b4da48f2375ae58973.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_ade1a3059b3bd1b4da48f2375ae58973.jpg not downloaded yet
2026-03-28 18:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE09172> (referer: https://www.auto1.com/v1/car-details-view/XE09172/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456260750>
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a6a20bb-8e47-55b5-a771-f23ea3483ecc/8a6a20bb-8e47-55b5-a771-f23ea3483ecc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F48%252F534890bfc229e0d871957556897e13d3%252Fpa%252FRF84100_d51c1e17882b5836e627083bc7dc8631.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_d51c1e17882b5836e627083bc7dc8631.jpg saved to cache
2026-03-28 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a6a20bb-8e47-55b5-a771-f23ea3483ecc
2026-03-28 18:47:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a6a20bb-8e47-55b5-a771-f23ea3483ecc, skipping ID generation
2026-03-28 18:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a6a20bb-8e47-55b5-a771-f23ea3483ecc with scrape type 1
2026-03-28 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a6a20bb-8e47-55b5-a771-f23ea3483ecc sending to next pipeline
2026-03-28 18:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a6a20bb-8e47-55b5-a771-f23ea3483ecc, identifier: RF84100
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564198d0>
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_d9b8eb1066682ace9c9ac2b756c85a3d.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_d9b8eb1066682ace9c9ac2b756c85a3d.jpg saved to cache
2026-03-28 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e88ce754-852f-5da3-9957-03cc9318eaf1
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F05%252F2d051f72f5cf0606ff73dbf7d239c4a4%252Fpa%252FNZ98006_33e53381ff446f40959e303f52a13053.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_33e53381ff446f40959e303f52a13053.jpg not downloaded yet
2026-03-28 18:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a6a20bb-8e47-55b5-a771-f23ea3483ecc with identifier: RF84100
2026-03-28 18:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a6a20bb-8e47-55b5-a771-f23ea3483ecc with identifier: RF84100
2026-03-28 18:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a6a20bb-8e47-55b5-a771-f23ea3483ecc with identifier: RF84100 to the API
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_d51c1e17882b5836e627083bc7dc8631.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:18:45Z',
 'fuel_type': 'diesel',
 'id': '8a6a20bb-8e47-55b5-a771-f23ea3483ecc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF84100',
 'listing': 'auction',
 'location': 'DE, Paderborn',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 267480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6a20bb-8e47-55b5-a771-f23ea3483ecc/8a6a20bb-8e47-55b5-a771-f23ea3483ecc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_d51c1e17882b5836e627083bc7dc8631.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6a20bb-8e47-55b5-a771-f23ea3483ecc/8a6a20bb-8e47-55b5-a771-f23ea3483ecc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_275fe19e5ec85688ad62ce22177312bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6a20bb-8e47-55b5-a771-f23ea3483ecc/8a6a20bb-8e47-55b5-a771-f23ea3483ecc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_deb867edbbde3a463bd9c9e627ce5fc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6a20bb-8e47-55b5-a771-f23ea3483ecc/8a6a20bb-8e47-55b5-a771-f23ea3483ecc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_206ae337608a7dce0f193eb0d121531c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a6a20bb-8e47-55b5-a771-f23ea3483ecc/8a6a20bb-8e47-55b5-a771-f23ea3483ecc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/48/534890bfc229e0d871957556897e13d3/pa/RF84100_ba1efa99000d696229bbc5cdde90d59c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2009}
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF84100%27 HTTP/1.1" 200 None
2026-03-28 18:47:19 [auto1.de] INFO: Saving data for RF84100: {'created_time': 1774723639.641006, 'last_price_update_time': 1774723639.641018, 'auction_closing_time': 1774883925.0}
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF84100') HTTP/1.1" 204 0
2026-03-28 18:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_9cda81f2bb159ffc3e2c9af2a5a8dd04.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547d1110>
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F5f%252F035f16c5f622e348f54e6481dae57ef5%252Fpa%252FBT55955_3fd7944c03b159844496cbe1d2c8243d.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_3fd7944c03b159844496cbe1d2c8243d.jpg saved to cache
2026-03-28 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9b961ea-ec5b-556d-8337-e84209cb427a
2026-03-28 18:47:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9b961ea-ec5b-556d-8337-e84209cb427a, skipping ID generation
2026-03-28 18:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9b961ea-ec5b-556d-8337-e84209cb427a with scrape type 1
2026-03-28 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9b961ea-ec5b-556d-8337-e84209cb427a sending to next pipeline
2026-03-28 18:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9b961ea-ec5b-556d-8337-e84209cb427a, identifier: BT55955
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546e0750>
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_27e15aa599acf60ac4413e421ee8d700.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_27e15aa599acf60ac4413e421ee8d700.jpg saved to cache
2026-03-28 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e88ce754-852f-5da3-9957-03cc9318eaf1
2026-03-28 18:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_326fa1811a7420c9791c1b93bc6be286.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_cc53463b98474b1af53baae47328f993.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_fca6934f8087b118ffd0e73957e77b27.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_9d6c9377d74dd80ff373b4f5d9a9ca5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F05%252F2d051f72f5cf0606ff73dbf7d239c4a4%252Fpa%252FNZ98006_1091e3d93f72a5f0de937b7daadf75d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_1091e3d93f72a5f0de937b7daadf75d6.jpg not downloaded yet
2026-03-28 18:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9b961ea-ec5b-556d-8337-e84209cb427a with identifier: BT55955
2026-03-28 18:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9b961ea-ec5b-556d-8337-e84209cb427a with identifier: BT55955
2026-03-28 18:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9b961ea-ec5b-556d-8337-e84209cb427a with identifier: BT55955 to the API
2026-03-28 18:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_3fd7944c03b159844496cbe1d2c8243d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:20:42Z',
 'fuel_type': 'petrol',
 'id': 'd9b961ea-ec5b-556d-8337-e84209cb427a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT55955',
 'listing': 'auction',
 'location': 'DE, Eschwege',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 127373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_3fd7944c03b159844496cbe1d2c8243d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_7af7f4f4e66c3456ee9efa1c5e95dbb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_7c003347a100cf7bedf0b8448d291de3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2667627,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_d8e5d866ec58c7831ac249993b19a9e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_8e1673553d909ce0c9821495569ea96c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3120346,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_8f3cc75b1369f5c916c062f657f36dc1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_29b7ee36be602073f8200d4b0112ffa5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_72d6d36845b582429ae3eb0c4018a32b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_cdb58a5a47568136f765ef8b8cb74ad0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b961ea-ec5b-556d-8337-e84209cb427a/d9b961ea-ec5b-556d-8337-e84209cb427a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3352735,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/5f/035f16c5f622e348f54e6481dae57ef5/pa/BT55955_7f5b8ce76f801ec7a0e8872c2ce93e94.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2017}
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT55955%27 HTTP/1.1" 200 None
2026-03-28 18:47:20 [auto1.de] INFO: Saving data for BT55955: {'created_time': 1774723640.229315, 'last_price_update_time': 1774723640.229328, 'auction_closing_time': 1774884042.0}
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT55955') HTTP/1.1" 204 0
2026-03-28 18:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_7dcfc4bbfafd0dce79a599061f2ca7cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK17224> (referer: https://www.auto1.com/v1/car-details-view/GK17224/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F05%252F2d051f72f5cf0606ff73dbf7d239c4a4%252Fpa%252FNZ98006_e736e9f1cb5d90f8f3ab3aad4b9d5210.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_e736e9f1cb5d90f8f3ab3aad4b9d5210.jpg not downloaded yet
2026-03-28 18:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b5450>
2026-03-28 18:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fb3%252Fd0b35fac1d347f8492530d33cb35ab87%252Fpa%252FLD78650_7a496ad3178aad660f8285264b5159af.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_7a496ad3178aad660f8285264b5159af.jpg saved to cache
2026-03-28 18:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e88ce754-852f-5da3-9957-03cc9318eaf1
2026-03-28 18:47:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e88ce754-852f-5da3-9957-03cc9318eaf1, skipping ID generation
2026-03-28 18:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88ce754-852f-5da3-9957-03cc9318eaf1 with scrape type 1
2026-03-28 18:47:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e88ce754-852f-5da3-9957-03cc9318eaf1 sending to next pipeline
2026-03-28 18:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e88ce754-852f-5da3-9957-03cc9318eaf1, identifier: LD78650
2026-03-28 18:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02e08ae0-dd15-5f34-a1ee-77fb71e2558f with identifier: XE09172
2026-03-28 18:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f with scrape type 1
2026-03-28 18:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_a2d4f2b3580096bd146f0fdf1a28bafa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_a2d4f2b3580096bd146f0fdf1a28bafa.jpg not downloaded yet
2026-03-28 18:47:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638ed50>
2026-03-28 18:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_9cda81f2bb159ffc3e2c9af2a5a8dd04.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_9cda81f2bb159ffc3e2c9af2a5a8dd04.jpg saved to cache
2026-03-28 18:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705
2026-03-28 18:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL01053> (referer: https://www.auto1.com/v1/car-details-view/CL01053/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e88ce754-852f-5da3-9957-03cc9318eaf1 with identifier: LD78650
2026-03-28 18:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e88ce754-852f-5da3-9957-03cc9318eaf1 with identifier: LD78650
2026-03-28 18:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e88ce754-852f-5da3-9957-03cc9318eaf1 with identifier: LD78650 to the API
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_7a496ad3178aad660f8285264b5159af.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:12:27Z',
 'fuel_type': 'petrol',
 'id': 'e88ce754-852f-5da3-9957-03cc9318eaf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD78650',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 151346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_c45c76a7124958082875373c29ca2f0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_6ecd4e9e5f40e6868ed562aa26721f1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_d45a6aa3e02cdf7062a61188292e5466.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_cb9b22a861a222c0fb2496705b31b92c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_62a18fecfdada6e39abc6bbda77a938d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_9dfa5fe39edbc3ed5dbe9bcdad33dd5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_aedfa0772b10bfc491415d0537398299.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_d9b8eb1066682ace9c9ac2b756c85a3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_27e15aa599acf60ac4413e421ee8d700.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88ce754-852f-5da3-9957-03cc9318eaf1/e88ce754-852f-5da3-9957-03cc9318eaf1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/b3/d0b35fac1d347f8492530d33cb35ab87/pa/LD78650_7a496ad3178aad660f8285264b5159af.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Match',
 'transmission': 'automatic',
 'trim': 'Match',
 'year': 2013}
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78650%27 HTTP/1.1" 200 None
2026-03-28 18:47:20 [auto1.de] INFO: Saving data for LD78650: {'created_time': 1774723640.893326, 'last_price_update_time': 1774723640.893341, 'auction_closing_time': 1774883547.0}
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD78650') HTTP/1.1" 204 0
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_8022c9579e460c5a52065fe6c36e0372.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_8022c9579e460c5a52065fe6c36e0372.jpg not downloaded yet
2026-03-28 18:47:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547d0150>
2026-03-28 18:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffe%252Fbbfef11cfdfb36e0e8a51e7dd4d91e24%252Fpa%252FUP78086_326fa1811a7420c9791c1b93bc6be286.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_326fa1811a7420c9791c1b93bc6be286.jpg saved to cache
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e94baef6-b842-55e6-923c-72dfd63cd195
2026-03-28 18:47:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e94baef6-b842-55e6-923c-72dfd63cd195, skipping ID generation
2026-03-28 18:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e94baef6-b842-55e6-923c-72dfd63cd195 with scrape type 1
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e94baef6-b842-55e6-923c-72dfd63cd195 sending to next pipeline
2026-03-28 18:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e94baef6-b842-55e6-923c-72dfd63cd195, identifier: UP78086
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456363310>
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9567e7f1-df59-575f-b013-ae275086f652/9567e7f1-df59-575f-b013-ae275086f652_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F13%252F1a13338c4ec1fdfcc0354022df46b066%252Fpa%252FZY32657_cc53463b98474b1af53baae47328f993.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_cc53463b98474b1af53baae47328f993.jpg saved to cache
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9567e7f1-df59-575f-b013-ae275086f652
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b3350>
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9567e7f1-df59-575f-b013-ae275086f652/9567e7f1-df59-575f-b013-ae275086f652_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F13%252F1a13338c4ec1fdfcc0354022df46b066%252Fpa%252FZY32657_fca6934f8087b118ffd0e73957e77b27.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_fca6934f8087b118ffd0e73957e77b27.jpg saved to cache
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9567e7f1-df59-575f-b013-ae275086f652
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a40d0>
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_9d6c9377d74dd80ff373b4f5d9a9ca5b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_9d6c9377d74dd80ff373b4f5d9a9ca5b.jpg saved to cache
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-03-28 18:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_ade1a3059b3bd1b4da48f2375ae58973.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e94baef6-b842-55e6-923c-72dfd63cd195 with identifier: UP78086
2026-03-28 18:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e94baef6-b842-55e6-923c-72dfd63cd195 with identifier: UP78086
2026-03-28 18:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e94baef6-b842-55e6-923c-72dfd63cd195 with identifier: UP78086 to the API
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_326fa1811a7420c9791c1b93bc6be286.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:42:30Z',
 'fuel_type': 'petrol',
 'id': 'e94baef6-b842-55e6-923c-72dfd63cd195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP78086',
 'listing': 'auction',
 'location': 'DE, Kumhausen',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 94250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3027527,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_326fa1811a7420c9791c1b93bc6be286.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_ffd0536ebd15b7a5a756b249e3c55709.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2909739,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_e96bac1664868f1fee233a3aeba0555c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_3f7ec5ebd012fb0c3f2e1d916490ec4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_b995e380133171c86bc5e9b0ea938ad3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3121643,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_c5cd9ea18f0115bcaeea18d43afbd7f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_d13b9e10ceae6a96d94422675cfa5efe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2970640,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_e66dc95f130827d1d66f2290d7fabb9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2919432,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_b307f97dba70c2ab62e452e0717593af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e94baef6-b842-55e6-923c-72dfd63cd195/e94baef6-b842-55e6-923c-72dfd63cd195_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3072453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fe/bbfef11cfdfb36e0e8a51e7dd4d91e24/pa/UP78086_d5762c10a3c9285ae2b4d2744ee3d82d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Ecomotive',
 'year': 2011}
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP78086%27 HTTP/1.1" 200 None
2026-03-28 18:47:21 [auto1.de] INFO: Saving data for UP78086: {'created_time': 1774723641.6601, 'last_price_update_time': 1774723641.660111, 'auction_closing_time': 1774885350.0}
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP78086') HTTP/1.1" 204 0
2026-03-28 18:47:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_e9dbb0bef9f35c6a06359d68daa38c81.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_e9dbb0bef9f35c6a06359d68daa38c81.jpg not downloaded yet
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546c2e10>
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0/8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F05%252F2d051f72f5cf0606ff73dbf7d239c4a4%252Fpa%252FNZ98006_7dcfc4bbfafd0dce79a599061f2ca7cf.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_7dcfc4bbfafd0dce79a599061f2ca7cf.jpg saved to cache
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0
2026-03-28 18:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbb98a53-7a1a-5938-8404-a38b8206175c with identifier: GK17224
2026-03-28 18:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbb98a53-7a1a-5938-8404-a38b8206175c with scrape type 1
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbb98a53-7a1a-5938-8404-a38b8206175c
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_12bd06d5bc5048367f4b2365584a83d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_12bd06d5bc5048367f4b2365584a83d3.jpg not downloaded yet
2026-03-28 18:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e6b87ac-7b0d-549f-9093-c347185962f5 with identifier: CL01053
2026-03-28 18:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e6b87ac-7b0d-549f-9093-c347185962f5 with scrape type 1
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3e6b87ac-7b0d-549f-9093-c347185962f5
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F8f%252F948f08d7c40341fd6fffef79f91f9c98%252Fpa%252FCL01053_05d56a69b99b3f8d5b248efe434b5351.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_05d56a69b99b3f8d5b248efe434b5351.jpg not downloaded yet
2026-03-28 18:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_1ba3eee28c905b469002638dbc72aeb4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_954ad31ebd9953f8196ffe36a85c4cf7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_954ad31ebd9953f8196ffe36a85c4cf7.jpg not downloaded yet
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_ea937f8a0cc57b8814630312e8777691.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_ea937f8a0cc57b8814630312e8777691.jpg not downloaded yet
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F8f%252F948f08d7c40341fd6fffef79f91f9c98%252Fpa%252FCL01053_c0f3ac43ea4d257db9c7b257b84dad8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_c0f3ac43ea4d257db9c7b257b84dad8b.jpg not downloaded yet
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d18d0>
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0/8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F05%252F2d051f72f5cf0606ff73dbf7d239c4a4%252Fpa%252FNZ98006_ade1a3059b3bd1b4da48f2375ae58973.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_ade1a3059b3bd1b4da48f2375ae58973.jpg saved to cache
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_2e1d7d793d2e1735a8e2747c1ae3a5ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_2e1d7d793d2e1735a8e2747c1ae3a5ea.jpg not downloaded yet
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_49eb43d2f8b029fec8c92c77dbc46ee1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_49eb43d2f8b029fec8c92c77dbc46ee1.jpg not downloaded yet
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F8f%252F948f08d7c40341fd6fffef79f91f9c98%252Fpa%252FCL01053_13e802b41d3cbee736f5cbd959253b02.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_13e802b41d3cbee736f5cbd959253b02.jpg not downloaded yet
2026-03-28 18:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_33e53381ff446f40959e303f52a13053.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_79372545c897b8b0800fe3c1a3fd35b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_43919ed5e109e234c25e8d89910c2a5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_43919ed5e109e234c25e8d89910c2a5b.jpg not downloaded yet
2026-03-28 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_e26a0950e20542370fe62f00c8c2b57d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_e26a0950e20542370fe62f00c8c2b57d.jpg not downloaded yet
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F8f%252F948f08d7c40341fd6fffef79f91f9c98%252Fpa%252FCL01053_ec17dc68bc4d7f7080ec6899fc992635.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_ec17dc68bc4d7f7080ec6899fc992635.jpg not downloaded yet
2026-03-28 18:47:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456337b50>
2026-03-28 18:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F3a%252F6c3aac9fdf1ea17295e1546b087431e1%252Fpa%252FWB94106_1ba3eee28c905b469002638dbc72aeb4.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_1ba3eee28c905b469002638dbc72aeb4.jpg saved to cache
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705
2026-03-28 18:47:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705, skipping ID generation
2026-03-28 18:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705 with scrape type 1
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705 sending to next pipeline
2026-03-28 18:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705, identifier: WB94106
2026-03-28 18:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705 with identifier: WB94106
2026-03-28 18:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705 with identifier: WB94106
2026-03-28 18:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705 with identifier: WB94106 to the API
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_1ba3eee28c905b469002638dbc72aeb4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:35:20Z',
 'fuel_type': 'petrol',
 'id': '4a2e0d09-96f8-5c6d-819d-bbe8c9db6705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB94106',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 81919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_283d4f9f95271d0ee34b93422e7981bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2935199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_9cda81f2bb159ffc3e2c9af2a5a8dd04.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878716,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_1ba3eee28c905b469002638dbc72aeb4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2585461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_1fb6ad9faf8b18cbf90d6cf9e2e2940a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_8ab7ff42f30a4c10e3997d86440771a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2924910,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_82a318dea8f8ebe9da03757751ae8340.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2693947,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_4d2c2951dc2ea34deb16bfe356f17f79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2356482,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_63ae17a91528f783c5194d0f131c320a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_54b75c2d7510f88e9231aa40b9f29935.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a2e0d09-96f8-5c6d-819d-bbe8c9db6705/4a2e0d09-96f8-5c6d-819d-bbe8c9db6705_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/3a/6c3aac9fdf1ea17295e1546b087431e1/pa/WB94106_3f987165aead6464799cef76f0e64da9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ti-VCT Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94106%27 HTTP/1.1" 200 None
2026-03-28 18:47:22 [auto1.de] INFO: Saving data for WB94106: {'created_time': 1774723642.660722, 'last_price_update_time': 1774723642.660735, 'auction_closing_time': 1774884920.0}
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB94106') HTTP/1.1" 204 0
2026-03-28 18:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_e736e9f1cb5d90f8f3ab3aad4b9d5210.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_24fd78ed655dd3877cd8ab55338ca8f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_24fd78ed655dd3877cd8ab55338ca8f5.jpg not downloaded yet
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_0e9711dd1c39af2a65634ebdcf2f74ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_0e9711dd1c39af2a65634ebdcf2f74ad.jpg not downloaded yet
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F8f%252F948f08d7c40341fd6fffef79f91f9c98%252Fpa%252FCL01053_510a56a3613f8b3a9bb0da5321e4d0ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_510a56a3613f8b3a9bb0da5321e4d0ca.jpg not downloaded yet
2026-03-28 18:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_1091e3d93f72a5f0de937b7daadf75d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560b3a50>
2026-03-28 18:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0/8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F05%252F2d051f72f5cf0606ff73dbf7d239c4a4%252Fpa%252FNZ98006_33e53381ff446f40959e303f52a13053.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_33e53381ff446f40959e303f52a13053.jpg saved to cache
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0
2026-03-28 18:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562ca0d0>
2026-03-28 18:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9567e7f1-df59-575f-b013-ae275086f652/9567e7f1-df59-575f-b013-ae275086f652_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F13%252F1a13338c4ec1fdfcc0354022df46b066%252Fpa%252FZY32657_79372545c897b8b0800fe3c1a3fd35b7.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_79372545c897b8b0800fe3c1a3fd35b7.jpg saved to cache
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9567e7f1-df59-575f-b013-ae275086f652
2026-03-28 18:47:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9567e7f1-df59-575f-b013-ae275086f652, skipping ID generation
2026-03-28 18:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9567e7f1-df59-575f-b013-ae275086f652 with scrape type 1
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9567e7f1-df59-575f-b013-ae275086f652 sending to next pipeline
2026-03-28 18:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9567e7f1-df59-575f-b013-ae275086f652, identifier: ZY32657
2026-03-28 18:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_c0f3ac43ea4d257db9c7b257b84dad8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_f3096b24c0db375ebcfda60ecd1906d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_f3096b24c0db375ebcfda60ecd1906d3.jpg not downloaded yet
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_471aedbc4f95553bbea266f0938e05a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_471aedbc4f95553bbea266f0938e05a9.jpg not downloaded yet
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F8f%252F948f08d7c40341fd6fffef79f91f9c98%252Fpa%252FCL01053_a447753668a6d5f7c2426f8bec4274d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_a447753668a6d5f7c2426f8bec4274d0.jpg not downloaded yet
2026-03-28 18:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9567e7f1-df59-575f-b013-ae275086f652 with identifier: ZY32657
2026-03-28 18:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9567e7f1-df59-575f-b013-ae275086f652 with identifier: ZY32657
2026-03-28 18:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9567e7f1-df59-575f-b013-ae275086f652 with identifier: ZY32657 to the API
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_79372545c897b8b0800fe3c1a3fd35b7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:07:24Z',
 'fuel_type': 'petrol',
 'id': '9567e7f1-df59-575f-b013-ae275086f652',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY32657',
 'listing': 'auction',
 'location': 'DE, Hamburg-Billstedt',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 164076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9567e7f1-df59-575f-b013-ae275086f652/9567e7f1-df59-575f-b013-ae275086f652_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_eacce75203af249c2b407fb0b944faac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9567e7f1-df59-575f-b013-ae275086f652/9567e7f1-df59-575f-b013-ae275086f652_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_79372545c897b8b0800fe3c1a3fd35b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9567e7f1-df59-575f-b013-ae275086f652/9567e7f1-df59-575f-b013-ae275086f652_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_fca6934f8087b118ffd0e73957e77b27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9567e7f1-df59-575f-b013-ae275086f652/9567e7f1-df59-575f-b013-ae275086f652_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_cc53463b98474b1af53baae47328f993.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9567e7f1-df59-575f-b013-ae275086f652/9567e7f1-df59-575f-b013-ae275086f652_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/13/1a13338c4ec1fdfcc0354022df46b066/pa/ZY32657_0cc64c84233daed39fe9d9d73ff719a7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Honda Jazz 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2009}
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY32657%27 HTTP/1.1" 200 None
2026-03-28 18:47:23 [auto1.de] INFO: Saving data for ZY32657: {'created_time': 1774723643.32614, 'last_price_update_time': 1774723643.32615, 'auction_closing_time': 1774883244.0}
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY32657') HTTP/1.1" 204 0
2026-03-28 18:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_13e802b41d3cbee736f5cbd959253b02.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_29966439b9e740769cb6838d98513b7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_29966439b9e740769cb6838d98513b7e.jpg not downloaded yet
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_6d9e9fcd348c76bdfa42a81856294f90.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_6d9e9fcd348c76bdfa42a81856294f90.jpg not downloaded yet
2026-03-28 18:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456309290>
2026-03-28 18:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0/8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F05%252F2d051f72f5cf0606ff73dbf7d239c4a4%252Fpa%252FNZ98006_e736e9f1cb5d90f8f3ab3aad4b9d5210.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_e736e9f1cb5d90f8f3ab3aad4b9d5210.jpg saved to cache
2026-03-28 18:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0
2026-03-28 18:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b4810>
2026-03-28 18:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0/8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F05%252F2d051f72f5cf0606ff73dbf7d239c4a4%252Fpa%252FNZ98006_1091e3d93f72a5f0de937b7daadf75d6.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_1091e3d93f72a5f0de937b7daadf75d6.jpg saved to cache
2026-03-28 18:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0
2026-03-28 18:47:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0, skipping ID generation
2026-03-28 18:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0 with scrape type 1
2026-03-28 18:47:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0 sending to next pipeline
2026-03-28 18:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0, identifier: NZ98006
2026-03-28 18:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_49eb43d2f8b029fec8c92c77dbc46ee1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR79425/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZA94641> (referer: https://www.auto1.com/v1/car-details-view/ZA94641/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU09493/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0 with identifier: NZ98006
2026-03-28 18:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0 with identifier: NZ98006
2026-03-28 18:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0 with identifier: NZ98006 to the API
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_1091e3d93f72a5f0de937b7daadf75d6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:23:39Z',
 'fuel_type': 'petrol',
 'id': '8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ98006',
 'listing': 'auction',
 'location': 'DE, Paderborn',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 188210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0/8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_7dcfc4bbfafd0dce79a599061f2ca7cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0/8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_ade1a3059b3bd1b4da48f2375ae58973.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0/8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_33e53381ff446f40959e303f52a13053.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0/8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_1091e3d93f72a5f0de937b7daadf75d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0/8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/05/2d051f72f5cf0606ff73dbf7d239c4a4/pa/NZ98006_e736e9f1cb5d90f8f3ab3aad4b9d5210.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ98006%27 HTTP/1.1" 200 None
2026-03-28 18:47:23 [auto1.de] INFO: Saving data for NZ98006: {'created_time': 1774723643.926992, 'last_price_update_time': 1774723643.927005, 'auction_closing_time': 1774884219.0}
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ98006') HTTP/1.1" 204 0
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_807e6ac6f751821856d7c80095fe17f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_807e6ac6f751821856d7c80095fe17f0.jpg not downloaded yet
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_a7442c48b0eca41fa8eebd9c1dd0105f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_a7442c48b0eca41fa8eebd9c1dd0105f.jpg not downloaded yet
2026-03-28 18:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458548bd0>
2026-03-28 18:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6b87ac-7b0d-549f-9093-c347185962f5/3e6b87ac-7b0d-549f-9093-c347185962f5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F8f%252F948f08d7c40341fd6fffef79f91f9c98%252Fpa%252FCL01053_c0f3ac43ea4d257db9c7b257b84dad8b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_c0f3ac43ea4d257db9c7b257b84dad8b.jpg saved to cache
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e6b87ac-7b0d-549f-9093-c347185962f5
2026-03-28 18:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_ec17dc68bc4d7f7080ec6899fc992635.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_e26a0950e20542370fe62f00c8c2b57d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_c45e7ee63531988ae08b07c40cc1605e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_c45e7ee63531988ae08b07c40cc1605e.jpg not downloaded yet
2026-03-28 18:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_510a56a3613f8b3a9bb0da5321e4d0ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456188510>
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6b87ac-7b0d-549f-9093-c347185962f5/3e6b87ac-7b0d-549f-9093-c347185962f5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F8f%252F948f08d7c40341fd6fffef79f91f9c98%252Fpa%252FCL01053_13e802b41d3cbee736f5cbd959253b02.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_13e802b41d3cbee736f5cbd959253b02.jpg saved to cache
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e6b87ac-7b0d-549f-9093-c347185962f5
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24586fc0d0>
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_49eb43d2f8b029fec8c92c77dbc46ee1.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_49eb43d2f8b029fec8c92c77dbc46ee1.jpg saved to cache
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbb98a53-7a1a-5938-8404-a38b8206175c
2026-03-28 18:47:24 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 6019 | hits on page: 40
2026-03-28 18:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4f1446a-413c-5264-8776-86bcef6ea39e with identifier: ZA94641
2026-03-28 18:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4f1446a-413c-5264-8776-86bcef6ea39e with scrape type 1
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4f1446a-413c-5264-8776-86bcef6ea39e
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_7ccf9d67c1d54852fc741253ab6f5fa9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_7ccf9d67c1d54852fc741253ab6f5fa9.jpg not downloaded yet
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_4144334bcc263b818d4622f77c3314b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_4144334bcc263b818d4622f77c3314b2.jpg not downloaded yet
2026-03-28 18:47:24 [auto1.de] INFO: Found listing with ID: UP78086
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP78086%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [auto1.de] INFO: Scrape type for UP78086: 0
2026-03-28 18:47:24 [auto1.de] INFO: Found listing with ID: WP34859
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP34859%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [auto1.de] INFO: Scrape type for WP34859: 0
2026-03-28 18:47:24 [auto1.de] INFO: Found listing with ID: UR14680
2026-03-28 18:47:24 [auto1.de] INFO: Found listing with ID: JS00894
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS00894%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [auto1.de] INFO: Scrape type for JS00894: 1
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_53880aabdf47c69d75f1ebb39a73c098.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_53880aabdf47c69d75f1ebb39a73c098.jpg not downloaded yet
2026-03-28 18:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_6d9e9fcd348c76bdfa42a81856294f90.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562e3450>
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6b87ac-7b0d-549f-9093-c347185962f5/3e6b87ac-7b0d-549f-9093-c347185962f5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F8f%252F948f08d7c40341fd6fffef79f91f9c98%252Fpa%252FCL01053_ec17dc68bc4d7f7080ec6899fc992635.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_ec17dc68bc4d7f7080ec6899fc992635.jpg saved to cache
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e6b87ac-7b0d-549f-9093-c347185962f5
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475a090>
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_e26a0950e20542370fe62f00c8c2b57d.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_e26a0950e20542370fe62f00c8c2b57d.jpg saved to cache
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbb98a53-7a1a-5938-8404-a38b8206175c
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547edb10>
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6b87ac-7b0d-549f-9093-c347185962f5/3e6b87ac-7b0d-549f-9093-c347185962f5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F8f%252F948f08d7c40341fd6fffef79f91f9c98%252Fpa%252FCL01053_510a56a3613f8b3a9bb0da5321e4d0ca.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_510a56a3613f8b3a9bb0da5321e4d0ca.jpg saved to cache
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e6b87ac-7b0d-549f-9093-c347185962f5
2026-03-28 18:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_a447753668a6d5f7c2426f8bec4274d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:24 [auto1.de] INFO: Found listing with ID: GZ33681
2026-03-28 18:47:24 [auto1.de] INFO: Found listing with ID: KE41699
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE41699%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [auto1.de] INFO: Scrape type for KE41699: 1
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_4b5e3e82855c05694ecc5c5433762bca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_4b5e3e82855c05694ecc5c5433762bca.jpg not downloaded yet
2026-03-28 18:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_471aedbc4f95553bbea266f0938e05a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:24 [auto1.de] INFO: Found listing with ID: WH78013
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH78013%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [auto1.de] INFO: Scrape type for WH78013: 1
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_a4e807f31e1b50f0090fdb9e88e25a1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_a4e807f31e1b50f0090fdb9e88e25a1f.jpg not downloaded yet
2026-03-28 18:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_f3096b24c0db375ebcfda60ecd1906d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:24 [auto1.de] INFO: Found listing with ID: GL25834
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL25834%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [auto1.de] INFO: Scrape type for GL25834: 1
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_cfc60ec7fdb1a1729a85a9a3d82c6898.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_cfc60ec7fdb1a1729a85a9a3d82c6898.jpg not downloaded yet
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456297a10>
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_6d9e9fcd348c76bdfa42a81856294f90.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_6d9e9fcd348c76bdfa42a81856294f90.jpg saved to cache
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fbb98a53-7a1a-5938-8404-a38b8206175c
2026-03-28 18:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_0e9711dd1c39af2a65634ebdcf2f74ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:24 [auto1.de] INFO: Found listing with ID: AB16604
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB16604%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [auto1.de] INFO: Scrape type for AB16604: 2
2026-03-28 18:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a730657-91aa-5dc0-8012-7284a9fa5980 with identifier: AB16604
2026-03-28 18:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a730657-91aa-5dc0-8012-7284a9fa5980 with scrape type 2
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a730657-91aa-5dc0-8012-7284a9fa5980 with scrape type 2
2026-03-28 18:47:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a730657-91aa-5dc0-8012-7284a9fa5980, identifier: AB16604
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_abfa8216d6c59b0a52e8fed85ab5a986.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_abfa8216d6c59b0a52e8fed85ab5a986.jpg not downloaded yet
2026-03-28 18:47:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a730657-91aa-5dc0-8012-7284a9fa5980 with identifier: AB16604
2026-03-28 18:47:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a730657-91aa-5dc0-8012-7284a9fa5980 with identifier: AB16604
2026-03-28 18:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a730657-91aa-5dc0-8012-7284a9fa5980 with identifier: AB16604 to the API
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:17:49Z',
 'fuel_type': 'petrol',
 'id': '7a730657-91aa-5dc0-8012-7284a9fa5980',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB16604',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 65513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': 'Renault Kangoo 1.6 Luxe',
 'transmission': 'automatic',
 'trim': 'Luxe',
 'year': 2012}
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB16604%27 HTTP/1.1" 200 None
2026-03-28 18:47:25 [auto1.de] INFO: Saving data for AB16604: {'auction_closing_time': 1774883869.0, 'created_time': 1773399862.033253, 'last_price_update_time': 1774723645.018711}
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB16604') HTTP/1.1" 204 0
2026-03-28 18:47:25 [auto1.de] INFO: Found listing with ID: PM83477
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM83477%27 HTTP/1.1" 200 None
2026-03-28 18:47:25 [auto1.de] INFO: Scrape type for PM83477: 1
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_92076fa59d52cf596d84cae525bbcce1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_92076fa59d52cf596d84cae525bbcce1.jpg not downloaded yet
2026-03-28 18:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_43919ed5e109e234c25e8d89910c2a5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456070b50>
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6b87ac-7b0d-549f-9093-c347185962f5/3e6b87ac-7b0d-549f-9093-c347185962f5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F8f%252F948f08d7c40341fd6fffef79f91f9c98%252Fpa%252FCL01053_a447753668a6d5f7c2426f8bec4274d0.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_a447753668a6d5f7c2426f8bec4274d0.jpg saved to cache
2026-03-28 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e6b87ac-7b0d-549f-9093-c347185962f5
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562e2ad0>
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_471aedbc4f95553bbea266f0938e05a9.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_471aedbc4f95553bbea266f0938e05a9.jpg saved to cache
2026-03-28 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbb98a53-7a1a-5938-8404-a38b8206175c
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454812a90>
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_f3096b24c0db375ebcfda60ecd1906d3.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_f3096b24c0db375ebcfda60ecd1906d3.jpg saved to cache
2026-03-28 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456432650>
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_0e9711dd1c39af2a65634ebdcf2f74ad.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_0e9711dd1c39af2a65634ebdcf2f74ad.jpg saved to cache
2026-03-28 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbb98a53-7a1a-5938-8404-a38b8206175c
2026-03-28 18:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_a7442c48b0eca41fa8eebd9c1dd0105f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:25 [auto1.de] INFO: Found listing with ID: XE10609
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE10609%27 HTTP/1.1" 200 None
2026-03-28 18:47:25 [auto1.de] INFO: Scrape type for XE10609: 2
2026-03-28 18:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c95ae50-25d7-57ed-9de1-1b295f91506d with identifier: XE10609
2026-03-28 18:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c95ae50-25d7-57ed-9de1-1b295f91506d with scrape type 2
2026-03-28 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c95ae50-25d7-57ed-9de1-1b295f91506d with scrape type 2
2026-03-28 18:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c95ae50-25d7-57ed-9de1-1b295f91506d, identifier: XE10609
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_e0e54b50df1c338842792456f09e28ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_e0e54b50df1c338842792456f09e28ce.jpg not downloaded yet
2026-03-28 18:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ49270/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB20164> (referer: https://www.auto1.com/v1/car-details-view/MB20164/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6d954ea87f25d6a05efac9e766b2b208.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c95ae50-25d7-57ed-9de1-1b295f91506d with identifier: XE10609
2026-03-28 18:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c95ae50-25d7-57ed-9de1-1b295f91506d with identifier: XE10609
2026-03-28 18:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c95ae50-25d7-57ed-9de1-1b295f91506d with identifier: XE10609 to the API
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:13:54Z',
 'fuel_type': 'diesel',
 'id': '1c95ae50-25d7-57ed-9de1-1b295f91506d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE10609',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 159012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-17',
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE10609%27 HTTP/1.1" 200 None
2026-03-28 18:47:25 [auto1.de] INFO: Saving data for XE10609: {'auction_closing_time': 1774883634.0, 'created_time': 1774118825.557976, 'last_price_update_time': 1774723645.85172}
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE10609') HTTP/1.1" 204 0
2026-03-28 18:47:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:25 [auto1.de] INFO: Found listing with ID: XT67395
2026-03-28 18:47:25 [auto1.de] INFO: Found listing with ID: XT85364
2026-03-28 18:47:25 [auto1.de] INFO: Found listing with ID: AU58197
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU58197%27 HTTP/1.1" 200 None
2026-03-28 18:47:25 [auto1.de] INFO: Scrape type for AU58197: 1
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_f8717260e81be0d2276255f18b5d89dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_f8717260e81be0d2276255f18b5d89dc.jpg not downloaded yet
2026-03-28 18:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_4144334bcc263b818d4622f77c3314b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:25 [auto1.de] INFO: Found listing with ID: KJ39198
2026-03-28 18:47:25 [auto1.de] INFO: Found listing with ID: ED37424
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED37424%27 HTTP/1.1" 200 None
2026-03-28 18:47:25 [auto1.de] INFO: Scrape type for ED37424: 2
2026-03-28 18:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37abdd3c-03bd-5da0-b053-1ed6247ad2d5 with identifier: ED37424
2026-03-28 18:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37abdd3c-03bd-5da0-b053-1ed6247ad2d5 with scrape type 2
2026-03-28 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37abdd3c-03bd-5da0-b053-1ed6247ad2d5 with scrape type 2
2026-03-28 18:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37abdd3c-03bd-5da0-b053-1ed6247ad2d5, identifier: ED37424
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_3f79e24333a39b144d785a61b1811090.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_3f79e24333a39b144d785a61b1811090.jpg not downloaded yet
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456432d90>
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_43919ed5e109e234c25e8d89910c2a5b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_43919ed5e109e234c25e8d89910c2a5b.jpg saved to cache
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245609e490>
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_a7442c48b0eca41fa8eebd9c1dd0105f.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_a7442c48b0eca41fa8eebd9c1dd0105f.jpg saved to cache
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fbb98a53-7a1a-5938-8404-a38b8206175c
2026-03-28 18:47:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97b1c8e3-47bd-5bea-9de4-5dd068407403 with identifier: MB20164
2026-03-28 18:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97b1c8e3-47bd-5bea-9de4-5dd068407403 with scrape type 1
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97b1c8e3-47bd-5bea-9de4-5dd068407403
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_173fea4e0ae1251c1b23e02acfe3bbab.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_173fea4e0ae1251c1b23e02acfe3bbab.jpg not downloaded yet
2026-03-28 18:47:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561efd90>
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_6d954ea87f25d6a05efac9e766b2b208.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6d954ea87f25d6a05efac9e766b2b208.jpg saved to cache
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-03-28 18:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_001dd3efd52ad70136d95ff3f99cc240.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37abdd3c-03bd-5da0-b053-1ed6247ad2d5 with identifier: ED37424
2026-03-28 18:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37abdd3c-03bd-5da0-b053-1ed6247ad2d5 with identifier: ED37424
2026-03-28 18:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37abdd3c-03bd-5da0-b053-1ed6247ad2d5 with identifier: ED37424 to the API
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:20Z',
 'fuel_type': 'diesel',
 'id': '37abdd3c-03bd-5da0-b053-1ed6247ad2d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED37424',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 136489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-23',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED37424%27 HTTP/1.1" 200 None
2026-03-28 18:47:26 [auto1.de] INFO: Saving data for ED37424: {'auction_closing_time': 1774884260.0, 'created_time': 1774033648.309546, 'last_price_update_time': 1774723646.580011}
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED37424') HTTP/1.1" 204 0
2026-03-28 18:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_53880aabdf47c69d75f1ebb39a73c098.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:26 [auto1.de] INFO: Found listing with ID: HP09567
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP09567%27 HTTP/1.1" 200 None
2026-03-28 18:47:26 [auto1.de] INFO: Scrape type for HP09567: 1
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_b04436c42ac5ed1f298c66f377764b2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_b04436c42ac5ed1f298c66f377764b2c.jpg not downloaded yet
2026-03-28 18:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_cfc60ec7fdb1a1729a85a9a3d82c6898.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:26 [auto1.de] INFO: Found listing with ID: EX55373
2026-03-28 18:47:26 [auto1.de] INFO: Found listing with ID: BN44220
2026-03-28 18:47:26 [auto1.de] INFO: Found listing with ID: YV25001
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV25001%27 HTTP/1.1" 200 None
2026-03-28 18:47:26 [auto1.de] INFO: Scrape type for YV25001: 1
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_5656d81ec2cc0f08f75cd1263369db00.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_5656d81ec2cc0f08f75cd1263369db00.jpg not downloaded yet
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563c0ad0>
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_4144334bcc263b818d4622f77c3314b2.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_4144334bcc263b818d4622f77c3314b2.jpg saved to cache
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbb98a53-7a1a-5938-8404-a38b8206175c
2026-03-28 18:47:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245467f150>
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_001dd3efd52ad70136d95ff3f99cc240.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_001dd3efd52ad70136d95ff3f99cc240.jpg saved to cache
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-03-28 18:47:26 [auto1.de] INFO: Found listing with ID: DF34301
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF34301%27 HTTP/1.1" 200 None
2026-03-28 18:47:26 [auto1.de] INFO: Scrape type for DF34301: 2
2026-03-28 18:47:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f with identifier: DF34301
2026-03-28 18:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f with scrape type 2
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f with scrape type 2
2026-03-28 18:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f, identifier: DF34301
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_ffd5c4a218c1b5d179df8ad976b7e518.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_ffd5c4a218c1b5d179df8ad976b7e518.jpg not downloaded yet
2026-03-28 18:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_92076fa59d52cf596d84cae525bbcce1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_f8717260e81be0d2276255f18b5d89dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f with identifier: DF34301
2026-03-28 18:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f with identifier: DF34301
2026-03-28 18:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f with identifier: DF34301 to the API
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-30T15:12:35Z',
 'fuel_type': 'diesel',
 'id': '54a983bf-4eaa-5bbe-82bb-9b27bbcc499f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF34301',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 83765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 300 d Mild-Hybrid 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2023}
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF34301%27 HTTP/1.1" 200 None
2026-03-28 18:47:27 [auto1.de] INFO: Saving data for DF34301: {'auction_closing_time': 1774883555.0, 'created_time': 1773381542.09826, 'last_price_update_time': 1774723647.313064}
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF34301') HTTP/1.1" 204 0
2026-03-28 18:47:27 [auto1.de] INFO: Found listing with ID: KT60539
2026-03-28 18:47:27 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA98416%27 HTTP/1.1" 200 None
2026-03-28 18:47:27 [auto1.de] INFO: Scrape type for VA98416: 1
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_7dcef35f0253348bda0854e5b8030a52.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_7dcef35f0253348bda0854e5b8030a52.jpg not downloaded yet
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562f4550>
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_53880aabdf47c69d75f1ebb39a73c098.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_53880aabdf47c69d75f1ebb39a73c098.jpg saved to cache
2026-03-28 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4f1446a-413c-5264-8776-86bcef6ea39e
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547e6c50>
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_cfc60ec7fdb1a1729a85a9a3d82c6898.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_cfc60ec7fdb1a1729a85a9a3d82c6898.jpg saved to cache
2026-03-28 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4f1446a-413c-5264-8776-86bcef6ea39e
2026-03-28 18:47:27 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-28 18:47:27 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-28 18:47:27 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS04004%27 HTTP/1.1" 200 None
2026-03-28 18:47:27 [auto1.de] INFO: Scrape type for RS04004: 1
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_9ae87429c2b0ec27f5616d8322aa3872.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_9ae87429c2b0ec27f5616d8322aa3872.jpg not downloaded yet
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546659d0>
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_92076fa59d52cf596d84cae525bbcce1.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_92076fa59d52cf596d84cae525bbcce1.jpg saved to cache
2026-03-28 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4f1446a-413c-5264-8776-86bcef6ea39e
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456193610>
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_f8717260e81be0d2276255f18b5d89dc.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_f8717260e81be0d2276255f18b5d89dc.jpg saved to cache
2026-03-28 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4f1446a-413c-5264-8776-86bcef6ea39e
2026-03-28 18:47:27 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-28 18:47:27 [auto1.de] INFO: Found listing with ID: EP86808
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP86808%27 HTTP/1.1" 200 None
2026-03-28 18:47:27 [auto1.de] INFO: Scrape type for EP86808: 1
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_d9caae5b0dc1addb58d544a587dc0598.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_d9caae5b0dc1addb58d544a587dc0598.jpg not downloaded yet
2026-03-28 18:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_3f79e24333a39b144d785a61b1811090.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_173fea4e0ae1251c1b23e02acfe3bbab.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:27 [auto1.de] INFO: Found listing with ID: YA04256
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA04256%27 HTTP/1.1" 200 None
2026-03-28 18:47:27 [auto1.de] INFO: Scrape type for YA04256: 2
2026-03-28 18:47:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ae606e-72bd-556a-8912-3c67e8fb10ed with identifier: YA04256
2026-03-28 18:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ae606e-72bd-556a-8912-3c67e8fb10ed with scrape type 2
2026-03-28 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ae606e-72bd-556a-8912-3c67e8fb10ed with scrape type 2
2026-03-28 18:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08ae606e-72bd-556a-8912-3c67e8fb10ed, identifier: YA04256
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_74a44e3b18501e7e4db48a84f2e00f2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_74a44e3b18501e7e4db48a84f2e00f2b.jpg not downloaded yet
2026-03-28 18:47:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2196f3a5bc8f79a4f0842a96a1b72401.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08ae606e-72bd-556a-8912-3c67e8fb10ed with identifier: YA04256
2026-03-28 18:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08ae606e-72bd-556a-8912-3c67e8fb10ed with identifier: YA04256
2026-03-28 18:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08ae606e-72bd-556a-8912-3c67e8fb10ed with identifier: YA04256 to the API
2026-03-28 18:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:58:55Z',
 'fuel_type': 'diesel',
 'id': '08ae606e-72bd-556a-8912-3c67e8fb10ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA04256',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 171839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-08',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA04256%27 HTTP/1.1" 200 None
2026-03-28 18:47:28 [auto1.de] INFO: Saving data for YA04256: {'auction_closing_time': 1774886335.0, 'created_time': 1773382432.531046, 'last_price_update_time': 1774723648.138093}
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA04256') HTTP/1.1" 204 0
2026-03-28 18:47:28 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS15050%27 HTTP/1.1" 200 None
2026-03-28 18:47:28 [auto1.de] INFO: Scrape type for WS15050: 1
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_c03fb641c87d57ac9a4759b781b5c31b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_c03fb641c87d57ac9a4759b781b5c31b.jpg not downloaded yet
2026-03-28 18:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_ffd5c4a218c1b5d179df8ad976b7e518.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_a2d4f2b3580096bd146f0fdf1a28bafa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_5656d81ec2cc0f08f75cd1263369db00.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:28 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-28 18:47:28 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-28 18:47:28 [auto1.de] INFO: Found listing with ID: HZ02763
2026-03-28 18:47:28 [auto1.de] INFO: Found listing with ID: KZ16493
2026-03-28 18:47:28 [auto1.de] INFO: Found listing with ID: UN41694
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN41694%27 HTTP/1.1" 200 None
2026-03-28 18:47:28 [auto1.de] INFO: Scrape type for UN41694: 1
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_94cd27a0c89b9c5fc94e5f2d7deb0f6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_94cd27a0c89b9c5fc94e5f2d7deb0f6b.jpg not downloaded yet
2026-03-28 18:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561965d0>
2026-03-28 18:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_3f79e24333a39b144d785a61b1811090.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_3f79e24333a39b144d785a61b1811090.jpg saved to cache
2026-03-28 18:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f4f1446a-413c-5264-8776-86bcef6ea39e
2026-03-28 18:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a43d0>
2026-03-28 18:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_173fea4e0ae1251c1b23e02acfe3bbab.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_173fea4e0ae1251c1b23e02acfe3bbab.jpg saved to cache
2026-03-28 18:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97b1c8e3-47bd-5bea-9de4-5dd068407403
2026-03-28 18:47:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456490890>
2026-03-28 18:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F6f%252F096f4a7f110446283f3ef6eeabd4598d%252Fpa%252FWK31693_2196f3a5bc8f79a4f0842a96a1b72401.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2196f3a5bc8f79a4f0842a96a1b72401.jpg saved to cache
2026-03-28 18:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f47b5984-7d4f-554a-b492-9773e9944a4c
2026-03-28 18:47:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f47b5984-7d4f-554a-b492-9773e9944a4c, skipping ID generation
2026-03-28 18:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f47b5984-7d4f-554a-b492-9773e9944a4c with scrape type 1
2026-03-28 18:47:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f47b5984-7d4f-554a-b492-9773e9944a4c sending to next pipeline
2026-03-28 18:47:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f47b5984-7d4f-554a-b492-9773e9944a4c, identifier: WK31693
2026-03-28 18:47:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f47b5984-7d4f-554a-b492-9773e9944a4c with identifier: WK31693
2026-03-28 18:47:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f47b5984-7d4f-554a-b492-9773e9944a4c with identifier: WK31693
2026-03-28 18:47:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f47b5984-7d4f-554a-b492-9773e9944a4c with identifier: WK31693 to the API
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2196f3a5bc8f79a4f0842a96a1b72401.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:57:19Z',
 'fuel_type': 'petrol',
 'id': 'f47b5984-7d4f-554a-b492-9773e9944a4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK31693',
 'listing': 'auction',
 'location': 'DE, Erfurt',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 108785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2768146,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_5529af265835508bae7a663eac37ad04.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2760949,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_d5ddcc7bdeb7e0f1b800465c56236838.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2822042,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2196f3a5bc8f79a4f0842a96a1b72401.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2659904,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_001dd3efd52ad70136d95ff3f99cc240.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_9d6c9377d74dd80ff373b4f5d9a9ca5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2715344,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6d954ea87f25d6a05efac9e766b2b208.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2726005,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_6723bdd675148afd2a830196bfc76895.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_74f5a606a97e7e9f9f98b562562be4ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2738965,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_2be1cf2204621f75525f828a6d5b94e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f47b5984-7d4f-554a-b492-9773e9944a4c/f47b5984-7d4f-554a-b492-9773e9944a4c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2762816,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/6f/096f4a7f110446283f3ef6eeabd4598d/pa/WK31693_f2acc4c1e382e515519e8b19c104ebc5.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2015}
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK31693%27 HTTP/1.1" 200 None
2026-03-28 18:47:28 [auto1.de] INFO: Saving data for WK31693: {'created_time': 1774723648.902649, 'last_price_update_time': 1774723648.902661, 'auction_closing_time': 1774886239.0}
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK31693') HTTP/1.1" 204 0
2026-03-28 18:47:29 [auto1.de] INFO: Found listing with ID: DF05561
2026-03-28 18:47:29 [auto1.de] INFO: Found listing with ID: UJ06873
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ06873%27 HTTP/1.1" 200 None
2026-03-28 18:47:29 [auto1.de] INFO: Scrape type for UJ06873: 1
2026-03-28 18:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM83477/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL25834/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_74a44e3b18501e7e4db48a84f2e00f2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:29 [auto1.de] INFO: Found listing with ID: GK39429
2026-03-28 18:47:29 [auto1.de] INFO: Found listing with ID: KR32445
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR32445%27 HTTP/1.1" 200 None
2026-03-28 18:47:29 [auto1.de] INFO: Scrape type for KR32445: 1
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454810050>
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_ffd5c4a218c1b5d179df8ad976b7e518.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_ffd5c4a218c1b5d179df8ad976b7e518.jpg saved to cache
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97b1c8e3-47bd-5bea-9de4-5dd068407403
2026-03-28 18:47:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564ec510>
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_a2d4f2b3580096bd146f0fdf1a28bafa.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_a2d4f2b3580096bd146f0fdf1a28bafa.jpg saved to cache
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456263810>
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_5656d81ec2cc0f08f75cd1263369db00.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_5656d81ec2cc0f08f75cd1263369db00.jpg saved to cache
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97b1c8e3-47bd-5bea-9de4-5dd068407403
2026-03-28 18:47:29 [auto1.de] INFO: Found listing with ID: MV07839
2026-03-28 18:47:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561bb750>
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_74a44e3b18501e7e4db48a84f2e00f2b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_74a44e3b18501e7e4db48a84f2e00f2b.jpg saved to cache
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97b1c8e3-47bd-5bea-9de4-5dd068407403
2026-03-28 18:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_29966439b9e740769cb6838d98513b7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_24fd78ed655dd3877cd8ab55338ca8f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_a4e807f31e1b50f0090fdb9e88e25a1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_abfa8216d6c59b0a52e8fed85ab5a986.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_d9caae5b0dc1addb58d544a587dc0598.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561a7e90>
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_29966439b9e740769cb6838d98513b7e.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_29966439b9e740769cb6838d98513b7e.jpg saved to cache
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f
2026-03-28 18:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_c03fb641c87d57ac9a4759b781b5c31b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456535210>
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_24fd78ed655dd3877cd8ab55338ca8f5.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_24fd78ed655dd3877cd8ab55338ca8f5.jpg saved to cache
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f
2026-03-28 18:47:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563b7450>
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_a4e807f31e1b50f0090fdb9e88e25a1f.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_a4e807f31e1b50f0090fdb9e88e25a1f.jpg saved to cache
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4f1446a-413c-5264-8776-86bcef6ea39e
2026-03-28 18:47:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245650fc50>
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_abfa8216d6c59b0a52e8fed85ab5a986.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_abfa8216d6c59b0a52e8fed85ab5a986.jpg saved to cache
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4f1446a-413c-5264-8776-86bcef6ea39e
2026-03-28 18:47:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475b190>
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_d9caae5b0dc1addb58d544a587dc0598.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_d9caae5b0dc1addb58d544a587dc0598.jpg saved to cache
2026-03-28 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97b1c8e3-47bd-5bea-9de4-5dd068407403
2026-03-28 18:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS00894/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH78013/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456341a50>
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_c03fb641c87d57ac9a4759b781b5c31b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_c03fb641c87d57ac9a4759b781b5c31b.jpg saved to cache
2026-03-28 18:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97b1c8e3-47bd-5bea-9de4-5dd068407403
2026-03-28 18:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_94cd27a0c89b9c5fc94e5f2d7deb0f6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245634c610>
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_94cd27a0c89b9c5fc94e5f2d7deb0f6b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_94cd27a0c89b9c5fc94e5f2d7deb0f6b.jpg saved to cache
2026-03-28 18:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97b1c8e3-47bd-5bea-9de4-5dd068407403
2026-03-28 18:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_9ae87429c2b0ec27f5616d8322aa3872.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_b04436c42ac5ed1f298c66f377764b2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547fa9d0>
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_9ae87429c2b0ec27f5616d8322aa3872.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_9ae87429c2b0ec27f5616d8322aa3872.jpg saved to cache
2026-03-28 18:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97b1c8e3-47bd-5bea-9de4-5dd068407403
2026-03-28 18:47:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456262250>
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_b04436c42ac5ed1f298c66f377764b2c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_b04436c42ac5ed1f298c66f377764b2c.jpg saved to cache
2026-03-28 18:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97b1c8e3-47bd-5bea-9de4-5dd068407403
2026-03-28 18:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_7dcef35f0253348bda0854e5b8030a52.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456192810>
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F64%252F0164f01740ffdcca2fff41689d26a849%252Fpa%252FMB20164_7dcef35f0253348bda0854e5b8030a52.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_7dcef35f0253348bda0854e5b8030a52.jpg saved to cache
2026-03-28 18:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97b1c8e3-47bd-5bea-9de4-5dd068407403
2026-03-28 18:47:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97b1c8e3-47bd-5bea-9de4-5dd068407403, skipping ID generation
2026-03-28 18:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97b1c8e3-47bd-5bea-9de4-5dd068407403 with scrape type 1
2026-03-28 18:47:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97b1c8e3-47bd-5bea-9de4-5dd068407403 sending to next pipeline
2026-03-28 18:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97b1c8e3-47bd-5bea-9de4-5dd068407403, identifier: MB20164
2026-03-28 18:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97b1c8e3-47bd-5bea-9de4-5dd068407403 with identifier: MB20164
2026-03-28 18:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97b1c8e3-47bd-5bea-9de4-5dd068407403 with identifier: MB20164
2026-03-28 18:47:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97b1c8e3-47bd-5bea-9de4-5dd068407403 with identifier: MB20164 to the API
2026-03-28 18:47:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_7dcef35f0253348bda0854e5b8030a52.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 268,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:12:07Z',
 'fuel_type': 'petrol',
 'id': '97b1c8e3-47bd-5bea-9de4-5dd068407403',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB20164',
 'listing': 'auction',
 'location': 'DE, Bocholt',
 'make': 'Subaru',
 'model': 'Outback',
 'odometer': 159213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_173fea4e0ae1251c1b23e02acfe3bbab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2715786,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_b04436c42ac5ed1f298c66f377764b2c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_5656d81ec2cc0f08f75cd1263369db00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_ffd5c4a218c1b5d179df8ad976b7e518.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2661928,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_7dcef35f0253348bda0854e5b8030a52.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_9ae87429c2b0ec27f5616d8322aa3872.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2759357,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_d9caae5b0dc1addb58d544a587dc0598.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_74a44e3b18501e7e4db48a84f2e00f2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_c03fb641c87d57ac9a4759b781b5c31b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b1c8e3-47bd-5bea-9de4-5dd068407403/97b1c8e3-47bd-5bea-9de4-5dd068407403_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2756485,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/64/0164f01740ffdcca2fff41689d26a849/pa/MB20164_94cd27a0c89b9c5fc94e5f2d7deb0f6b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru Outback 2.5 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB20164%27 HTTP/1.1" 200 None
2026-03-28 18:47:31 [auto1.de] INFO: Saving data for MB20164: {'created_time': 1774723651.457982, 'last_price_update_time': 1774723651.457994, 'auction_closing_time': 1774883527.0}
2026-03-28 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB20164') HTTP/1.1" 204 0
2026-03-28 18:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS15050/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_e0e54b50df1c338842792456f09e28ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547e7350>
2026-03-28 18:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_e0e54b50df1c338842792456f09e28ce.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_e0e54b50df1c338842792456f09e28ce.jpg saved to cache
2026-03-28 18:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4f1446a-413c-5264-8776-86bcef6ea39e
2026-03-28 18:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL25834> (referer: https://www.auto1.com/v1/car-details-view/GL25834/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27828a04-1704-5252-9290-b3ef0c7a57d1 with identifier: GL25834
2026-03-28 18:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27828a04-1704-5252-9290-b3ef0c7a57d1 with scrape type 1
2026-03-28 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27828a04-1704-5252-9290-b3ef0c7a57d1
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_282431965e876e6e3319d6b95235afd7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_282431965e876e6e3319d6b95235afd7.jpg not downloaded yet
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_428ca251fd2c8019d4c8378fe970b8aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_428ca251fd2c8019d4c8378fe970b8aa.jpg not downloaded yet
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_83b90101098da7b426400780d8073b7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_83b90101098da7b426400780d8073b7b.jpg not downloaded yet
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_24b3902f1a3bab39ee006e9d9b5f7332.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_24b3902f1a3bab39ee006e9d9b5f7332.jpg not downloaded yet
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_2f6b82e9a7b68a4c38397bbf92c76a88.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_2f6b82e9a7b68a4c38397bbf92c76a88.jpg not downloaded yet
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_de8cebc5955ba28e9aa97fe3bf131ca5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_de8cebc5955ba28e9aa97fe3bf131ca5.jpg not downloaded yet
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_65944c43914e04a4964dc6d4903e023d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_65944c43914e04a4964dc6d4903e023d.jpg not downloaded yet
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_881a65e0003f86c160871e6a29153d89.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_881a65e0003f86c160871e6a29153d89.jpg not downloaded yet
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_8bcb7a98830cf47797de63bcdd10c6dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_8bcb7a98830cf47797de63bcdd10c6dc.jpg not downloaded yet
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_af6f1765abbee37d02c02995a52f6302.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_af6f1765abbee37d02c02995a52f6302.jpg not downloaded yet
2026-03-28 18:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_4b5e3e82855c05694ecc5c5433762bca.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245603c190>
2026-03-28 18:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_4b5e3e82855c05694ecc5c5433762bca.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_4b5e3e82855c05694ecc5c5433762bca.jpg saved to cache
2026-03-28 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4f1446a-413c-5264-8776-86bcef6ea39e
2026-03-28 18:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_af6f1765abbee37d02c02995a52f6302.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_8bcb7a98830cf47797de63bcdd10c6dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456111910>
2026-03-28 18:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_af6f1765abbee37d02c02995a52f6302.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_af6f1765abbee37d02c02995a52f6302.jpg saved to cache
2026-03-28 18:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27828a04-1704-5252-9290-b3ef0c7a57d1
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564924d0>
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_8bcb7a98830cf47797de63bcdd10c6dc.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_8bcb7a98830cf47797de63bcdd10c6dc.jpg saved to cache
2026-03-28 18:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27828a04-1704-5252-9290-b3ef0c7a57d1
2026-03-28 18:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_881a65e0003f86c160871e6a29153d89.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456490c90>
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_881a65e0003f86c160871e6a29153d89.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_881a65e0003f86c160871e6a29153d89.jpg saved to cache
2026-03-28 18:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27828a04-1704-5252-9290-b3ef0c7a57d1
2026-03-28 18:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_65944c43914e04a4964dc6d4903e023d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245650d3d0>
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_65944c43914e04a4964dc6d4903e023d.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_65944c43914e04a4964dc6d4903e023d.jpg saved to cache
2026-03-28 18:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27828a04-1704-5252-9290-b3ef0c7a57d1
2026-03-28 18:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_de8cebc5955ba28e9aa97fe3bf131ca5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245615ab50>
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_de8cebc5955ba28e9aa97fe3bf131ca5.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_de8cebc5955ba28e9aa97fe3bf131ca5.jpg saved to cache
2026-03-28 18:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27828a04-1704-5252-9290-b3ef0c7a57d1
2026-03-28 18:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_2f6b82e9a7b68a4c38397bbf92c76a88.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456493910>
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_2f6b82e9a7b68a4c38397bbf92c76a88.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_2f6b82e9a7b68a4c38397bbf92c76a88.jpg saved to cache
2026-03-28 18:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27828a04-1704-5252-9290-b3ef0c7a57d1
2026-03-28 18:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_24b3902f1a3bab39ee006e9d9b5f7332.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561b6890>
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_24b3902f1a3bab39ee006e9d9b5f7332.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_24b3902f1a3bab39ee006e9d9b5f7332.jpg saved to cache
2026-03-28 18:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27828a04-1704-5252-9290-b3ef0c7a57d1
2026-03-28 18:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_83b90101098da7b426400780d8073b7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456490090>
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_83b90101098da7b426400780d8073b7b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_83b90101098da7b426400780d8073b7b.jpg saved to cache
2026-03-28 18:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27828a04-1704-5252-9290-b3ef0c7a57d1
2026-03-28 18:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_428ca251fd2c8019d4c8378fe970b8aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_282431965e876e6e3319d6b95235afd7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456190410>
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_428ca251fd2c8019d4c8378fe970b8aa.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_428ca251fd2c8019d4c8378fe970b8aa.jpg saved to cache
2026-03-28 18:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27828a04-1704-5252-9290-b3ef0c7a57d1
2026-03-28 18:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ49270> (referer: https://www.auto1.com/v1/car-details-view/KJ49270/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563107d0>
2026-03-28 18:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b236bbe8ffc23848259a08dd17e613b%252Fpa%252FGL25834_282431965e876e6e3319d6b95235afd7.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_282431965e876e6e3319d6b95235afd7.jpg saved to cache
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27828a04-1704-5252-9290-b3ef0c7a57d1
2026-03-28 18:47:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27828a04-1704-5252-9290-b3ef0c7a57d1, skipping ID generation
2026-03-28 18:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27828a04-1704-5252-9290-b3ef0c7a57d1 with scrape type 1
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27828a04-1704-5252-9290-b3ef0c7a57d1 sending to next pipeline
2026-03-28 18:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27828a04-1704-5252-9290-b3ef0c7a57d1, identifier: GL25834
2026-03-28 18:47:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27828a04-1704-5252-9290-b3ef0c7a57d1 with identifier: GL25834
2026-03-28 18:47:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27828a04-1704-5252-9290-b3ef0c7a57d1 with identifier: GL25834
2026-03-28 18:47:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27828a04-1704-5252-9290-b3ef0c7a57d1 with identifier: GL25834 to the API
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_282431965e876e6e3319d6b95235afd7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:34:21Z',
 'fuel_type': 'diesel',
 'id': '27828a04-1704-5252-9290-b3ef0c7a57d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL25834',
 'listing': 'auction',
 'location': 'DE, Halle',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 124707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_282431965e876e6e3319d6b95235afd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2635279,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_428ca251fd2c8019d4c8378fe970b8aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2638858,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_83b90101098da7b426400780d8073b7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624740,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_24b3902f1a3bab39ee006e9d9b5f7332.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2830144,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_2f6b82e9a7b68a4c38397bbf92c76a88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2593040,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_de8cebc5955ba28e9aa97fe3bf131ca5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_65944c43914e04a4964dc6d4903e023d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2685275,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_881a65e0003f86c160871e6a29153d89.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_8bcb7a98830cf47797de63bcdd10c6dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27828a04-1704-5252-9290-b3ef0c7a57d1/27828a04-1704-5252-9290-b3ef0c7a57d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3048283,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b236bbe8ffc23848259a08dd17e613b/pa/GL25834_af6f1765abbee37d02c02995a52f6302.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Energy Start',
 'transmission': 'manual',
 'trim': 'Start',
 'year': 2017}
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL25834%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [auto1.de] INFO: Saving data for GL25834: {'created_time': 1774723655.520184, 'last_price_update_time': 1774723655.520194, 'auction_closing_time': 1774884861.0}
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL25834') HTTP/1.1" 204 0
2026-03-28 18:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN41694/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR32445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP86808/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ06873/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10bf9abd-ed49-5e26-8d07-67425d4023ae with identifier: KJ49270
2026-03-28 18:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10bf9abd-ed49-5e26-8d07-67425d4023ae with scrape type 1
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10bf9abd-ed49-5e26-8d07-67425d4023ae
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_fbd8a9fe1a30ae628a1d5f48247adcd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_fbd8a9fe1a30ae628a1d5f48247adcd6.jpg not downloaded yet
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_7786fa040df6002914ba0a139d5de73c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_7786fa040df6002914ba0a139d5de73c.jpg not downloaded yet
2026-03-28 18:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM83477> (referer: https://www.auto1.com/v1/car-details-view/PM83477/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_2c11455f1b67c9715d360b3579828b2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_2c11455f1b67c9715d360b3579828b2c.jpg not downloaded yet
2026-03-28 18:47:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_692c797f825394076a7f63665563d8e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_692c797f825394076a7f63665563d8e0.jpg not downloaded yet
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_94f8ffcd6b0f2d4c1ae546f9dd3da462.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_94f8ffcd6b0f2d4c1ae546f9dd3da462.jpg not downloaded yet
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_c674b772e5e757a935b500bc6b166c00.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_c674b772e5e757a935b500bc6b166c00.jpg not downloaded yet
2026-03-28 18:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_c45e7ee63531988ae08b07c40cc1605e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_3f213e142c3dc50df1bb63b6264f26b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_3f213e142c3dc50df1bb63b6264f26b5.jpg not downloaded yet
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_41a8798f7bd4f539dd5536e245564972.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_41a8798f7bd4f539dd5536e245564972.jpg not downloaded yet
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_aaa4bfe2f4e54a25b4f255a52b28f922.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_aaa4bfe2f4e54a25b4f255a52b28f922.jpg not downloaded yet
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_5bbfd461ed73aba24ba0323906cc64f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_5bbfd461ed73aba24ba0323906cc64f0.jpg not downloaded yet
2026-03-28 18:47:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf5d962c-9d53-5e10-96f5-b4f74a6b60ce with identifier: PM83477
2026-03-28 18:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5d962c-9d53-5e10-96f5-b4f74a6b60ce with scrape type 1
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cf5d962c-9d53-5e10-96f5-b4f74a6b60ce
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9d%252Fbc9d808e866e22c95b41276dc96c253b%252Fpa%252FPM83477_82b3923b329aa8f568748a020fda7b00.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_82b3923b329aa8f568748a020fda7b00.jpg not downloaded yet
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9d%252Fbc9d808e866e22c95b41276dc96c253b%252Fpa%252FPM83477_3b5216c86de356a59f2c93c4cc67c9d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_3b5216c86de356a59f2c93c4cc67c9d3.jpg not downloaded yet
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9d%252Fbc9d808e866e22c95b41276dc96c253b%252Fpa%252FPM83477_1df5b20d9c588cf040ee86191255729f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_1df5b20d9c588cf040ee86191255729f.jpg not downloaded yet
2026-03-28 18:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456263550>
2026-03-28 18:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_c45e7ee63531988ae08b07c40cc1605e.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_c45e7ee63531988ae08b07c40cc1605e.jpg saved to cache
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fbb98a53-7a1a-5938-8404-a38b8206175c
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9d%252Fbc9d808e866e22c95b41276dc96c253b%252Fpa%252FPM83477_fdad9b1f005ff4bb99f00f69d5c7e569.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_fdad9b1f005ff4bb99f00f69d5c7e569.jpg not downloaded yet
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9d%252Fbc9d808e866e22c95b41276dc96c253b%252Fpa%252FPM83477_206a610762d22ce08c50812ed4161266.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_206a610762d22ce08c50812ed4161266.jpg not downloaded yet
2026-03-28 18:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_7ccf9d67c1d54852fc741253ab6f5fa9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_7786fa040df6002914ba0a139d5de73c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_206a610762d22ce08c50812ed4161266.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564ecad0>
2026-03-28 18:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fba%252F1cba2d746a37c89467d29dad6ae7f3da%252Fpa%252FZA94641_7ccf9d67c1d54852fc741253ab6f5fa9.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_7ccf9d67c1d54852fc741253ab6f5fa9.jpg saved to cache
2026-03-28 18:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4f1446a-413c-5264-8776-86bcef6ea39e
2026-03-28 18:47:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4f1446a-413c-5264-8776-86bcef6ea39e, skipping ID generation
2026-03-28 18:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4f1446a-413c-5264-8776-86bcef6ea39e with scrape type 1
2026-03-28 18:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4f1446a-413c-5264-8776-86bcef6ea39e sending to next pipeline
2026-03-28 18:47:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4f1446a-413c-5264-8776-86bcef6ea39e, identifier: ZA94641
2026-03-28 18:47:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4f1446a-413c-5264-8776-86bcef6ea39e with identifier: ZA94641
2026-03-28 18:47:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4f1446a-413c-5264-8776-86bcef6ea39e with identifier: ZA94641
2026-03-28 18:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4f1446a-413c-5264-8776-86bcef6ea39e with identifier: ZA94641 to the API
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_7ccf9d67c1d54852fc741253ab6f5fa9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:42:22Z',
 'fuel_type': 'diesel',
 'id': 'f4f1446a-413c-5264-8776-86bcef6ea39e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA94641',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 362673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2787185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_7ccf9d67c1d54852fc741253ab6f5fa9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_53880aabdf47c69d75f1ebb39a73c098.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2929204,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_4b5e3e82855c05694ecc5c5433762bca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3098904,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_a4e807f31e1b50f0090fdb9e88e25a1f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_cfc60ec7fdb1a1729a85a9a3d82c6898.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3091010,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_abfa8216d6c59b0a52e8fed85ab5a986.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_92076fa59d52cf596d84cae525bbcce1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3071039,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_e0e54b50df1c338842792456f09e28ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_f8717260e81be0d2276255f18b5d89dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4f1446a-413c-5264-8776-86bcef6ea39e/f4f1446a-413c-5264-8776-86bcef6ea39e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/ba/1cba2d746a37c89467d29dad6ae7f3da/pa/ZA94641_3f79e24333a39b144d785a61b1811090.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350 CDI T BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Elegance',
 'year': 2013}
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA94641%27 HTTP/1.1" 200 None
2026-03-28 18:47:36 [auto1.de] INFO: Saving data for ZA94641: {'created_time': 1774723656.52788, 'last_price_update_time': 1774723656.527892, 'auction_closing_time': 1774885342.0}
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA94641') HTTP/1.1" 204 0
2026-03-28 18:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU58197/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245628dbd0>
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_7786fa040df6002914ba0a139d5de73c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_7786fa040df6002914ba0a139d5de73c.jpg saved to cache
2026-03-28 18:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10bf9abd-ed49-5e26-8d07-67425d4023ae
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456070750>
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5d962c-9d53-5e10-96f5-b4f74a6b60ce/cf5d962c-9d53-5e10-96f5-b4f74a6b60ce_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9d%252Fbc9d808e866e22c95b41276dc96c253b%252Fpa%252FPM83477_206a610762d22ce08c50812ed4161266.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_206a610762d22ce08c50812ed4161266.jpg saved to cache
2026-03-28 18:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf5d962c-9d53-5e10-96f5-b4f74a6b60ce
2026-03-28 18:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_c674b772e5e757a935b500bc6b166c00.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_3b5216c86de356a59f2c93c4cc67c9d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_1df5b20d9c588cf040ee86191255729f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_fdad9b1f005ff4bb99f00f69d5c7e569.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454644fd0>
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_c674b772e5e757a935b500bc6b166c00.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_c674b772e5e757a935b500bc6b166c00.jpg saved to cache
2026-03-28 18:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10bf9abd-ed49-5e26-8d07-67425d4023ae
2026-03-28 18:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_82b3923b329aa8f568748a020fda7b00.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456196ad0>
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5d962c-9d53-5e10-96f5-b4f74a6b60ce/cf5d962c-9d53-5e10-96f5-b4f74a6b60ce_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9d%252Fbc9d808e866e22c95b41276dc96c253b%252Fpa%252FPM83477_3b5216c86de356a59f2c93c4cc67c9d3.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_3b5216c86de356a59f2c93c4cc67c9d3.jpg saved to cache
2026-03-28 18:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf5d962c-9d53-5e10-96f5-b4f74a6b60ce
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561d3790>
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5d962c-9d53-5e10-96f5-b4f74a6b60ce/cf5d962c-9d53-5e10-96f5-b4f74a6b60ce_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9d%252Fbc9d808e866e22c95b41276dc96c253b%252Fpa%252FPM83477_1df5b20d9c588cf040ee86191255729f.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_1df5b20d9c588cf040ee86191255729f.jpg saved to cache
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf5d962c-9d53-5e10-96f5-b4f74a6b60ce
2026-03-28 18:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456337f10>
2026-03-28 18:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5d962c-9d53-5e10-96f5-b4f74a6b60ce/cf5d962c-9d53-5e10-96f5-b4f74a6b60ce_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9d%252Fbc9d808e866e22c95b41276dc96c253b%252Fpa%252FPM83477_fdad9b1f005ff4bb99f00f69d5c7e569.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_fdad9b1f005ff4bb99f00f69d5c7e569.jpg saved to cache
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf5d962c-9d53-5e10-96f5-b4f74a6b60ce
2026-03-28 18:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS00894> (referer: https://www.auto1.com/v1/car-details-view/JS00894/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a5b10>
2026-03-28 18:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5d962c-9d53-5e10-96f5-b4f74a6b60ce/cf5d962c-9d53-5e10-96f5-b4f74a6b60ce_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F9d%252Fbc9d808e866e22c95b41276dc96c253b%252Fpa%252FPM83477_82b3923b329aa8f568748a020fda7b00.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_82b3923b329aa8f568748a020fda7b00.jpg saved to cache
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf5d962c-9d53-5e10-96f5-b4f74a6b60ce
2026-03-28 18:47:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf5d962c-9d53-5e10-96f5-b4f74a6b60ce, skipping ID generation
2026-03-28 18:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5d962c-9d53-5e10-96f5-b4f74a6b60ce with scrape type 1
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf5d962c-9d53-5e10-96f5-b4f74a6b60ce sending to next pipeline
2026-03-28 18:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf5d962c-9d53-5e10-96f5-b4f74a6b60ce, identifier: PM83477
2026-03-28 18:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf5d962c-9d53-5e10-96f5-b4f74a6b60ce with identifier: PM83477
2026-03-28 18:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf5d962c-9d53-5e10-96f5-b4f74a6b60ce with identifier: PM83477
2026-03-28 18:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf5d962c-9d53-5e10-96f5-b4f74a6b60ce with identifier: PM83477 to the API
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_82b3923b329aa8f568748a020fda7b00.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:21Z',
 'fuel_type': 'petrol',
 'id': 'cf5d962c-9d53-5e10-96f5-b4f74a6b60ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM83477',
 'listing': 'auction',
 'location': 'DE, Kaufbeuren',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 162237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5d962c-9d53-5e10-96f5-b4f74a6b60ce/cf5d962c-9d53-5e10-96f5-b4f74a6b60ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_82b3923b329aa8f568748a020fda7b00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5d962c-9d53-5e10-96f5-b4f74a6b60ce/cf5d962c-9d53-5e10-96f5-b4f74a6b60ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_3b5216c86de356a59f2c93c4cc67c9d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5d962c-9d53-5e10-96f5-b4f74a6b60ce/cf5d962c-9d53-5e10-96f5-b4f74a6b60ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_1df5b20d9c588cf040ee86191255729f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5d962c-9d53-5e10-96f5-b4f74a6b60ce/cf5d962c-9d53-5e10-96f5-b4f74a6b60ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_fdad9b1f005ff4bb99f00f69d5c7e569.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5d962c-9d53-5e10-96f5-b4f74a6b60ce/cf5d962c-9d53-5e10-96f5-b4f74a6b60ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/9d/bc9d808e866e22c95b41276dc96c253b/pa/PM83477_206a610762d22ce08c50812ed4161266.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.8 Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2009}
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM83477%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [auto1.de] INFO: Saving data for PM83477: {'created_time': 1774723657.58395, 'last_price_update_time': 1774723657.583962, 'auction_closing_time': 1774884081.0}
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM83477') HTTP/1.1" 204 0
2026-03-28 18:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH78013> (referer: https://www.auto1.com/v1/car-details-view/WH78013/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA98416/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9ab4fc4-4c34-5084-87f2-38a39718a000 with identifier: JS00894
2026-03-28 18:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9ab4fc4-4c34-5084-87f2-38a39718a000 with scrape type 1
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9ab4fc4-4c34-5084-87f2-38a39718a000
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_df0c20a0db2b31d6272a62e9bdf4cfb5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_df0c20a0db2b31d6272a62e9bdf4cfb5.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_a0d89820d417961711068d4a462a7736.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_a0d89820d417961711068d4a462a7736.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_aff5d053eec865e319a55939629b48ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_aff5d053eec865e319a55939629b48ba.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_c9257ebfb1472f70c10de55e4fa265be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_c9257ebfb1472f70c10de55e4fa265be.jpg not downloaded yet
2026-03-28 18:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV25001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_9b350ccf3e86622e6afe5fbe07edaa45.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_9b350ccf3e86622e6afe5fbe07edaa45.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_42a34394d9bd14c951ccd492dbadaaac.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_42a34394d9bd14c951ccd492dbadaaac.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_d47daf8ab4fd18c72d13170d6d3e08c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_d47daf8ab4fd18c72d13170d6d3e08c7.jpg not downloaded yet
2026-03-28 18:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43b875ff-616a-5654-adba-cf64d8c0c77a with identifier: WH78013
2026-03-28 18:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43b875ff-616a-5654-adba-cf64d8c0c77a with scrape type 1
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43b875ff-616a-5654-adba-cf64d8c0c77a
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_fccf49f5819f909a8239154d0b597e73.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_fccf49f5819f909a8239154d0b597e73.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_67c89a1fb0d2d2099ae28507d7b7ef4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_67c89a1fb0d2d2099ae28507d7b7ef4c.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_9da987929c33403b55bca4d9928ae4c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_9da987929c33403b55bca4d9928ae4c2.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_3c1dd446b1d5a71a71fc0f23469314a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_3c1dd446b1d5a71a71fc0f23469314a9.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_4d2e83304af31b89efcc8b638a5e87c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_4d2e83304af31b89efcc8b638a5e87c2.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_c4d73848b27d10267ac6dcd153f35c2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_c4d73848b27d10267ac6dcd153f35c2b.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_887218e31a42f64ea2feb310fbbd19f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_887218e31a42f64ea2feb310fbbd19f8.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_4d5e228c45e910f5a99a2cd584ed13c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_4d5e228c45e910f5a99a2cd584ed13c3.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_a4c928492b3ac5436a5c51c44461ed8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_a4c928492b3ac5436a5c51c44461ed8c.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_0dba750c820dcb4da3dffcde65637fb5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_0dba750c820dcb4da3dffcde65637fb5.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_836eb4c2890943c3908e7b1d50b94063.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_836eb4c2890943c3908e7b1d50b94063.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_3b06b8836410553a6808effd54126252.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_3b06b8836410553a6808effd54126252.jpg not downloaded yet
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_2bd64a1ab6f9a89c399de0ec02b32489.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_2bd64a1ab6f9a89c399de0ec02b32489.jpg not downloaded yet
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_aaa4bfe2f4e54a25b4f255a52b28f922.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_5bbfd461ed73aba24ba0323906cc64f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_41a8798f7bd4f539dd5536e245564972.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561a4650>
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_aaa4bfe2f4e54a25b4f255a52b28f922.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_aaa4bfe2f4e54a25b4f255a52b28f922.jpg saved to cache
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10bf9abd-ed49-5e26-8d07-67425d4023ae
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_2bd64a1ab6f9a89c399de0ec02b32489.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564eeb50>
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_5bbfd461ed73aba24ba0323906cc64f0.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_5bbfd461ed73aba24ba0323906cc64f0.jpg saved to cache
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10bf9abd-ed49-5e26-8d07-67425d4023ae
2026-03-28 18:47:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245620d110>
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_41a8798f7bd4f539dd5536e245564972.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_41a8798f7bd4f539dd5536e245564972.jpg saved to cache
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10bf9abd-ed49-5e26-8d07-67425d4023ae
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245609d550>
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_2bd64a1ab6f9a89c399de0ec02b32489.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_2bd64a1ab6f9a89c399de0ec02b32489.jpg saved to cache
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43b875ff-616a-5654-adba-cf64d8c0c77a
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE41699/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_3b06b8836410553a6808effd54126252.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_836eb4c2890943c3908e7b1d50b94063.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_a4c928492b3ac5436a5c51c44461ed8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_4d5e228c45e910f5a99a2cd584ed13c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_887218e31a42f64ea2feb310fbbd19f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456096490>
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_3b06b8836410553a6808effd54126252.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_3b06b8836410553a6808effd54126252.jpg saved to cache
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43b875ff-616a-5654-adba-cf64d8c0c77a
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_0dba750c820dcb4da3dffcde65637fb5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_4d2e83304af31b89efcc8b638a5e87c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 6019 | hits on page: 40
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563eaa90>
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_836eb4c2890943c3908e7b1d50b94063.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_836eb4c2890943c3908e7b1d50b94063.jpg saved to cache
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43b875ff-616a-5654-adba-cf64d8c0c77a
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456412810>
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_a4c928492b3ac5436a5c51c44461ed8c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_a4c928492b3ac5436a5c51c44461ed8c.jpg saved to cache
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43b875ff-616a-5654-adba-cf64d8c0c77a
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_9da987929c33403b55bca4d9928ae4c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [auto1.de] INFO: Found listing with ID: YR28195
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR28195%27 HTTP/1.1" 200 None
2026-03-28 18:47:38 [auto1.de] INFO: Scrape type for YR28195: 1
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_c4d73848b27d10267ac6dcd153f35c2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MU09493> (referer: https://www.auto1.com/v1/car-details-view/MU09493/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:38 [auto1.de] INFO: Found listing with ID: AW19440
2026-03-28 18:47:38 [auto1.de] INFO: Found listing with ID: DG41556
2026-03-28 18:47:38 [auto1.de] INFO: Found listing with ID: SR75246
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR75246%27 HTTP/1.1" 200 None
2026-03-28 18:47:38 [auto1.de] INFO: Scrape type for SR75246: 1
2026-03-28 18:47:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245652a450>
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_4d5e228c45e910f5a99a2cd584ed13c3.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_4d5e228c45e910f5a99a2cd584ed13c3.jpg saved to cache
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43b875ff-616a-5654-adba-cf64d8c0c77a
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563b5d10>
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_887218e31a42f64ea2feb310fbbd19f8.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_887218e31a42f64ea2feb310fbbd19f8.jpg saved to cache
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43b875ff-616a-5654-adba-cf64d8c0c77a
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_aff5d053eec865e319a55939629b48ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS04004/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:38 [auto1.de] INFO: Found listing with ID: HU15676
2026-03-28 18:47:38 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-28 18:47:38 [auto1.de] INFO: Found listing with ID: ZM61762
2026-03-28 18:47:38 [auto1.de] INFO: Found listing with ID: SC91438
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC91438%27 HTTP/1.1" 200 None
2026-03-28 18:47:38 [auto1.de] INFO: Scrape type for SC91438: 1
2026-03-28 18:47:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561da290>
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_0dba750c820dcb4da3dffcde65637fb5.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_0dba750c820dcb4da3dffcde65637fb5.jpg saved to cache
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43b875ff-616a-5654-adba-cf64d8c0c77a
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bc090>
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_4d2e83304af31b89efcc8b638a5e87c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_4d2e83304af31b89efcc8b638a5e87c2.jpg saved to cache
2026-03-28 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43b875ff-616a-5654-adba-cf64d8c0c77a
2026-03-28 18:47:39 [auto1.de] INFO: Found listing with ID: LJ25581
2026-03-28 18:47:39 [auto1.de] INFO: Found listing with ID: LL75700
2026-03-28 18:47:39 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG78174%27 HTTP/1.1" 200 None
2026-03-28 18:47:39 [auto1.de] INFO: Scrape type for RG78174: 1
2026-03-28 18:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547fba10>
2026-03-28 18:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_9da987929c33403b55bca4d9928ae4c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_9da987929c33403b55bca4d9928ae4c2.jpg saved to cache
2026-03-28 18:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43b875ff-616a-5654-adba-cf64d8c0c77a
2026-03-28 18:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560d2010>
2026-03-28 18:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_c4d73848b27d10267ac6dcd153f35c2b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_c4d73848b27d10267ac6dcd153f35c2b.jpg saved to cache
2026-03-28 18:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9ab4fc4-4c34-5084-87f2-38a39718a000
2026-03-28 18:47:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f817086f-9b8d-58d2-abb9-afae8991c669 with identifier: MU09493
2026-03-28 18:47:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f817086f-9b8d-58d2-abb9-afae8991c669 with scrape type 1
2026-03-28 18:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f817086f-9b8d-58d2-abb9-afae8991c669
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_01dcded9ccc2f31a4430d9c9ac8495ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_01dcded9ccc2f31a4430d9c9ac8495ad.jpg not downloaded yet
2026-03-28 18:47:39 [auto1.de] INFO: Found listing with ID: NG57043
2026-03-28 18:47:39 [auto1.de] INFO: Found listing with ID: SK20247
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20247%27 HTTP/1.1" 200 None
2026-03-28 18:47:39 [auto1.de] INFO: Scrape type for SK20247: 2
2026-03-28 18:47:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b13deea-6ba9-5e51-8035-415a89952eff with identifier: SK20247
2026-03-28 18:47:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b13deea-6ba9-5e51-8035-415a89952eff with scrape type 2
2026-03-28 18:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b13deea-6ba9-5e51-8035-415a89952eff with scrape type 2
2026-03-28 18:47:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b13deea-6ba9-5e51-8035-415a89952eff, identifier: SK20247
2026-03-28 18:47:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b13deea-6ba9-5e51-8035-415a89952eff with identifier: SK20247
2026-03-28 18:47:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b13deea-6ba9-5e51-8035-415a89952eff with identifier: SK20247
2026-03-28 18:47:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b13deea-6ba9-5e51-8035-415a89952eff with identifier: SK20247 to the API
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:33:46Z',
 'fuel_type': 'diesel',
 'id': '0b13deea-6ba9-5e51-8035-415a89952eff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK20247',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 55852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-17',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 114 CDI Pro extralang',
 'transmission': 'automatic',
 'trim': 'Pro extralang',
 'year': 2019}
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20247%27 HTTP/1.1" 200 None
2026-03-28 18:47:39 [auto1.de] INFO: Saving data for SK20247: {'auction_closing_time': 1774884826.0, 'created_time': 1773427822.049423, 'last_price_update_time': 1774723659.697308}
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK20247') HTTP/1.1" 204 0
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_20646b89d04eb4adc9b516a50acd2430.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_20646b89d04eb4adc9b516a50acd2430.jpg not downloaded yet
2026-03-28 18:47:39 [auto1.de] INFO: Found listing with ID: KY61393
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY61393%27 HTTP/1.1" 200 None
2026-03-28 18:47:39 [auto1.de] INFO: Scrape type for KY61393: 1
2026-03-28 18:47:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456305ed0>
2026-03-28 18:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_aff5d053eec865e319a55939629b48ba.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_aff5d053eec865e319a55939629b48ba.jpg saved to cache
2026-03-28 18:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9ab4fc4-4c34-5084-87f2-38a39718a000
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_639536d7226db8a0bc14344b4c610813.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_639536d7226db8a0bc14344b4c610813.jpg not downloaded yet
2026-03-28 18:47:39 [auto1.de] INFO: Found listing with ID: XA48872
2026-03-28 18:47:39 [auto1.de] INFO: Found listing with ID: ZZ30319
2026-03-28 18:47:39 [auto1.de] INFO: Found listing with ID: HK51191
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK51191%27 HTTP/1.1" 200 None
2026-03-28 18:47:40 [auto1.de] INFO: Scrape type for HK51191: 1
2026-03-28 18:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU58197> (referer: https://www.auto1.com/v1/car-details-view/AU58197/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ06873> (referer: https://www.auto1.com/v1/car-details-view/UJ06873/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS15050> (referer: https://www.auto1.com/v1/car-details-view/WS15050/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_873e66e074bae0916befca746f47aafc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_873e66e074bae0916befca746f47aafc.jpg not downloaded yet
2026-03-28 18:47:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:40 [auto1.de] INFO: Found listing with ID: FJ78997
2026-03-28 18:47:40 [auto1.de] INFO: Found listing with ID: NH81778
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81778%27 HTTP/1.1" 200 None
2026-03-28 18:47:40 [auto1.de] INFO: Scrape type for NH81778: 1
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_5c5105f332374fdaea3539b5a11dfc3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_5c5105f332374fdaea3539b5a11dfc3d.jpg not downloaded yet
2026-03-28 18:47:40 [auto1.de] INFO: Found listing with ID: SC04632
2026-03-28 18:47:40 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-28 18:47:40 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-28 18:47:40 [auto1.de] INFO: Found listing with ID: RZ32125
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ32125%27 HTTP/1.1" 200 None
2026-03-28 18:47:40 [auto1.de] INFO: Scrape type for RZ32125: 1
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_2168e1d68c4bd789ddf6b5d67c5bd9b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_2168e1d68c4bd789ddf6b5d67c5bd9b1.jpg not downloaded yet
2026-03-28 18:47:40 [auto1.de] INFO: Found listing with ID: LC33446
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33446%27 HTTP/1.1" 200 None
2026-03-28 18:47:40 [auto1.de] INFO: Scrape type for LC33446: 2
2026-03-28 18:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e24f4af9-1614-5905-9855-baee67ecc2a9 with identifier: LC33446
2026-03-28 18:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e24f4af9-1614-5905-9855-baee67ecc2a9 with scrape type 2
2026-03-28 18:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e24f4af9-1614-5905-9855-baee67ecc2a9 with scrape type 2
2026-03-28 18:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e24f4af9-1614-5905-9855-baee67ecc2a9, identifier: LC33446
2026-03-28 18:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e24f4af9-1614-5905-9855-baee67ecc2a9 with identifier: LC33446
2026-03-28 18:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e24f4af9-1614-5905-9855-baee67ecc2a9 with identifier: LC33446
2026-03-28 18:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e24f4af9-1614-5905-9855-baee67ecc2a9 with identifier: LC33446 to the API
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:19:14Z',
 'fuel_type': 'petrol',
 'id': 'e24f4af9-1614-5905-9855-baee67ecc2a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC33446',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 142136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-24',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Team',
 'transmission': 'automatic',
 'trim': 'Team',
 'year': 2010}
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33446%27 HTTP/1.1" 200 None
2026-03-28 18:47:40 [auto1.de] INFO: Saving data for LC33446: {'auction_closing_time': 1774883954.0, 'created_time': 1774033549.751531, 'last_price_update_time': 1774723660.531398}
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC33446') HTTP/1.1" 204 0
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_7a4e578bf17f3287e4b6225c86977274.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_7a4e578bf17f3287e4b6225c86977274.jpg not downloaded yet
2026-03-28 18:47:40 [auto1.de] INFO: Found listing with ID: JA37481
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA37481%27 HTTP/1.1" 200 None
2026-03-28 18:47:40 [auto1.de] INFO: Scrape type for JA37481: 2
2026-03-28 18:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 569d06e1-8edf-5e5a-b569-ab45de60d82d with identifier: JA37481
2026-03-28 18:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 569d06e1-8edf-5e5a-b569-ab45de60d82d with scrape type 2
2026-03-28 18:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 569d06e1-8edf-5e5a-b569-ab45de60d82d with scrape type 2
2026-03-28 18:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 569d06e1-8edf-5e5a-b569-ab45de60d82d, identifier: JA37481
2026-03-28 18:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 569d06e1-8edf-5e5a-b569-ab45de60d82d with identifier: JA37481
2026-03-28 18:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 569d06e1-8edf-5e5a-b569-ab45de60d82d with identifier: JA37481
2026-03-28 18:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 569d06e1-8edf-5e5a-b569-ab45de60d82d with identifier: JA37481 to the API
2026-03-28 18:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:33:41Z',
 'fuel_type': 'petrol',
 'id': '569d06e1-8edf-5e5a-b569-ab45de60d82d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA37481',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 131752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-25',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2011}
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA37481%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [auto1.de] INFO: Saving data for JA37481: {'auction_closing_time': 1774884821.0, 'created_time': 1774035211.510155, 'last_price_update_time': 1774723661.174162}
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA37481') HTTP/1.1" 204 0
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_0d0fb0119db75e5acd7c6f60564350fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_0d0fb0119db75e5acd7c6f60564350fe.jpg not downloaded yet
2026-03-28 18:47:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b146ce1-64f4-5f09-b063-75c40ebf65b8 with identifier: AU58197
2026-03-28 18:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b146ce1-64f4-5f09-b063-75c40ebf65b8 with scrape type 1
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8b146ce1-64f4-5f09-b063-75c40ebf65b8
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F3c%252F1d3c0833481960d335a56b3a5f45b80f%252Fpa%252FAU58197_9feccfcc4fef9c2488dc10d8840ab00f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_9feccfcc4fef9c2488dc10d8840ab00f.jpg not downloaded yet
2026-03-28 18:47:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c with identifier: UJ06873
2026-03-28 18:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c with scrape type 1
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F04%252F2c04cb20ae4fa91867fe5f36a1c5e7a2%252Fpa%252FUJ06873_3188700e1e34edc49c17b55d44d5a60b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_3188700e1e34edc49c17b55d44d5a60b.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F04%252F2c04cb20ae4fa91867fe5f36a1c5e7a2%252Fpa%252FUJ06873_f36965e489374a1120ab93c811f1d3a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_f36965e489374a1120ab93c811f1d3a9.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F04%252F2c04cb20ae4fa91867fe5f36a1c5e7a2%252Fpa%252FUJ06873_4a6b5534ac0365fa2e1e73b7636bc50e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_4a6b5534ac0365fa2e1e73b7636bc50e.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F04%252F2c04cb20ae4fa91867fe5f36a1c5e7a2%252Fpa%252FUJ06873_20ec2706cb852aebe08afc84fc10c5c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_20ec2706cb852aebe08afc84fc10c5c1.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F04%252F2c04cb20ae4fa91867fe5f36a1c5e7a2%252Fpa%252FUJ06873_3b9d05abca251572232f6fbb3b628e25.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_3b9d05abca251572232f6fbb3b628e25.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F04%252F2c04cb20ae4fa91867fe5f36a1c5e7a2%252Fpa%252FUJ06873_607b2607985acd903a731ee068723275.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_607b2607985acd903a731ee068723275.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F04%252F2c04cb20ae4fa91867fe5f36a1c5e7a2%252Fpa%252FUJ06873_9b6ab7e9cdaac756a3f8fea03a217223.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_9b6ab7e9cdaac756a3f8fea03a217223.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F04%252F2c04cb20ae4fa91867fe5f36a1c5e7a2%252Fpa%252FUJ06873_aca591c493287f35cf4e302a9d1ee8c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_aca591c493287f35cf4e302a9d1ee8c6.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F04%252F2c04cb20ae4fa91867fe5f36a1c5e7a2%252Fpa%252FUJ06873_571d39ea66f58350e5292a14b0597871.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_571d39ea66f58350e5292a14b0597871.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F04%252F2c04cb20ae4fa91867fe5f36a1c5e7a2%252Fpa%252FUJ06873_36256f719c0dfb6e7ea7936c8084a0f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_36256f719c0dfb6e7ea7936c8084a0f3.jpg already downloaded
2026-03-28 18:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c, identifier: UJ06873
2026-03-28 18:47:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb10b814-2a1b-5190-ae90-62811cbea39f with identifier: WS15050
2026-03-28 18:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb10b814-2a1b-5190-ae90-62811cbea39f with scrape type 1
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb10b814-2a1b-5190-ae90-62811cbea39f
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffb%252Fd8fbfe1d315df349ee4f8756bdf03c9b%252Fpa%252FWS15050_c96b5926fa854eaaf809b70681b1a291.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_c96b5926fa854eaaf809b70681b1a291.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffb%252Fd8fbfe1d315df349ee4f8756bdf03c9b%252Fpa%252FWS15050_9137283d5129b68f4e0cbf7b7c187ba3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_9137283d5129b68f4e0cbf7b7c187ba3.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffb%252Fd8fbfe1d315df349ee4f8756bdf03c9b%252Fpa%252FWS15050_942cc01042fc1a81016259f51926060b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_942cc01042fc1a81016259f51926060b.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffb%252Fd8fbfe1d315df349ee4f8756bdf03c9b%252Fpa%252FWS15050_e16d13e41c6923f90bdd9b198a2e2e94.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_e16d13e41c6923f90bdd9b198a2e2e94.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffb%252Fd8fbfe1d315df349ee4f8756bdf03c9b%252Fpa%252FWS15050_c2a83b7046a80a3181c1b7aa4ee67b2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_c2a83b7046a80a3181c1b7aa4ee67b2b.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffb%252Fd8fbfe1d315df349ee4f8756bdf03c9b%252Fpa%252FWS15050_0a8781756d642e83fb6344232a6f7a4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_0a8781756d642e83fb6344232a6f7a4e.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffb%252Fd8fbfe1d315df349ee4f8756bdf03c9b%252Fpa%252FWS15050_b7d0a729402782aa46dba2670c80ebc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_b7d0a729402782aa46dba2670c80ebc9.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffb%252Fd8fbfe1d315df349ee4f8756bdf03c9b%252Fpa%252FWS15050_ba7c9de381475b4f924d6eeabbad5844.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_ba7c9de381475b4f924d6eeabbad5844.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffb%252Fd8fbfe1d315df349ee4f8756bdf03c9b%252Fpa%252FWS15050_0e985e589d3016fda920ff8fcf124496.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_0e985e589d3016fda920ff8fcf124496.jpg already downloaded
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Ffb%252Fd8fbfe1d315df349ee4f8756bdf03c9b%252Fpa%252FWS15050_6cc2fd7e04cdcc0c11f8d83756afbd3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_6cc2fd7e04cdcc0c11f8d83756afbd3e.jpg already downloaded
2026-03-28 18:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb10b814-2a1b-5190-ae90-62811cbea39f, identifier: WS15050
2026-03-28 18:47:41 [auto1.de] INFO: Found listing with ID: ZT00661
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00661%27 HTTP/1.1" 200 None
2026-03-28 18:47:41 [auto1.de] INFO: Scrape type for ZT00661: 1
2026-03-28 18:47:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c with identifier: UJ06873
2026-03-28 18:47:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c with identifier: UJ06873
2026-03-28 18:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c with identifier: UJ06873 to the API
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UJ06873>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:45:36Z',
 'fuel_type': 'petrol',
 'id': 'f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ06873',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 146519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_3188700e1e34edc49c17b55d44d5a60b.jpg',
                'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_f36965e489374a1120ab93c811f1d3a9.jpg',
                'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_4a6b5534ac0365fa2e1e73b7636bc50e.jpg',
                'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_20ec2706cb852aebe08afc84fc10c5c1.jpg',
                'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_3b9d05abca251572232f6fbb3b628e25.jpg',
                'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_607b2607985acd903a731ee068723275.jpg',
                'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_9b6ab7e9cdaac756a3f8fea03a217223.jpg',
                'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_aca591c493287f35cf4e302a9d1ee8c6.jpg',
                'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_571d39ea66f58350e5292a14b0597871.jpg',
                'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_36256f719c0dfb6e7ea7936c8084a0f3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c/f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_3188700e1e34edc49c17b55d44d5a60b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c/f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_f36965e489374a1120ab93c811f1d3a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c/f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_4a6b5534ac0365fa2e1e73b7636bc50e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c/f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_20ec2706cb852aebe08afc84fc10c5c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c/f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_3b9d05abca251572232f6fbb3b628e25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c/f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_607b2607985acd903a731ee068723275.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c/f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_9b6ab7e9cdaac756a3f8fea03a217223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c/f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_aca591c493287f35cf4e302a9d1ee8c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c/f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_571d39ea66f58350e5292a14b0597871.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c/f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/04/2c04cb20ae4fa91867fe5f36a1c5e7a2/pa/UJ06873_36256f719c0dfb6e7ea7936c8084a0f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 2.0 TCe Renault Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2015}
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ06873%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [auto1.de] INFO: Saving data for UJ06873: {'created_time': 1774723662.08247, 'last_price_update_time': 1774723662.082482, 'auction_closing_time': 1774885536.0}
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ06873') HTTP/1.1" 204 0
2026-03-28 18:47:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb10b814-2a1b-5190-ae90-62811cbea39f with identifier: WS15050
2026-03-28 18:47:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb10b814-2a1b-5190-ae90-62811cbea39f with identifier: WS15050
2026-03-28 18:47:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb10b814-2a1b-5190-ae90-62811cbea39f with identifier: WS15050 to the API
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WS15050>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:16:18Z',
 'fuel_type': 'petrol',
 'id': 'bb10b814-2a1b-5190-ae90-62811cbea39f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS15050',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'BMW',
 'model': '5er',
 'odometer': 171435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_c96b5926fa854eaaf809b70681b1a291.jpg',
                'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_9137283d5129b68f4e0cbf7b7c187ba3.jpg',
                'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_942cc01042fc1a81016259f51926060b.jpg',
                'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_e16d13e41c6923f90bdd9b198a2e2e94.jpg',
                'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_c2a83b7046a80a3181c1b7aa4ee67b2b.jpg',
                'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_0a8781756d642e83fb6344232a6f7a4e.jpg',
                'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_b7d0a729402782aa46dba2670c80ebc9.jpg',
                'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_ba7c9de381475b4f924d6eeabbad5844.jpg',
                'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_0e985e589d3016fda920ff8fcf124496.jpg',
                'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_6cc2fd7e04cdcc0c11f8d83756afbd3e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb10b814-2a1b-5190-ae90-62811cbea39f/bb10b814-2a1b-5190-ae90-62811cbea39f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_c96b5926fa854eaaf809b70681b1a291.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb10b814-2a1b-5190-ae90-62811cbea39f/bb10b814-2a1b-5190-ae90-62811cbea39f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_9137283d5129b68f4e0cbf7b7c187ba3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb10b814-2a1b-5190-ae90-62811cbea39f/bb10b814-2a1b-5190-ae90-62811cbea39f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_942cc01042fc1a81016259f51926060b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb10b814-2a1b-5190-ae90-62811cbea39f/bb10b814-2a1b-5190-ae90-62811cbea39f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_e16d13e41c6923f90bdd9b198a2e2e94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb10b814-2a1b-5190-ae90-62811cbea39f/bb10b814-2a1b-5190-ae90-62811cbea39f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_c2a83b7046a80a3181c1b7aa4ee67b2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb10b814-2a1b-5190-ae90-62811cbea39f/bb10b814-2a1b-5190-ae90-62811cbea39f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_0a8781756d642e83fb6344232a6f7a4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb10b814-2a1b-5190-ae90-62811cbea39f/bb10b814-2a1b-5190-ae90-62811cbea39f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_b7d0a729402782aa46dba2670c80ebc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb10b814-2a1b-5190-ae90-62811cbea39f/bb10b814-2a1b-5190-ae90-62811cbea39f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_ba7c9de381475b4f924d6eeabbad5844.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb10b814-2a1b-5190-ae90-62811cbea39f/bb10b814-2a1b-5190-ae90-62811cbea39f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_0e985e589d3016fda920ff8fcf124496.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb10b814-2a1b-5190-ae90-62811cbea39f/bb10b814-2a1b-5190-ae90-62811cbea39f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/fb/d8fbfe1d315df349ee4f8756bdf03c9b/pa/WS15050_6cc2fd7e04cdcc0c11f8d83756afbd3e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS15050%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [auto1.de] INFO: Saving data for WS15050: {'created_time': 1774723662.418964, 'last_price_update_time': 1774723662.418979, 'auction_closing_time': 1774883778.0}
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS15050') HTTP/1.1" 204 0
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_39d2c69366f333b76b3bf4836fd5fa17.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_39d2c69366f333b76b3bf4836fd5fa17.jpg not downloaded yet
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F3c%252F1d3c0833481960d335a56b3a5f45b80f%252Fpa%252FAU58197_1788afae752c4e5fd5a0c30c89e59164.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_1788afae752c4e5fd5a0c30c89e59164.jpg not downloaded yet
2026-03-28 18:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR32445> (referer: https://www.auto1.com/v1/car-details-view/KR32445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP09567/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: WC65602
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG46200%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [auto1.de] INFO: Scrape type for DG46200: 0
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU17582%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [auto1.de] INFO: Scrape type for BU17582: 0
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN71880%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [auto1.de] INFO: Scrape type for HN71880: 0
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62888%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [auto1.de] INFO: Scrape type for UT62888: 0
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN24608%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [auto1.de] INFO: Scrape type for CN24608: 0
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE39564%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [auto1.de] INFO: Scrape type for BE39564: 0
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-28 18:47:42 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-28 18:47:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_0c366f27e24325204a2d8f6c3db1055a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_0c366f27e24325204a2d8f6c3db1055a.jpg not downloaded yet
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F3c%252F1d3c0833481960d335a56b3a5f45b80f%252Fpa%252FAU58197_019496279593ba8b3f9e26b95b4f0f98.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_019496279593ba8b3f9e26b95b4f0f98.jpg not downloaded yet
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F3c%252F1d3c0833481960d335a56b3a5f45b80f%252Fpa%252FAU58197_e7b5fc0d3bf4adfbaa62dd0da3e19c73.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_e7b5fc0d3bf4adfbaa62dd0da3e19c73.jpg not downloaded yet
2026-03-28 18:47:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfb61f94-294e-5efc-92a7-e3a616506273 with identifier: KR32445
2026-03-28 18:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb61f94-294e-5efc-92a7-e3a616506273 with scrape type 1
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dfb61f94-294e-5efc-92a7-e3a616506273
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_af908be27b0f456db0d97e4bed480320.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_af908be27b0f456db0d97e4bed480320.jpg not downloaded yet
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F3c%252F1d3c0833481960d335a56b3a5f45b80f%252Fpa%252FAU58197_f865fe837a79ee700c964c5970bea4b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_f865fe837a79ee700c964c5970bea4b3.jpg not downloaded yet
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_bdd261086f0722742d97da70c38c8142.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_bdd261086f0722742d97da70c38c8142.jpg not downloaded yet
2026-03-28 18:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_1788afae752c4e5fd5a0c30c89e59164.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_cac4693198837ec20ae870524cf64c30.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_cac4693198837ec20ae870524cf64c30.jpg not downloaded yet
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_0e7039eb2bfe10115ca13d0c6e095cfe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_0e7039eb2bfe10115ca13d0c6e095cfe.jpg not downloaded yet
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_141a0315a05e746297c35eeed3e996c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_141a0315a05e746297c35eeed3e996c2.jpg not downloaded yet
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_67d906976437a1c329e8c74f3221cc6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_67d906976437a1c329e8c74f3221cc6a.jpg not downloaded yet
2026-03-28 18:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_3c1dd446b1d5a71a71fc0f23469314a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_118035cceefa308050d7f2fbdb079066.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_118035cceefa308050d7f2fbdb079066.jpg not downloaded yet
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_1651d47ca0ce0c7f3da7c459bbc661fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_1651d47ca0ce0c7f3da7c459bbc661fb.jpg not downloaded yet
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_7ed31c0bcc71d9f855cb02493c8a5f1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_7ed31c0bcc71d9f855cb02493c8a5f1f.jpg not downloaded yet
2026-03-28 18:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_67c89a1fb0d2d2099ae28507d7b7ef4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_3105ed6a7f33f0b130a7978430c26702.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_3105ed6a7f33f0b130a7978430c26702.jpg not downloaded yet
2026-03-28 18:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_bdd261086f0722742d97da70c38c8142.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562b8610>
2026-03-28 18:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b146ce1-64f4-5f09-b063-75c40ebf65b8/8b146ce1-64f4-5f09-b063-75c40ebf65b8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F3c%252F1d3c0833481960d335a56b3a5f45b80f%252Fpa%252FAU58197_1788afae752c4e5fd5a0c30c89e59164.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_1788afae752c4e5fd5a0c30c89e59164.jpg saved to cache
2026-03-28 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b146ce1-64f4-5f09-b063-75c40ebf65b8
2026-03-28 18:47:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561a5150>
2026-03-28 18:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_3c1dd446b1d5a71a71fc0f23469314a9.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_3c1dd446b1d5a71a71fc0f23469314a9.jpg saved to cache
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9ab4fc4-4c34-5084-87f2-38a39718a000
2026-03-28 18:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_67d906976437a1c329e8c74f3221cc6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561dbfd0>
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_67c89a1fb0d2d2099ae28507d7b7ef4c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_67c89a1fb0d2d2099ae28507d7b7ef4c.jpg saved to cache
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9ab4fc4-4c34-5084-87f2-38a39718a000
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475f510>
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_bdd261086f0722742d97da70c38c8142.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_bdd261086f0722742d97da70c38c8142.jpg saved to cache
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfb61f94-294e-5efc-92a7-e3a616506273
2026-03-28 18:47:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454667550>
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_67d906976437a1c329e8c74f3221cc6a.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_67d906976437a1c329e8c74f3221cc6a.jpg saved to cache
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfb61f94-294e-5efc-92a7-e3a616506273
2026-03-28 18:47:43 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 6019 | hits on page: 40
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV82579%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for WV82579: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP80469%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for ZP80469: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW56448%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for CW56448: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL34972%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for DL34972: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD10006%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for ZD10006: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32904%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for FX32904: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB79978%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for PB79978: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX18437%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for SX18437: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF30877%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for GF30877: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD84483%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for CD84483: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM88868%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for GM88868: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT60125%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for AT60125: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA47251%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for WA47251: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64872%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for RC64872: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV73009%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for GV73009: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63291%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for SR63291: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP03101%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for EP03101: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA64256%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for HA64256: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH34221%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [auto1.de] INFO: Scrape type for BH34221: 0
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-28 18:47:43 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-28 18:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV25001> (referer: https://www.auto1.com/v1/car-details-view/YV25001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_1651d47ca0ce0c7f3da7c459bbc661fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_118035cceefa308050d7f2fbdb079066.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_3105ed6a7f33f0b130a7978430c26702.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_7ed31c0bcc71d9f855cb02493c8a5f1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_639536d7226db8a0bc14344b4c610813.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_39d2c69366f333b76b3bf4836fd5fa17.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_f865fe837a79ee700c964c5970bea4b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP86808> (referer: https://www.auto1.com/v1/car-details-view/EP86808/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8 with identifier: YV25001
2026-03-28 18:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8 with scrape type 1
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5c%252F215c37665e5667b7bcaf917663aade5f%252Fpa%252FYV25001_465cc8e2e937acbded070b6b9fc06bdb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_465cc8e2e937acbded070b6b9fc06bdb.jpg not downloaded yet
2026-03-28 18:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_141a0315a05e746297c35eeed3e996c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5c%252F215c37665e5667b7bcaf917663aade5f%252Fpa%252FYV25001_22e6f4d6304073ac20a6c727f98c0a67.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_22e6f4d6304073ac20a6c727f98c0a67.jpg not downloaded yet
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245605d150>
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_1651d47ca0ce0c7f3da7c459bbc661fb.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_1651d47ca0ce0c7f3da7c459bbc661fb.jpg saved to cache
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dfb61f94-294e-5efc-92a7-e3a616506273
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562ba310>
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_118035cceefa308050d7f2fbdb079066.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_118035cceefa308050d7f2fbdb079066.jpg saved to cache
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfb61f94-294e-5efc-92a7-e3a616506273
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454791050>
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_3105ed6a7f33f0b130a7978430c26702.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_3105ed6a7f33f0b130a7978430c26702.jpg saved to cache
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dfb61f94-294e-5efc-92a7-e3a616506273
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564d3190>
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_7ed31c0bcc71d9f855cb02493c8a5f1f.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_7ed31c0bcc71d9f855cb02493c8a5f1f.jpg saved to cache
2026-03-28 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dfb61f94-294e-5efc-92a7-e3a616506273
2026-03-28 18:47:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562e2e50>
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_639536d7226db8a0bc14344b4c610813.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_639536d7226db8a0bc14344b4c610813.jpg saved to cache
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f817086f-9b8d-58d2-abb9-afae8991c669
2026-03-28 18:47:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454711d50>
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_39d2c69366f333b76b3bf4836fd5fa17.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_39d2c69366f333b76b3bf4836fd5fa17.jpg saved to cache
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f817086f-9b8d-58d2-abb9-afae8991c669
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5c%252F215c37665e5667b7bcaf917663aade5f%252Fpa%252FYV25001_13f7ed46491f4ba5a866a91fa35eca21.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_13f7ed46491f4ba5a866a91fa35eca21.jpg not downloaded yet
2026-03-28 18:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_0e7039eb2bfe10115ca13d0c6e095cfe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_cac4693198837ec20ae870524cf64c30.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5c%252F215c37665e5667b7bcaf917663aade5f%252Fpa%252FYV25001_60e5db0c7d6441d6fccd2e7c1b233380.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_60e5db0c7d6441d6fccd2e7c1b233380.jpg not downloaded yet
2026-03-28 18:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR75246/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547cc910>
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b146ce1-64f4-5f09-b063-75c40ebf65b8/8b146ce1-64f4-5f09-b063-75c40ebf65b8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F3c%252F1d3c0833481960d335a56b3a5f45b80f%252Fpa%252FAU58197_f865fe837a79ee700c964c5970bea4b3.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_f865fe837a79ee700c964c5970bea4b3.jpg saved to cache
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b146ce1-64f4-5f09-b063-75c40ebf65b8
2026-03-28 18:47:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 924edd99-4850-51d7-a327-18cce27c82df with identifier: EP86808
2026-03-28 18:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 924edd99-4850-51d7-a327-18cce27c82df with scrape type 1
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 924edd99-4850-51d7-a327-18cce27c82df
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_ff28546020c645596bccdc66d7594d1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_ff28546020c645596bccdc66d7594d1c.jpg not downloaded yet
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562cb210>
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_141a0315a05e746297c35eeed3e996c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_141a0315a05e746297c35eeed3e996c2.jpg saved to cache
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfb61f94-294e-5efc-92a7-e3a616506273
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5c%252F215c37665e5667b7bcaf917663aade5f%252Fpa%252FYV25001_12e9c463b615d393af06127eb6561ed9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_12e9c463b615d393af06127eb6561ed9.jpg not downloaded yet
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_0a16434e7756c2fe84a11718415d712d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_0a16434e7756c2fe84a11718415d712d.jpg not downloaded yet
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561970d0>
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_0e7039eb2bfe10115ca13d0c6e095cfe.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_0e7039eb2bfe10115ca13d0c6e095cfe.jpg saved to cache
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfb61f94-294e-5efc-92a7-e3a616506273
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454829710>
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_cac4693198837ec20ae870524cf64c30.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_cac4693198837ec20ae870524cf64c30.jpg saved to cache
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfb61f94-294e-5efc-92a7-e3a616506273
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_20ee16a523025a0e5ef924aa4bb074e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_20ee16a523025a0e5ef924aa4bb074e6.jpg not downloaded yet
2026-03-28 18:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_e7b5fc0d3bf4adfbaa62dd0da3e19c73.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_af908be27b0f456db0d97e4bed480320.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_465cc8e2e937acbded070b6b9fc06bdb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_13f7ed46491f4ba5a866a91fa35eca21.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_019496279593ba8b3f9e26b95b4f0f98.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_2c2c7820c7b34e458841ffa5a31084de.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_2c2c7820c7b34e458841ffa5a31084de.jpg not downloaded yet
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_595948ceee21783b838a702bd5718caa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_595948ceee21783b838a702bd5718caa.jpg not downloaded yet
2026-03-28 18:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA98416> (referer: https://www.auto1.com/v1/car-details-view/VA98416/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_73ff48b9270ba7bfb16a7da7955341b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_73ff48b9270ba7bfb16a7da7955341b8.jpg not downloaded yet
2026-03-28 18:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_0c366f27e24325204a2d8f6c3db1055a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_203b3f5d18c018180183e0ad5bf2fff6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_203b3f5d18c018180183e0ad5bf2fff6.jpg not downloaded yet
2026-03-28 18:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_12e9c463b615d393af06127eb6561ed9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_ec4f76bd14b676a9e7fe3a7b1afd220b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_ec4f76bd14b676a9e7fe3a7b1afd220b.jpg not downloaded yet
2026-03-28 18:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_22e6f4d6304073ac20a6c727f98c0a67.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_e5ac25ad5db29adba771c31ded34544e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_e5ac25ad5db29adba771c31ded34544e.jpg not downloaded yet
2026-03-28 18:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_60e5db0c7d6441d6fccd2e7c1b233380.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456073190>
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b146ce1-64f4-5f09-b063-75c40ebf65b8/8b146ce1-64f4-5f09-b063-75c40ebf65b8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F3c%252F1d3c0833481960d335a56b3a5f45b80f%252Fpa%252FAU58197_e7b5fc0d3bf4adfbaa62dd0da3e19c73.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_e7b5fc0d3bf4adfbaa62dd0da3e19c73.jpg saved to cache
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b146ce1-64f4-5f09-b063-75c40ebf65b8
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245610d650>
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a9d8e81cc58c21161523bf8272804%252Fpa%252FKR32445_af908be27b0f456db0d97e4bed480320.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_af908be27b0f456db0d97e4bed480320.jpg saved to cache
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfb61f94-294e-5efc-92a7-e3a616506273
2026-03-28 18:47:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfb61f94-294e-5efc-92a7-e3a616506273, skipping ID generation
2026-03-28 18:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb61f94-294e-5efc-92a7-e3a616506273 with scrape type 1
2026-03-28 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfb61f94-294e-5efc-92a7-e3a616506273 sending to next pipeline
2026-03-28 18:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfb61f94-294e-5efc-92a7-e3a616506273, identifier: KR32445
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454791090>
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8/6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5c%252F215c37665e5667b7bcaf917663aade5f%252Fpa%252FYV25001_465cc8e2e937acbded070b6b9fc06bdb.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_465cc8e2e937acbded070b6b9fc06bdb.jpg saved to cache
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245477db10>
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8/6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5c%252F215c37665e5667b7bcaf917663aade5f%252Fpa%252FYV25001_13f7ed46491f4ba5a866a91fa35eca21.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_13f7ed46491f4ba5a866a91fa35eca21.jpg saved to cache
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562a6190>
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b146ce1-64f4-5f09-b063-75c40ebf65b8/8b146ce1-64f4-5f09-b063-75c40ebf65b8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F3c%252F1d3c0833481960d335a56b3a5f45b80f%252Fpa%252FAU58197_019496279593ba8b3f9e26b95b4f0f98.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_019496279593ba8b3f9e26b95b4f0f98.jpg saved to cache
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b146ce1-64f4-5f09-b063-75c40ebf65b8
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_23b35801c446b7f2f9fc2fa705a267a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_23b35801c446b7f2f9fc2fa705a267a9.jpg not downloaded yet
2026-03-28 18:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfb61f94-294e-5efc-92a7-e3a616506273 with identifier: KR32445
2026-03-28 18:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfb61f94-294e-5efc-92a7-e3a616506273 with identifier: KR32445
2026-03-28 18:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfb61f94-294e-5efc-92a7-e3a616506273 with identifier: KR32445 to the API
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_af908be27b0f456db0d97e4bed480320.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 299,
 'expiration_date': '2026-03-30T15:28:00Z',
 'fuel_type': 'hybrid',
 'id': 'dfb61f94-294e-5efc-92a7-e3a616506273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR32445',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 97017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_af908be27b0f456db0d97e4bed480320.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_bdd261086f0722742d97da70c38c8142.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_cac4693198837ec20ae870524cf64c30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_0e7039eb2bfe10115ca13d0c6e095cfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_141a0315a05e746297c35eeed3e996c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_67d906976437a1c329e8c74f3221cc6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_118035cceefa308050d7f2fbdb079066.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_1651d47ca0ce0c7f3da7c459bbc661fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_7ed31c0bcc71d9f855cb02493c8a5f1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb61f94-294e-5efc-92a7-e3a616506273/dfb61f94-294e-5efc-92a7-e3a616506273_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a9d8e81cc58c21161523bf8272804/pa/KR32445_3105ed6a7f33f0b130a7978430c26702.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid Be Chic 4x4',
 'transmission': 'automatic',
 'trim': 'Be Chic 4x4',
 'year': 2020}
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR32445%27 HTTP/1.1" 200 None
2026-03-28 18:47:45 [auto1.de] INFO: Saving data for KR32445: {'created_time': 1774723665.485196, 'last_price_update_time': 1774723665.485207, 'auction_closing_time': 1774884480.0}
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR32445') HTTP/1.1" 204 0
2026-03-28 18:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_203b3f5d18c018180183e0ad5bf2fff6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR79425> (referer: https://www.auto1.com/v1/car-details-view/NR79425/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR28195/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8661c2eb-31db-51be-86b6-a83a7d17c61d with identifier: VA98416
2026-03-28 18:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8661c2eb-31db-51be-86b6-a83a7d17c61d with scrape type 1
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8661c2eb-31db-51be-86b6-a83a7d17c61d
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F80%252Fe680890fdd9a003228f57ed5936f676c%252Fpa%252FVA98416_9dd9a169bf22fe04f1bdf88c05e507e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_9dd9a169bf22fe04f1bdf88c05e507e5.jpg not downloaded yet
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245628fc50>
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_0c366f27e24325204a2d8f6c3db1055a.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_0c366f27e24325204a2d8f6c3db1055a.jpg saved to cache
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f817086f-9b8d-58d2-abb9-afae8991c669
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547e4810>
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8/6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5c%252F215c37665e5667b7bcaf917663aade5f%252Fpa%252FYV25001_12e9c463b615d393af06127eb6561ed9.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_12e9c463b615d393af06127eb6561ed9.jpg saved to cache
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456286210>
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8/6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5c%252F215c37665e5667b7bcaf917663aade5f%252Fpa%252FYV25001_22e6f4d6304073ac20a6c727f98c0a67.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_22e6f4d6304073ac20a6c727f98c0a67.jpg saved to cache
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618a010>
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8/6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F5c%252F215c37665e5667b7bcaf917663aade5f%252Fpa%252FYV25001_60e5db0c7d6441d6fccd2e7c1b233380.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_60e5db0c7d6441d6fccd2e7c1b233380.jpg saved to cache
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8
2026-03-28 18:47:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8, skipping ID generation
2026-03-28 18:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8 with scrape type 1
2026-03-28 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8 sending to next pipeline
2026-03-28 18:47:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8, identifier: YV25001
2026-03-28 18:47:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE41699> (referer: https://www.auto1.com/v1/car-details-view/KE41699/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8 with identifier: YV25001
2026-03-28 18:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8 with identifier: YV25001
2026-03-28 18:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8 with identifier: YV25001 to the API
2026-03-28 18:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_60e5db0c7d6441d6fccd2e7c1b233380.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:41:39Z',
 'fuel_type': 'petrol',
 'id': '6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV25001',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 101992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8/6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_465cc8e2e937acbded070b6b9fc06bdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8/6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_22e6f4d6304073ac20a6c727f98c0a67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8/6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_13f7ed46491f4ba5a866a91fa35eca21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8/6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_60e5db0c7d6441d6fccd2e7c1b233380.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8/6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/5c/215c37665e5667b7bcaf917663aade5f/pa/YV25001_12e9c463b615d393af06127eb6561ed9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV25001%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [auto1.de] INFO: Saving data for YV25001: {'created_time': 1774723666.264173, 'last_price_update_time': 1774723666.264185, 'auction_closing_time': 1774885299.0}
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV25001') HTTP/1.1" 204 0
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F80%252Fe680890fdd9a003228f57ed5936f676c%252Fpa%252FVA98416_415c678360543c508ab14f4a78fccc4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_415c678360543c508ab14f4a78fccc4c.jpg not downloaded yet
2026-03-28 18:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_595948ceee21783b838a702bd5718caa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245636cb90>
2026-03-28 18:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_203b3f5d18c018180183e0ad5bf2fff6.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_203b3f5d18c018180183e0ad5bf2fff6.jpg saved to cache
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 924edd99-4850-51d7-a327-18cce27c82df
2026-03-28 18:47:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: defa7b68-3dd7-559f-92dd-8169e04cc51a with identifier: NR79425
2026-03-28 18:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item defa7b68-3dd7-559f-92dd-8169e04cc51a with scrape type 1
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item defa7b68-3dd7-559f-92dd-8169e04cc51a
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_7bfc00bdf121263237465d94c5c4b90b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_7bfc00bdf121263237465d94c5c4b90b.jpg not downloaded yet
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F80%252Fe680890fdd9a003228f57ed5936f676c%252Fpa%252FVA98416_31f109666d346a9b5467ce72874353ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_31f109666d346a9b5467ce72874353ad.jpg not downloaded yet
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_b5023be0904d0c80f6a630f01d6d10ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_b5023be0904d0c80f6a630f01d6d10ec.jpg not downloaded yet
2026-03-28 18:47:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f with identifier: KE41699
2026-03-28 18:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f with scrape type 1
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F38%252F1838552f7a6c236ee247a3a0c268ae4a%252Fpa%252FKE41699_f7160539a940ce7ca73c4c3fce6aeb90.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_f7160539a940ce7ca73c4c3fce6aeb90.jpg already downloaded
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F38%252F1838552f7a6c236ee247a3a0c268ae4a%252Fpa%252FKE41699_8e293b9dc3ad57d846e316847b16776a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_8e293b9dc3ad57d846e316847b16776a.jpg already downloaded
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F38%252F1838552f7a6c236ee247a3a0c268ae4a%252Fpa%252FKE41699_2730d2d54d966433f17260ea3f34051c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_2730d2d54d966433f17260ea3f34051c.jpg already downloaded
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F38%252F1838552f7a6c236ee247a3a0c268ae4a%252Fpa%252FKE41699_1145dc19fee102793c50f40c4b29771a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_1145dc19fee102793c50f40c4b29771a.jpg already downloaded
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F38%252F1838552f7a6c236ee247a3a0c268ae4a%252Fpa%252FKE41699_52da62c82b0c0d9263d5f8ce0605c622.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_52da62c82b0c0d9263d5f8ce0605c622.jpg already downloaded
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F38%252F1838552f7a6c236ee247a3a0c268ae4a%252Fpa%252FKE41699_86a4a3e46d59718810433fae77db5b11.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_86a4a3e46d59718810433fae77db5b11.jpg already downloaded
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F38%252F1838552f7a6c236ee247a3a0c268ae4a%252Fpa%252FKE41699_d29e44b3d3b351bdfa1ec51a543580e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_d29e44b3d3b351bdfa1ec51a543580e2.jpg already downloaded
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F38%252F1838552f7a6c236ee247a3a0c268ae4a%252Fpa%252FKE41699_5fa005de94b504ffe5a1faded142840b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_5fa005de94b504ffe5a1faded142840b.jpg already downloaded
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F38%252F1838552f7a6c236ee247a3a0c268ae4a%252Fpa%252FKE41699_3e737326ed63d04cc6d9fc69b05b7627.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_3e737326ed63d04cc6d9fc69b05b7627.jpg already downloaded
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F38%252F1838552f7a6c236ee247a3a0c268ae4a%252Fpa%252FKE41699_1210fb21e4ca9e7455744640d84238a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_1210fb21e4ca9e7455744640d84238a1.jpg already downloaded
2026-03-28 18:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f, identifier: KE41699
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F80%252Fe680890fdd9a003228f57ed5936f676c%252Fpa%252FVA98416_9701e29bf6c8ed83709aa7e2a9e60790.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_9701e29bf6c8ed83709aa7e2a9e60790.jpg not downloaded yet
2026-03-28 18:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f with identifier: KE41699
2026-03-28 18:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f with identifier: KE41699
2026-03-28 18:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f with identifier: KE41699 to the API
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KE41699>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:33:23Z',
 'fuel_type': 'diesel',
 'id': '1b9cda7c-81b7-54fb-bafb-c8efb2ff038f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE41699',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 145600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_f7160539a940ce7ca73c4c3fce6aeb90.jpg',
                'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_8e293b9dc3ad57d846e316847b16776a.jpg',
                'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_2730d2d54d966433f17260ea3f34051c.jpg',
                'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_1145dc19fee102793c50f40c4b29771a.jpg',
                'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_52da62c82b0c0d9263d5f8ce0605c622.jpg',
                'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_86a4a3e46d59718810433fae77db5b11.jpg',
                'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_d29e44b3d3b351bdfa1ec51a543580e2.jpg',
                'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_5fa005de94b504ffe5a1faded142840b.jpg',
                'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_3e737326ed63d04cc6d9fc69b05b7627.jpg',
                'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_1210fb21e4ca9e7455744640d84238a1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9cda7c-81b7-54fb-bafb-c8efb2ff038f/1b9cda7c-81b7-54fb-bafb-c8efb2ff038f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_f7160539a940ce7ca73c4c3fce6aeb90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9cda7c-81b7-54fb-bafb-c8efb2ff038f/1b9cda7c-81b7-54fb-bafb-c8efb2ff038f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_8e293b9dc3ad57d846e316847b16776a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9cda7c-81b7-54fb-bafb-c8efb2ff038f/1b9cda7c-81b7-54fb-bafb-c8efb2ff038f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_2730d2d54d966433f17260ea3f34051c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9cda7c-81b7-54fb-bafb-c8efb2ff038f/1b9cda7c-81b7-54fb-bafb-c8efb2ff038f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_1145dc19fee102793c50f40c4b29771a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9cda7c-81b7-54fb-bafb-c8efb2ff038f/1b9cda7c-81b7-54fb-bafb-c8efb2ff038f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3294657,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_52da62c82b0c0d9263d5f8ce0605c622.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9cda7c-81b7-54fb-bafb-c8efb2ff038f/1b9cda7c-81b7-54fb-bafb-c8efb2ff038f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_86a4a3e46d59718810433fae77db5b11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9cda7c-81b7-54fb-bafb-c8efb2ff038f/1b9cda7c-81b7-54fb-bafb-c8efb2ff038f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_d29e44b3d3b351bdfa1ec51a543580e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9cda7c-81b7-54fb-bafb-c8efb2ff038f/1b9cda7c-81b7-54fb-bafb-c8efb2ff038f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_5fa005de94b504ffe5a1faded142840b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9cda7c-81b7-54fb-bafb-c8efb2ff038f/1b9cda7c-81b7-54fb-bafb-c8efb2ff038f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_3e737326ed63d04cc6d9fc69b05b7627.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b9cda7c-81b7-54fb-bafb-c8efb2ff038f/1b9cda7c-81b7-54fb-bafb-c8efb2ff038f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/38/1838552f7a6c236ee247a3a0c268ae4a/pa/KE41699_1210fb21e4ca9e7455744640d84238a1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
 'transmission': 'automatic',
 'trim': 'T BlueTEC',
 'year': 2015}
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE41699%27 HTTP/1.1" 200 None
2026-03-28 18:47:47 [auto1.de] INFO: Saving data for KE41699: {'created_time': 1774723667.075393, 'last_price_update_time': 1774723667.075403, 'auction_closing_time': 1774884803.0}
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE41699') HTTP/1.1" 204 0
2026-03-28 18:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_e5ac25ad5db29adba771c31ded34544e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_90f663e56aa4bcfbb0f4743d9f922cc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_90f663e56aa4bcfbb0f4743d9f922cc1.jpg not downloaded yet
2026-03-28 18:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_2c2c7820c7b34e458841ffa5a31084de.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F80%252Fe680890fdd9a003228f57ed5936f676c%252Fpa%252FVA98416_11d8b742d33d1633e1e28d66b71b9ccc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_11d8b742d33d1633e1e28d66b71b9ccc.jpg not downloaded yet
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456096650>
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_595948ceee21783b838a702bd5718caa.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_595948ceee21783b838a702bd5718caa.jpg saved to cache
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 924edd99-4850-51d7-a327-18cce27c82df
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_b0388d7c56d5230efd0b01667959b14a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_b0388d7c56d5230efd0b01667959b14a.jpg not downloaded yet
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_1d40a8b22b49bfe77c7b3ef89dfd1977.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_1d40a8b22b49bfe77c7b3ef89dfd1977.jpg not downloaded yet
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_99e0b8b5e87103203a52399dabb4997c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_99e0b8b5e87103203a52399dabb4997c.jpg not downloaded yet
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bf310>
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_e5ac25ad5db29adba771c31ded34544e.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_e5ac25ad5db29adba771c31ded34544e.jpg saved to cache
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 924edd99-4850-51d7-a327-18cce27c82df
2026-03-28 18:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_9dd9a169bf22fe04f1bdf88c05e507e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_63b354848a7f2a9c072bc2eca9b5c25b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_63b354848a7f2a9c072bc2eca9b5c25b.jpg not downloaded yet
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245603e7d0>
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_2c2c7820c7b34e458841ffa5a31084de.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_2c2c7820c7b34e458841ffa5a31084de.jpg saved to cache
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 924edd99-4850-51d7-a327-18cce27c82df
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_09773060b8e6269f458528185eaac20b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_09773060b8e6269f458528185eaac20b.jpg not downloaded yet
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_be68914a298b0ff253ff19feb95a480a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_be68914a298b0ff253ff19feb95a480a.jpg not downloaded yet
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_319b14945d54e80c8e0d318b3b9dc806.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_319b14945d54e80c8e0d318b3b9dc806.jpg not downloaded yet
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245649d050>
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8661c2eb-31db-51be-86b6-a83a7d17c61d/8661c2eb-31db-51be-86b6-a83a7d17c61d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F80%252Fe680890fdd9a003228f57ed5936f676c%252Fpa%252FVA98416_9dd9a169bf22fe04f1bdf88c05e507e5.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_9dd9a169bf22fe04f1bdf88c05e507e5.jpg saved to cache
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8661c2eb-31db-51be-86b6-a83a7d17c61d
2026-03-28 18:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_9701e29bf6c8ed83709aa7e2a9e60790.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_ff28546020c645596bccdc66d7594d1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_0a16434e7756c2fe84a11718415d712d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_20ee16a523025a0e5ef924aa4bb074e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_ec4f76bd14b676a9e7fe3a7b1afd220b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_73ff48b9270ba7bfb16a7da7955341b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_23b35801c446b7f2f9fc2fa705a267a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_b5023be0904d0c80f6a630f01d6d10ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456253610>
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8661c2eb-31db-51be-86b6-a83a7d17c61d/8661c2eb-31db-51be-86b6-a83a7d17c61d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F80%252Fe680890fdd9a003228f57ed5936f676c%252Fpa%252FVA98416_9701e29bf6c8ed83709aa7e2a9e60790.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_9701e29bf6c8ed83709aa7e2a9e60790.jpg saved to cache
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8661c2eb-31db-51be-86b6-a83a7d17c61d
2026-03-28 18:47:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618e1d0>
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_ff28546020c645596bccdc66d7594d1c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_ff28546020c645596bccdc66d7594d1c.jpg saved to cache
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 924edd99-4850-51d7-a327-18cce27c82df
2026-03-28 18:47:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245628d250>
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_0a16434e7756c2fe84a11718415d712d.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_0a16434e7756c2fe84a11718415d712d.jpg saved to cache
2026-03-28 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 924edd99-4850-51d7-a327-18cce27c82df
2026-03-28 18:47:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245855ac90>
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_20ee16a523025a0e5ef924aa4bb074e6.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_20ee16a523025a0e5ef924aa4bb074e6.jpg saved to cache
2026-03-28 18:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 924edd99-4850-51d7-a327-18cce27c82df
2026-03-28 18:47:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245628f990>
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_ec4f76bd14b676a9e7fe3a7b1afd220b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_ec4f76bd14b676a9e7fe3a7b1afd220b.jpg saved to cache
2026-03-28 18:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 924edd99-4850-51d7-a327-18cce27c82df
2026-03-28 18:47:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563e85d0>
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_73ff48b9270ba7bfb16a7da7955341b8.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_73ff48b9270ba7bfb16a7da7955341b8.jpg saved to cache
2026-03-28 18:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 924edd99-4850-51d7-a327-18cce27c82df
2026-03-28 18:47:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245628fa90>
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F6c%252Fb36cbd7936d7c4addb224db8411f7109%252Fpa%252FEP86808_23b35801c446b7f2f9fc2fa705a267a9.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_23b35801c446b7f2f9fc2fa705a267a9.jpg saved to cache
2026-03-28 18:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 924edd99-4850-51d7-a327-18cce27c82df
2026-03-28 18:47:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 924edd99-4850-51d7-a327-18cce27c82df, skipping ID generation
2026-03-28 18:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 924edd99-4850-51d7-a327-18cce27c82df with scrape type 1
2026-03-28 18:47:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 924edd99-4850-51d7-a327-18cce27c82df sending to next pipeline
2026-03-28 18:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 924edd99-4850-51d7-a327-18cce27c82df, identifier: EP86808
2026-03-28 18:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 924edd99-4850-51d7-a327-18cce27c82df with identifier: EP86808
2026-03-28 18:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 924edd99-4850-51d7-a327-18cce27c82df with identifier: EP86808
2026-03-28 18:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 924edd99-4850-51d7-a327-18cce27c82df with identifier: EP86808 to the API
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_23b35801c446b7f2f9fc2fa705a267a9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 158,
 'expiration_date': '2026-03-30T15:06:39Z',
 'fuel_type': 'petrol',
 'id': '924edd99-4850-51d7-a327-18cce27c82df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP86808',
 'listing': 'auction',
 'location': 'DE, Hannover',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 83493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2998989,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_ff28546020c645596bccdc66d7594d1c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3016425,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_0a16434e7756c2fe84a11718415d712d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3213050,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_20ee16a523025a0e5ef924aa4bb074e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_2c2c7820c7b34e458841ffa5a31084de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_595948ceee21783b838a702bd5718caa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3187451,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_73ff48b9270ba7bfb16a7da7955341b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_203b3f5d18c018180183e0ad5bf2fff6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3052894,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_ec4f76bd14b676a9e7fe3a7b1afd220b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_e5ac25ad5db29adba771c31ded34544e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_924edd99-4850-51d7-a327-18cce27c82df/924edd99-4850-51d7-a327-18cce27c82df_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3000074,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/6c/b36cbd7936d7c4addb224db8411f7109/pa/EP86808_23b35801c446b7f2f9fc2fa705a267a9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru Forester 2.0 X Comfort',
 'transmission': 'automatic',
 'trim': 'X Comfort',
 'year': 2006}
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP86808%27 HTTP/1.1" 200 None
2026-03-28 18:47:48 [auto1.de] INFO: Saving data for EP86808: {'created_time': 1774723668.846329, 'last_price_update_time': 1774723668.846342, 'auction_closing_time': 1774883199.0}
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP86808') HTTP/1.1" 204 0
2026-03-28 18:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_99e0b8b5e87103203a52399dabb4997c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP09567> (referer: https://www.auto1.com/v1/car-details-view/HP09567/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561d1dd0>
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_b5023be0904d0c80f6a630f01d6d10ec.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_b5023be0904d0c80f6a630f01d6d10ec.jpg saved to cache
2026-03-28 18:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item defa7b68-3dd7-559f-92dd-8169e04cc51a
2026-03-28 18:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_319b14945d54e80c8e0d318b3b9dc806.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245605b210>
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_99e0b8b5e87103203a52399dabb4997c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_99e0b8b5e87103203a52399dabb4997c.jpg saved to cache
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item defa7b68-3dd7-559f-92dd-8169e04cc51a
2026-03-28 18:47:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31a5ae1f-e733-5676-bc99-03dbf7e9b52c with identifier: HP09567
2026-03-28 18:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c with scrape type 1
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_f74f83f7a4058f43287787354b02ac2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_f74f83f7a4058f43287787354b02ac2c.jpg not downloaded yet
2026-03-28 18:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_31f109666d346a9b5467ce72874353ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_08b7a2f8c52f07f3ca4c22363646e561.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_08b7a2f8c52f07f3ca4c22363646e561.jpg not downloaded yet
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_731ae284277724b89c87a508b55cb049.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_731ae284277724b89c87a508b55cb049.jpg not downloaded yet
2026-03-28 18:47:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456498dd0>
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_319b14945d54e80c8e0d318b3b9dc806.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_319b14945d54e80c8e0d318b3b9dc806.jpg saved to cache
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item defa7b68-3dd7-559f-92dd-8169e04cc51a
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_8a6af4ca2b0821c00a08bddee2b3a13d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_8a6af4ca2b0821c00a08bddee2b3a13d.jpg not downloaded yet
2026-03-28 18:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_11d8b742d33d1633e1e28d66b71b9ccc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_90f663e56aa4bcfbb0f4743d9f922cc1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_26d7b8c636e6b0a5ce30aacc79fd24b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_26d7b8c636e6b0a5ce30aacc79fd24b5.jpg not downloaded yet
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_b000a6a382eb30081e77b6c4afb5ed28.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_b000a6a382eb30081e77b6c4afb5ed28.jpg not downloaded yet
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562862d0>
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8661c2eb-31db-51be-86b6-a83a7d17c61d/8661c2eb-31db-51be-86b6-a83a7d17c61d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F80%252Fe680890fdd9a003228f57ed5936f676c%252Fpa%252FVA98416_31f109666d346a9b5467ce72874353ad.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_31f109666d346a9b5467ce72874353ad.jpg saved to cache
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8661c2eb-31db-51be-86b6-a83a7d17c61d
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_670e49d4ad6c971aa58c872508e820e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_670e49d4ad6c971aa58c872508e820e7.jpg not downloaded yet
2026-03-28 18:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_f74f83f7a4058f43287787354b02ac2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_c0d5b87fc36bd79fbdd502b871219550.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_c0d5b87fc36bd79fbdd502b871219550.jpg not downloaded yet
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_5ed5f7ab6128c34f429527077f58cddf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_5ed5f7ab6128c34f429527077f58cddf.jpg not downloaded yet
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547a0990>
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8661c2eb-31db-51be-86b6-a83a7d17c61d/8661c2eb-31db-51be-86b6-a83a7d17c61d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F80%252Fe680890fdd9a003228f57ed5936f676c%252Fpa%252FVA98416_11d8b742d33d1633e1e28d66b71b9ccc.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_11d8b742d33d1633e1e28d66b71b9ccc.jpg saved to cache
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8661c2eb-31db-51be-86b6-a83a7d17c61d
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245608f910>
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_90f663e56aa4bcfbb0f4743d9f922cc1.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_90f663e56aa4bcfbb0f4743d9f922cc1.jpg saved to cache
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item defa7b68-3dd7-559f-92dd-8169e04cc51a
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_4898bb9418912572da5c9f4319abf941.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_4898bb9418912572da5c9f4319abf941.jpg not downloaded yet
2026-03-28 18:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_731ae284277724b89c87a508b55cb049.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456175950>
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_f74f83f7a4058f43287787354b02ac2c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_f74f83f7a4058f43287787354b02ac2c.jpg saved to cache
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c
2026-03-28 18:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_8a6af4ca2b0821c00a08bddee2b3a13d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_63b354848a7f2a9c072bc2eca9b5c25b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_09773060b8e6269f458528185eaac20b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_be68914a298b0ff253ff19feb95a480a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_1d40a8b22b49bfe77c7b3ef89dfd1977.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_b0388d7c56d5230efd0b01667959b14a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_7bfc00bdf121263237465d94c5c4b90b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458531690>
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_731ae284277724b89c87a508b55cb049.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_731ae284277724b89c87a508b55cb049.jpg saved to cache
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456111d10>
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_8a6af4ca2b0821c00a08bddee2b3a13d.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_8a6af4ca2b0821c00a08bddee2b3a13d.jpg saved to cache
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c
2026-03-28 18:47:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456493710>
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_63b354848a7f2a9c072bc2eca9b5c25b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_63b354848a7f2a9c072bc2eca9b5c25b.jpg saved to cache
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item defa7b68-3dd7-559f-92dd-8169e04cc51a
2026-03-28 18:47:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561a5050>
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_09773060b8e6269f458528185eaac20b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_09773060b8e6269f458528185eaac20b.jpg saved to cache
2026-03-28 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item defa7b68-3dd7-559f-92dd-8169e04cc51a
2026-03-28 18:47:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560acbd0>
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_be68914a298b0ff253ff19feb95a480a.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_be68914a298b0ff253ff19feb95a480a.jpg saved to cache
2026-03-28 18:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item defa7b68-3dd7-559f-92dd-8169e04cc51a
2026-03-28 18:47:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564eead0>
2026-03-28 18:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_1d40a8b22b49bfe77c7b3ef89dfd1977.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_1d40a8b22b49bfe77c7b3ef89dfd1977.jpg saved to cache
2026-03-28 18:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item defa7b68-3dd7-559f-92dd-8169e04cc51a
2026-03-28 18:47:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245624b190>
2026-03-28 18:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_b0388d7c56d5230efd0b01667959b14a.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_b0388d7c56d5230efd0b01667959b14a.jpg saved to cache
2026-03-28 18:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item defa7b68-3dd7-559f-92dd-8169e04cc51a
2026-03-28 18:47:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245649d410>
2026-03-28 18:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3d%252Fbb3dc2bb4df2e2050be35aacc7ace365%252Fpa%252FNR79425_7bfc00bdf121263237465d94c5c4b90b.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_7bfc00bdf121263237465d94c5c4b90b.jpg saved to cache
2026-03-28 18:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item defa7b68-3dd7-559f-92dd-8169e04cc51a
2026-03-28 18:47:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: defa7b68-3dd7-559f-92dd-8169e04cc51a, skipping ID generation
2026-03-28 18:47:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item defa7b68-3dd7-559f-92dd-8169e04cc51a with scrape type 1
2026-03-28 18:47:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item defa7b68-3dd7-559f-92dd-8169e04cc51a sending to next pipeline
2026-03-28 18:47:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: defa7b68-3dd7-559f-92dd-8169e04cc51a, identifier: NR79425
2026-03-28 18:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: defa7b68-3dd7-559f-92dd-8169e04cc51a with identifier: NR79425
2026-03-28 18:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: defa7b68-3dd7-559f-92dd-8169e04cc51a with identifier: NR79425
2026-03-28 18:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: defa7b68-3dd7-559f-92dd-8169e04cc51a with identifier: NR79425 to the API
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_7bfc00bdf121263237465d94c5c4b90b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:03:15Z',
 'fuel_type': 'petrol',
 'id': 'defa7b68-3dd7-559f-92dd-8169e04cc51a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR79425',
 'listing': 'auction',
 'location': 'DE, Stuttgart',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 58782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3114491,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_7bfc00bdf121263237465d94c5c4b90b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_b5023be0904d0c80f6a630f01d6d10ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_90f663e56aa4bcfbb0f4743d9f922cc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829175,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_b0388d7c56d5230efd0b01667959b14a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3051549,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_1d40a8b22b49bfe77c7b3ef89dfd1977.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_99e0b8b5e87103203a52399dabb4997c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2817064,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_63b354848a7f2a9c072bc2eca9b5c25b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2911180,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_09773060b8e6269f458528185eaac20b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2954292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_be68914a298b0ff253ff19feb95a480a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_defa7b68-3dd7-559f-92dd-8169e04cc51a/defa7b68-3dd7-559f-92dd-8169e04cc51a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3075620,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3d/bb3dc2bb4df2e2050be35aacc7ace365/pa/NR79425_319b14945d54e80c8e0d318b3b9dc806.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2014}
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR79425%27 HTTP/1.1" 200 None
2026-03-28 18:47:50 [auto1.de] INFO: Saving data for NR79425: {'created_time': 1774723670.97571, 'last_price_update_time': 1774723670.975722, 'auction_closing_time': 1774882995.0}
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR79425') HTTP/1.1" 204 0
2026-03-28 18:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_b000a6a382eb30081e77b6c4afb5ed28.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_4898bb9418912572da5c9f4319abf941.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS04004> (referer: https://www.auto1.com/v1/car-details-view/RS04004/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY61393/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_5ed5f7ab6128c34f429527077f58cddf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_9feccfcc4fef9c2488dc10d8840ab00f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245628ce10>
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_b000a6a382eb30081e77b6c4afb5ed28.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_b000a6a382eb30081e77b6c4afb5ed28.jpg saved to cache
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c
2026-03-28 18:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_415c678360543c508ab14f4a78fccc4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458560dd0>
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_4898bb9418912572da5c9f4319abf941.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_4898bb9418912572da5c9f4319abf941.jpg saved to cache
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c
2026-03-28 18:47:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f07142c-3944-5a62-92d0-8dae174fba2d with identifier: RS04004
2026-03-28 18:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f07142c-3944-5a62-92d0-8dae174fba2d with scrape type 1
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f07142c-3944-5a62-92d0-8dae174fba2d
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_c307fb5fd5f397141c230f0c0bd0ac61.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_c307fb5fd5f397141c230f0c0bd0ac61.jpg not downloaded yet
2026-03-28 18:47:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24582cf290>
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_5ed5f7ab6128c34f429527077f58cddf.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_5ed5f7ab6128c34f429527077f58cddf.jpg saved to cache
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_3488130e78d4a7bbbdda5a9a1af27b39.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_3488130e78d4a7bbbdda5a9a1af27b39.jpg not downloaded yet
2026-03-28 18:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_0d0fb0119db75e5acd7c6f60564350fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_2168e1d68c4bd789ddf6b5d67c5bd9b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245480ae90>
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b146ce1-64f4-5f09-b063-75c40ebf65b8/8b146ce1-64f4-5f09-b063-75c40ebf65b8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F3c%252F1d3c0833481960d335a56b3a5f45b80f%252Fpa%252FAU58197_9feccfcc4fef9c2488dc10d8840ab00f.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_9feccfcc4fef9c2488dc10d8840ab00f.jpg saved to cache
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b146ce1-64f4-5f09-b063-75c40ebf65b8
2026-03-28 18:47:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b146ce1-64f4-5f09-b063-75c40ebf65b8, skipping ID generation
2026-03-28 18:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b146ce1-64f4-5f09-b063-75c40ebf65b8 with scrape type 1
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b146ce1-64f4-5f09-b063-75c40ebf65b8 sending to next pipeline
2026-03-28 18:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b146ce1-64f4-5f09-b063-75c40ebf65b8, identifier: AU58197
2026-03-28 18:47:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475be90>
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8661c2eb-31db-51be-86b6-a83a7d17c61d/8661c2eb-31db-51be-86b6-a83a7d17c61d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F80%252Fe680890fdd9a003228f57ed5936f676c%252Fpa%252FVA98416_415c678360543c508ab14f4a78fccc4c.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_415c678360543c508ab14f4a78fccc4c.jpg saved to cache
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8661c2eb-31db-51be-86b6-a83a7d17c61d
2026-03-28 18:47:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8661c2eb-31db-51be-86b6-a83a7d17c61d, skipping ID generation
2026-03-28 18:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8661c2eb-31db-51be-86b6-a83a7d17c61d with scrape type 1
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8661c2eb-31db-51be-86b6-a83a7d17c61d sending to next pipeline
2026-03-28 18:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8661c2eb-31db-51be-86b6-a83a7d17c61d, identifier: VA98416
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_2e22fa98a998f491f99de02ce0a00f71.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_2e22fa98a998f491f99de02ce0a00f71.jpg not downloaded yet
2026-03-28 18:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b146ce1-64f4-5f09-b063-75c40ebf65b8 with identifier: AU58197
2026-03-28 18:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b146ce1-64f4-5f09-b063-75c40ebf65b8 with identifier: AU58197
2026-03-28 18:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b146ce1-64f4-5f09-b063-75c40ebf65b8 with identifier: AU58197 to the API
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_9feccfcc4fef9c2488dc10d8840ab00f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:13:48Z',
 'fuel_type': 'petrol',
 'id': '8b146ce1-64f4-5f09-b063-75c40ebf65b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU58197',
 'listing': 'auction',
 'location': 'DE, Donaueschingen',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 168247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b146ce1-64f4-5f09-b063-75c40ebf65b8/8b146ce1-64f4-5f09-b063-75c40ebf65b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_9feccfcc4fef9c2488dc10d8840ab00f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b146ce1-64f4-5f09-b063-75c40ebf65b8/8b146ce1-64f4-5f09-b063-75c40ebf65b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_1788afae752c4e5fd5a0c30c89e59164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b146ce1-64f4-5f09-b063-75c40ebf65b8/8b146ce1-64f4-5f09-b063-75c40ebf65b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_019496279593ba8b3f9e26b95b4f0f98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b146ce1-64f4-5f09-b063-75c40ebf65b8/8b146ce1-64f4-5f09-b063-75c40ebf65b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_e7b5fc0d3bf4adfbaa62dd0da3e19c73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b146ce1-64f4-5f09-b063-75c40ebf65b8/8b146ce1-64f4-5f09-b063-75c40ebf65b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/3c/1d3c0833481960d335a56b3a5f45b80f/pa/AU58197_f865fe837a79ee700c964c5970bea4b3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-28 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU58197%27 HTTP/1.1" 200 None
2026-03-28 18:47:52 [auto1.de] INFO: Saving data for AU58197: {'created_time': 1774723672.001264, 'last_price_update_time': 1774723672.001276, 'auction_closing_time': 1774883628.0}
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU58197') HTTP/1.1" 204 0
2026-03-28 18:47:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8661c2eb-31db-51be-86b6-a83a7d17c61d with identifier: VA98416
2026-03-28 18:47:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8661c2eb-31db-51be-86b6-a83a7d17c61d with identifier: VA98416
2026-03-28 18:47:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8661c2eb-31db-51be-86b6-a83a7d17c61d with identifier: VA98416 to the API
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_415c678360543c508ab14f4a78fccc4c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 211,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:17Z',
 'fuel_type': 'petrol',
 'id': '8661c2eb-31db-51be-86b6-a83a7d17c61d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA98416',
 'listing': 'auction',
 'location': 'DE, Aschaffenburg',
 'make': 'Alfa Romeo',
 'model': 'Alfa 147',
 'odometer': 136621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8661c2eb-31db-51be-86b6-a83a7d17c61d/8661c2eb-31db-51be-86b6-a83a7d17c61d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_9dd9a169bf22fe04f1bdf88c05e507e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8661c2eb-31db-51be-86b6-a83a7d17c61d/8661c2eb-31db-51be-86b6-a83a7d17c61d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_415c678360543c508ab14f4a78fccc4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8661c2eb-31db-51be-86b6-a83a7d17c61d/8661c2eb-31db-51be-86b6-a83a7d17c61d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_31f109666d346a9b5467ce72874353ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8661c2eb-31db-51be-86b6-a83a7d17c61d/8661c2eb-31db-51be-86b6-a83a7d17c61d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_9701e29bf6c8ed83709aa7e2a9e60790.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8661c2eb-31db-51be-86b6-a83a7d17c61d/8661c2eb-31db-51be-86b6-a83a7d17c61d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/80/e680890fdd9a003228f57ed5936f676c/pa/VA98416_11d8b742d33d1633e1e28d66b71b9ccc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Alfa 147 2.0 Selespeed Distinctive',
 'transmission': 'automatic',
 'trim': 'Selespeed Distinctive',
 'year': 2001}
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA98416%27 HTTP/1.1" 200 None
2026-03-28 18:47:52 [auto1.de] INFO: Saving data for VA98416: {'created_time': 1774723672.368821, 'last_price_update_time': 1774723672.368835, 'auction_closing_time': 1774884617.0}
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA98416') HTTP/1.1" 204 0
2026-03-28 18:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_873e66e074bae0916befca746f47aafc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_e88524b63a80ce8a192978786dedf4a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_e88524b63a80ce8a192978786dedf4a8.jpg not downloaded yet
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a93d0>
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_0d0fb0119db75e5acd7c6f60564350fe.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_0d0fb0119db75e5acd7c6f60564350fe.jpg saved to cache
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f817086f-9b8d-58d2-abb9-afae8991c669
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24582a6590>
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_2168e1d68c4bd789ddf6b5d67c5bd9b1.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_2168e1d68c4bd789ddf6b5d67c5bd9b1.jpg saved to cache
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f817086f-9b8d-58d2-abb9-afae8991c669
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_0c64ad9450b05cba7bab2f00e09427e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_0c64ad9450b05cba7bab2f00e09427e2.jpg not downloaded yet
2026-03-28 18:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_c307fb5fd5f397141c230f0c0bd0ac61.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_dd56c27f98741f061b068ca381221ac6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_dd56c27f98741f061b068ca381221ac6.jpg not downloaded yet
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_5993d2d4d712cd66e99853ac1b3d9885.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_5993d2d4d712cd66e99853ac1b3d9885.jpg not downloaded yet
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546f4290>
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_873e66e074bae0916befca746f47aafc.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_873e66e074bae0916befca746f47aafc.jpg saved to cache
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f817086f-9b8d-58d2-abb9-afae8991c669
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_f077d356808bf7556fd61864a1dca237.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_f077d356808bf7556fd61864a1dca237.jpg not downloaded yet
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_40a4dae961c1274f4ac0d04a17ad9220.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_40a4dae961c1274f4ac0d04a17ad9220.jpg not downloaded yet
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_362d8fab0123a123531599aa911a876d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_362d8fab0123a123531599aa911a876d.jpg not downloaded yet
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454769a50>
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_c307fb5fd5f397141c230f0c0bd0ac61.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_c307fb5fd5f397141c230f0c0bd0ac61.jpg saved to cache
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f07142c-3944-5a62-92d0-8dae174fba2d
2026-03-28 18:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_7a4e578bf17f3287e4b6225c86977274.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_670e49d4ad6c971aa58c872508e820e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_c0d5b87fc36bd79fbdd502b871219550.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_08b7a2f8c52f07f3ca4c22363646e561.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_26d7b8c636e6b0a5ce30aacc79fd24b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_5c5105f332374fdaea3539b5a11dfc3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_0c64ad9450b05cba7bab2f00e09427e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_2e22fa98a998f491f99de02ce0a00f71.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561fdb10>
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_7a4e578bf17f3287e4b6225c86977274.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_7a4e578bf17f3287e4b6225c86977274.jpg saved to cache
2026-03-28 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f817086f-9b8d-58d2-abb9-afae8991c669
2026-03-28 18:47:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475f8d0>
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_670e49d4ad6c971aa58c872508e820e7.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_670e49d4ad6c971aa58c872508e820e7.jpg saved to cache
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c
2026-03-28 18:47:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456328750>
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_c0d5b87fc36bd79fbdd502b871219550.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_c0d5b87fc36bd79fbdd502b871219550.jpg saved to cache
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c
2026-03-28 18:47:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547e6550>
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_08b7a2f8c52f07f3ca4c22363646e561.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_08b7a2f8c52f07f3ca4c22363646e561.jpg saved to cache
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c
2026-03-28 18:47:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562c8e50>
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F25%252F3a2563ff7433fe9f8e43e9289af833fc%252Fpa%252FHP09567_26d7b8c636e6b0a5ce30aacc79fd24b5.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_26d7b8c636e6b0a5ce30aacc79fd24b5.jpg saved to cache
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c
2026-03-28 18:47:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31a5ae1f-e733-5676-bc99-03dbf7e9b52c, skipping ID generation
2026-03-28 18:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c with scrape type 1
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c sending to next pipeline
2026-03-28 18:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31a5ae1f-e733-5676-bc99-03dbf7e9b52c, identifier: HP09567
2026-03-28 18:47:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562e3810>
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_5c5105f332374fdaea3539b5a11dfc3d.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_5c5105f332374fdaea3539b5a11dfc3d.jpg saved to cache
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f817086f-9b8d-58d2-abb9-afae8991c669
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454753090>
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_0c64ad9450b05cba7bab2f00e09427e2.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_0c64ad9450b05cba7bab2f00e09427e2.jpg saved to cache
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f07142c-3944-5a62-92d0-8dae174fba2d
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562c97d0>
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_2e22fa98a998f491f99de02ce0a00f71.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_2e22fa98a998f491f99de02ce0a00f71.jpg saved to cache
2026-03-28 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f07142c-3944-5a62-92d0-8dae174fba2d
2026-03-28 18:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31a5ae1f-e733-5676-bc99-03dbf7e9b52c with identifier: HP09567
2026-03-28 18:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31a5ae1f-e733-5676-bc99-03dbf7e9b52c with identifier: HP09567
2026-03-28 18:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31a5ae1f-e733-5676-bc99-03dbf7e9b52c with identifier: HP09567 to the API
2026-03-28 18:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_26d7b8c636e6b0a5ce30aacc79fd24b5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:09:18Z',
 'fuel_type': 'diesel',
 'id': '31a5ae1f-e733-5676-bc99-03dbf7e9b52c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP09567',
 'listing': 'auction',
 'location': 'DE, Schwerin',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 233248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_f74f83f7a4058f43287787354b02ac2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2870669,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_08b7a2f8c52f07f3ca4c22363646e561.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_731ae284277724b89c87a508b55cb049.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_8a6af4ca2b0821c00a08bddee2b3a13d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857070,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_26d7b8c636e6b0a5ce30aacc79fd24b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_b000a6a382eb30081e77b6c4afb5ed28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2907553,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_670e49d4ad6c971aa58c872508e820e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2949995,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_c0d5b87fc36bd79fbdd502b871219550.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2925474,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_5ed5f7ab6128c34f429527077f58cddf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a5ae1f-e733-5676-bc99-03dbf7e9b52c/31a5ae1f-e733-5676-bc99-03dbf7e9b52c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/25/3a2563ff7433fe9f8e43e9289af833fc/pa/HP09567_4898bb9418912572da5c9f4319abf941.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP09567%27 HTTP/1.1" 200 None
2026-03-28 18:47:54 [auto1.de] INFO: Saving data for HP09567: {'created_time': 1774723674.161676, 'last_price_update_time': 1774723674.161688, 'auction_closing_time': 1774883358.0}
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP09567') HTTP/1.1" 204 0
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY61393> (referer: https://www.auto1.com/v1/car-details-view/KY61393/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_362d8fab0123a123531599aa911a876d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3b017d1-5c92-51d4-b14b-acbbadf32f20 with identifier: KY61393
2026-03-28 18:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3b017d1-5c92-51d4-b14b-acbbadf32f20 with scrape type 1
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3b017d1-5c92-51d4-b14b-acbbadf32f20
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_e7b1ece0504c3af7645dd98e49fcf610.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_e7b1ece0504c3af7645dd98e49fcf610.jpg not downloaded yet
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_5222ddf86d3117ddd0577999efb3c2d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_5222ddf86d3117ddd0577999efb3c2d2.jpg not downloaded yet
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_9549d9ccf5e0e0e5501146cb4fbba3b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_9549d9ccf5e0e0e5501146cb4fbba3b3.jpg not downloaded yet
2026-03-28 18:47:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561d8f10>
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_362d8fab0123a123531599aa911a876d.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_362d8fab0123a123531599aa911a876d.jpg saved to cache
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f07142c-3944-5a62-92d0-8dae174fba2d
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_d54a08339f27bdfba46c6aa4b5f750f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_d54a08339f27bdfba46c6aa4b5f750f3.jpg not downloaded yet
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_20646b89d04eb4adc9b516a50acd2430.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_3488130e78d4a7bbbdda5a9a1af27b39.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_218232417d35d41363b1ee7df499d856.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_218232417d35d41363b1ee7df499d856.jpg not downloaded yet
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_0d9a8cc63763af172f48c016924f1b1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_0d9a8cc63763af172f48c016924f1b1e.jpg not downloaded yet
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_2eb1df1ffa65d4cb703f867433af61c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_2eb1df1ffa65d4cb703f867433af61c2.jpg not downloaded yet
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_507910449d50912b491ae9913773e99a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_507910449d50912b491ae9913773e99a.jpg not downloaded yet
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_9549d9ccf5e0e0e5501146cb4fbba3b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_d54a08339f27bdfba46c6aa4b5f750f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_b32d7093e5609220d6b53063678072dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_b32d7093e5609220d6b53063678072dc.jpg not downloaded yet
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_a9df2f930872fb3c14566a041cb9b6cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_a9df2f930872fb3c14566a041cb9b6cd.jpg not downloaded yet
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561ba3d0>
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_20646b89d04eb4adc9b516a50acd2430.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_20646b89d04eb4adc9b516a50acd2430.jpg saved to cache
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f817086f-9b8d-58d2-abb9-afae8991c669
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d2c50>
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_3488130e78d4a7bbbdda5a9a1af27b39.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_3488130e78d4a7bbbdda5a9a1af27b39.jpg saved to cache
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f07142c-3944-5a62-92d0-8dae174fba2d
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_2eb1df1ffa65d4cb703f867433af61c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_507910449d50912b491ae9913773e99a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563ebed0>
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_9549d9ccf5e0e0e5501146cb4fbba3b3.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_9549d9ccf5e0e0e5501146cb4fbba3b3.jpg saved to cache
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3b017d1-5c92-51d4-b14b-acbbadf32f20
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456261550>
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_d54a08339f27bdfba46c6aa4b5f750f3.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_d54a08339f27bdfba46c6aa4b5f750f3.jpg saved to cache
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3b017d1-5c92-51d4-b14b-acbbadf32f20
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_a9df2f930872fb3c14566a041cb9b6cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_f077d356808bf7556fd61864a1dca237.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_40a4dae961c1274f4ac0d04a17ad9220.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_01dcded9ccc2f31a4430d9c9ac8495ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245603df90>
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_2eb1df1ffa65d4cb703f867433af61c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_2eb1df1ffa65d4cb703f867433af61c2.jpg saved to cache
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3b017d1-5c92-51d4-b14b-acbbadf32f20
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_e88524b63a80ce8a192978786dedf4a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_5993d2d4d712cd66e99853ac1b3d9885.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_b32d7093e5609220d6b53063678072dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_0d9a8cc63763af172f48c016924f1b1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561f8510>
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_507910449d50912b491ae9913773e99a.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_507910449d50912b491ae9913773e99a.jpg saved to cache
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3b017d1-5c92-51d4-b14b-acbbadf32f20
2026-03-28 18:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_dd56c27f98741f061b068ca381221ac6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561d0c50>
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_a9df2f930872fb3c14566a041cb9b6cd.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_a9df2f930872fb3c14566a041cb9b6cd.jpg saved to cache
2026-03-28 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3b017d1-5c92-51d4-b14b-acbbadf32f20
2026-03-28 18:47:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564eee90>
2026-03-28 18:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_f077d356808bf7556fd61864a1dca237.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_f077d356808bf7556fd61864a1dca237.jpg saved to cache
2026-03-28 18:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f07142c-3944-5a62-92d0-8dae174fba2d
2026-03-28 18:47:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546a0fd0>
2026-03-28 18:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_40a4dae961c1274f4ac0d04a17ad9220.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_40a4dae961c1274f4ac0d04a17ad9220.jpg saved to cache
2026-03-28 18:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f07142c-3944-5a62-92d0-8dae174fba2d
2026-03-28 18:47:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d12d0>
2026-03-28 18:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F50%252F6250cf9cf80a79c6d79f3164063a5440%252Fpa%252FMU09493_01dcded9ccc2f31a4430d9c9ac8495ad.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_01dcded9ccc2f31a4430d9c9ac8495ad.jpg saved to cache
2026-03-28 18:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f817086f-9b8d-58d2-abb9-afae8991c669
2026-03-28 18:47:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f817086f-9b8d-58d2-abb9-afae8991c669, skipping ID generation
2026-03-28 18:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f817086f-9b8d-58d2-abb9-afae8991c669 with scrape type 1
2026-03-28 18:47:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f817086f-9b8d-58d2-abb9-afae8991c669 sending to next pipeline
2026-03-28 18:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f817086f-9b8d-58d2-abb9-afae8991c669, identifier: MU09493
2026-03-28 18:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f817086f-9b8d-58d2-abb9-afae8991c669 with identifier: MU09493
2026-03-28 18:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f817086f-9b8d-58d2-abb9-afae8991c669 with identifier: MU09493
2026-03-28 18:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f817086f-9b8d-58d2-abb9-afae8991c669 with identifier: MU09493 to the API
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_01dcded9ccc2f31a4430d9c9ac8495ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:07:54Z',
 'fuel_type': 'diesel',
 'id': 'f817086f-9b8d-58d2-abb9-afae8991c669',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU09493',
 'listing': 'auction',
 'location': 'DE, Bremen',
 'make': 'BMW',
 'model': '3er',
 'odometer': 268179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2763033,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_01dcded9ccc2f31a4430d9c9ac8495ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_20646b89d04eb4adc9b516a50acd2430.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2876523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_639536d7226db8a0bc14344b4c610813.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_873e66e074bae0916befca746f47aafc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2914241,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_5c5105f332374fdaea3539b5a11dfc3d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_2168e1d68c4bd789ddf6b5d67c5bd9b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2148670,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_7a4e578bf17f3287e4b6225c86977274.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_0d0fb0119db75e5acd7c6f60564350fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2831917,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_39d2c69366f333b76b3bf4836fd5fa17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f817086f-9b8d-58d2-abb9-afae8991c669/f817086f-9b8d-58d2-abb9-afae8991c669_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/50/6250cf9cf80a79c6d79f3164063a5440/pa/MU09493_0c366f27e24325204a2d8f6c3db1055a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 325d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU09493%27 HTTP/1.1" 200 None
2026-03-28 18:47:55 [auto1.de] INFO: Saving data for MU09493: {'created_time': 1774723675.789133, 'last_price_update_time': 1774723675.789144, 'auction_closing_time': 1774883274.0}
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU09493') HTTP/1.1" 204 0
2026-03-28 18:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT00661/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL64703> (referer: https://www.auto1.com/v1/car-details-view/HL64703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:47:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561ed7d0>
2026-03-28 18:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_e88524b63a80ce8a192978786dedf4a8.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_e88524b63a80ce8a192978786dedf4a8.jpg saved to cache
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f07142c-3944-5a62-92d0-8dae174fba2d
2026-03-28 18:47:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d2490>
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_5993d2d4d712cd66e99853ac1b3d9885.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_5993d2d4d712cd66e99853ac1b3d9885.jpg saved to cache
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f07142c-3944-5a62-92d0-8dae174fba2d
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245476bd10>
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_b32d7093e5609220d6b53063678072dc.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_b32d7093e5609220d6b53063678072dc.jpg saved to cache
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3b017d1-5c92-51d4-b14b-acbbadf32f20
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638d5d0>
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_0d9a8cc63763af172f48c016924f1b1e.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_0d9a8cc63763af172f48c016924f1b1e.jpg saved to cache
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3b017d1-5c92-51d4-b14b-acbbadf32f20
2026-03-28 18:47:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563d3750>
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fb4%252F03b431901f1352a36e6fcebf7e190bb6%252Fpa%252FRS04004_dd56c27f98741f061b068ca381221ac6.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_dd56c27f98741f061b068ca381221ac6.jpg saved to cache
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f07142c-3944-5a62-92d0-8dae174fba2d
2026-03-28 18:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f07142c-3944-5a62-92d0-8dae174fba2d, skipping ID generation
2026-03-28 18:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f07142c-3944-5a62-92d0-8dae174fba2d with scrape type 1
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f07142c-3944-5a62-92d0-8dae174fba2d sending to next pipeline
2026-03-28 18:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f07142c-3944-5a62-92d0-8dae174fba2d, identifier: RS04004
2026-03-28 18:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f07142c-3944-5a62-92d0-8dae174fba2d with identifier: RS04004
2026-03-28 18:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f07142c-3944-5a62-92d0-8dae174fba2d with identifier: RS04004
2026-03-28 18:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f07142c-3944-5a62-92d0-8dae174fba2d with identifier: RS04004 to the API
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_dd56c27f98741f061b068ca381221ac6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:02:02Z',
 'fuel_type': 'petrol',
 'id': '8f07142c-3944-5a62-92d0-8dae174fba2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS04004',
 'listing': 'auction',
 'location': 'DE, Singen',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 133500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_c307fb5fd5f397141c230f0c0bd0ac61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_3488130e78d4a7bbbdda5a9a1af27b39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_2e22fa98a998f491f99de02ce0a00f71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2862371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_e88524b63a80ce8a192978786dedf4a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_0c64ad9450b05cba7bab2f00e09427e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3015124,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_dd56c27f98741f061b068ca381221ac6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2769424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_5993d2d4d712cd66e99853ac1b3d9885.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2799115,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_f077d356808bf7556fd61864a1dca237.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2863134,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_40a4dae961c1274f4ac0d04a17ad9220.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f07142c-3944-5a62-92d0-8dae174fba2d/8f07142c-3944-5a62-92d0-8dae174fba2d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3043754,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/b4/03b431901f1352a36e6fcebf7e190bb6/pa/RS04004_362d8fab0123a123531599aa911a876d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Premium 2WD',
 'transmission': 'manual',
 'trim': 'Premium 2WD',
 'year': 2016}
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS04004%27 HTTP/1.1" 200 None
2026-03-28 18:47:56 [auto1.de] INFO: Saving data for RS04004: {'created_time': 1774723676.764999, 'last_price_update_time': 1774723676.765011, 'auction_closing_time': 1774882922.0}
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS04004') HTTP/1.1" 204 0
2026-03-28 18:47:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b54d80ea-71b5-5cdd-a266-b510de27fe9f with identifier: HL64703
2026-03-28 18:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b54d80ea-71b5-5cdd-a266-b510de27fe9f with scrape type 1
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b54d80ea-71b5-5cdd-a266-b510de27fe9f
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_0fc841b187a04e09cca6de0544c93f43.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_0fc841b187a04e09cca6de0544c93f43.jpg not downloaded yet
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_affaed0196cfce86326b09536db28ecb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_affaed0196cfce86326b09536db28ecb.jpg not downloaded yet
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_e39bc16a0cb1e77e069d20758eb4f059.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_e39bc16a0cb1e77e069d20758eb4f059.jpg not downloaded yet
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_0ef9cb9843011dbc77863d19d04171ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_0ef9cb9843011dbc77863d19d04171ef.jpg not downloaded yet
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_ef6e77fb2d79d2cad6259b632833c8de.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_ef6e77fb2d79d2cad6259b632833c8de.jpg not downloaded yet
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_a684aa4f962479a8b7dbaa6f362ea03a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_a684aa4f962479a8b7dbaa6f362ea03a.jpg not downloaded yet
2026-03-28 18:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_fccf49f5819f909a8239154d0b597e73.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_fe2e47776a6b3f9bda5b91944677a721.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_fe2e47776a6b3f9bda5b91944677a721.jpg not downloaded yet
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_f65e9e4f789078f24fea7d9c1bc3a2df.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_f65e9e4f789078f24fea7d9c1bc3a2df.jpg not downloaded yet
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_bfa94db6d5363d483316fc59fd64ce05.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_bfa94db6d5363d483316fc59fd64ce05.jpg not downloaded yet
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_4663fe95520b59659302c9fbafe1be0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_4663fe95520b59659302c9fbafe1be0a.jpg not downloaded yet
2026-03-28 18:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_9b350ccf3e86622e6afe5fbe07edaa45.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_e7b1ece0504c3af7645dd98e49fcf610.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546474d0>
2026-03-28 18:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F91%252F5791ebaaa8e8255853155d23e507226c%252Fpa%252FWH78013_fccf49f5819f909a8239154d0b597e73.jpg') HTTP/1.1" 204 0
2026-03-28 18:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_fccf49f5819f909a8239154d0b597e73.jpg saved to cache
2026-03-28 18:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43b875ff-616a-5654-adba-cf64d8c0c77a
2026-03-28 18:47:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43b875ff-616a-5654-adba-cf64d8c0c77a, skipping ID generation
2026-03-28 18:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43b875ff-616a-5654-adba-cf64d8c0c77a with scrape type 1
2026-03-28 18:47:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43b875ff-616a-5654-adba-cf64d8c0c77a sending to next pipeline
2026-03-28 18:47:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43b875ff-616a-5654-adba-cf64d8c0c77a, identifier: WH78013
2026-03-28 18:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43b875ff-616a-5654-adba-cf64d8c0c77a with identifier: WH78013
2026-03-28 18:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43b875ff-616a-5654-adba-cf64d8c0c77a with identifier: WH78013
2026-03-28 18:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43b875ff-616a-5654-adba-cf64d8c0c77a with identifier: WH78013 to the API
2026-03-28 18:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_fccf49f5819f909a8239154d0b597e73.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:14:47Z',
 'fuel_type': 'petrol',
 'id': '43b875ff-616a-5654-adba-cf64d8c0c77a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH78013',
 'listing': 'auction',
 'location': 'DE, Esslingen am Neckar',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 99620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_fccf49f5819f909a8239154d0b597e73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_9da987929c33403b55bca4d9928ae4c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_4d2e83304af31b89efcc8b638a5e87c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_887218e31a42f64ea2feb310fbbd19f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_4d5e228c45e910f5a99a2cd584ed13c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_a4c928492b3ac5436a5c51c44461ed8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_0dba750c820dcb4da3dffcde65637fb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_836eb4c2890943c3908e7b1d50b94063.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_3b06b8836410553a6808effd54126252.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b875ff-616a-5654-adba-cf64d8c0c77a/43b875ff-616a-5654-adba-cf64d8c0c77a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791ebaaa8e8255853155d23e507226c/pa/WH78013_2bd64a1ab6f9a89c399de0ec02b32489.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH78013%27 HTTP/1.1" 200 None
2026-03-28 18:48:11 [auto1.de] INFO: Saving data for WH78013: {'created_time': 1774723691.598334, 'last_price_update_time': 1774723691.598345, 'auction_closing_time': 1774883687.0}
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH78013') HTTP/1.1" 204 0
2026-03-28 18:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_42a34394d9bd14c951ccd492dbadaaac.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:11 [scrapy.extensions.logstats] INFO: Crawled 593 pages (at 64 pages/min), scraped 814 items (at 45 items/min)
2026-03-28 18:48:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 197MiB
2026-03-28 18:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_4663fe95520b59659302c9fbafe1be0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454647990>
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_9b350ccf3e86622e6afe5fbe07edaa45.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_9b350ccf3e86622e6afe5fbe07edaa45.jpg saved to cache
2026-03-28 18:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9ab4fc4-4c34-5084-87f2-38a39718a000
2026-03-28 18:48:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547f1a90>
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_e7b1ece0504c3af7645dd98e49fcf610.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_e7b1ece0504c3af7645dd98e49fcf610.jpg saved to cache
2026-03-28 18:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3b017d1-5c92-51d4-b14b-acbbadf32f20
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245603f350>
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_42a34394d9bd14c951ccd492dbadaaac.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_42a34394d9bd14c951ccd492dbadaaac.jpg saved to cache
2026-03-28 18:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9ab4fc4-4c34-5084-87f2-38a39718a000
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564ed490>
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_4663fe95520b59659302c9fbafe1be0a.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_4663fe95520b59659302c9fbafe1be0a.jpg saved to cache
2026-03-28 18:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b54d80ea-71b5-5cdd-a266-b510de27fe9f
2026-03-28 18:48:11 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 6020 | hits on page: 40
2026-03-28 18:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_f65e9e4f789078f24fea7d9c1bc3a2df.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT22331%27 HTTP/1.1" 200 None
2026-03-28 18:48:11 [auto1.de] INFO: Scrape type for PT22331: 0
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC15764%27 HTTP/1.1" 200 None
2026-03-28 18:48:11 [auto1.de] INFO: Scrape type for BC15764: 0
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW82863%27 HTTP/1.1" 200 None
2026-03-28 18:48:11 [auto1.de] INFO: Scrape type for YW82863: 0
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR37862%27 HTTP/1.1" 200 None
2026-03-28 18:48:11 [auto1.de] INFO: Scrape type for AR37862: 0
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR83794%27 HTTP/1.1" 200 None
2026-03-28 18:48:11 [auto1.de] INFO: Scrape type for XR83794: 0
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM55805%27 HTTP/1.1" 200 None
2026-03-28 18:48:11 [auto1.de] INFO: Scrape type for DM55805: 0
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR74031%27 HTTP/1.1" 200 None
2026-03-28 18:48:11 [auto1.de] INFO: Scrape type for BR74031: 0
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-28 18:48:11 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG46471%27 HTTP/1.1" 200 None
2026-03-28 18:48:12 [auto1.de] INFO: Scrape type for ZG46471: 0
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR61272%27 HTTP/1.1" 200 None
2026-03-28 18:48:12 [auto1.de] INFO: Scrape type for ZR61272: 0
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU16554%27 HTTP/1.1" 200 None
2026-03-28 18:48:12 [auto1.de] INFO: Scrape type for YU16554: 0
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR78588%27 HTTP/1.1" 200 None
2026-03-28 18:48:12 [auto1.de] INFO: Scrape type for PR78588: 0
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK30802%27 HTTP/1.1" 200 None
2026-03-28 18:48:12 [auto1.de] INFO: Scrape type for RK30802: 0
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB66562%27 HTTP/1.1" 200 None
2026-03-28 18:48:12 [auto1.de] INFO: Scrape type for UB66562: 0
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY16606%27 HTTP/1.1" 200 None
2026-03-28 18:48:12 [auto1.de] INFO: Scrape type for DY16606: 0
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90225%27 HTTP/1.1" 200 None
2026-03-28 18:48:12 [auto1.de] INFO: Scrape type for DK90225: 0
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC13380%27 HTTP/1.1" 200 None
2026-03-28 18:48:12 [auto1.de] INFO: Scrape type for MC13380: 0
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD16668%27 HTTP/1.1" 200 None
2026-03-28 18:48:12 [auto1.de] INFO: Scrape type for TD16668: 0
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54285%27 HTTP/1.1" 200 None
2026-03-28 18:48:12 [auto1.de] INFO: Scrape type for GF54285: 0
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM74850%27 HTTP/1.1" 200 None
2026-03-28 18:48:12 [auto1.de] INFO: Scrape type for JM74850: 0
2026-03-28 18:48:12 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-28 18:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_fe2e47776a6b3f9bda5b91944677a721.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_ef6e77fb2d79d2cad6259b632833c8de.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_218232417d35d41363b1ee7df499d856.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456159ad0>
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_f65e9e4f789078f24fea7d9c1bc3a2df.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_f65e9e4f789078f24fea7d9c1bc3a2df.jpg saved to cache
2026-03-28 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b54d80ea-71b5-5cdd-a266-b510de27fe9f
2026-03-28 18:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_5222ddf86d3117ddd0577999efb3c2d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_d47daf8ab4fd18c72d13170d6d3e08c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_c9257ebfb1472f70c10de55e4fa265be.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_a684aa4f962479a8b7dbaa6f362ea03a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_bfa94db6d5363d483316fc59fd64ce05.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456534a90>
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_fe2e47776a6b3f9bda5b91944677a721.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_fe2e47776a6b3f9bda5b91944677a721.jpg saved to cache
2026-03-28 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b54d80ea-71b5-5cdd-a266-b510de27fe9f
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564d2d10>
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_ef6e77fb2d79d2cad6259b632833c8de.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_ef6e77fb2d79d2cad6259b632833c8de.jpg saved to cache
2026-03-28 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b54d80ea-71b5-5cdd-a266-b510de27fe9f
2026-03-28 18:48:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562f5550>
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_218232417d35d41363b1ee7df499d856.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_218232417d35d41363b1ee7df499d856.jpg saved to cache
2026-03-28 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3b017d1-5c92-51d4-b14b-acbbadf32f20
2026-03-28 18:48:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456094150>
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F96%252Fb9960c8c9a106cd9817360b2b5874d00%252Fpa%252FKY61393_5222ddf86d3117ddd0577999efb3c2d2.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_5222ddf86d3117ddd0577999efb3c2d2.jpg saved to cache
2026-03-28 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3b017d1-5c92-51d4-b14b-acbbadf32f20
2026-03-28 18:48:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3b017d1-5c92-51d4-b14b-acbbadf32f20, skipping ID generation
2026-03-28 18:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3b017d1-5c92-51d4-b14b-acbbadf32f20 with scrape type 1
2026-03-28 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3b017d1-5c92-51d4-b14b-acbbadf32f20 sending to next pipeline
2026-03-28 18:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3b017d1-5c92-51d4-b14b-acbbadf32f20, identifier: KY61393
2026-03-28 18:48:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456309650>
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_d47daf8ab4fd18c72d13170d6d3e08c7.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_d47daf8ab4fd18c72d13170d6d3e08c7.jpg saved to cache
2026-03-28 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9ab4fc4-4c34-5084-87f2-38a39718a000
2026-03-28 18:48:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562c8b10>
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_c9257ebfb1472f70c10de55e4fa265be.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_c9257ebfb1472f70c10de55e4fa265be.jpg saved to cache
2026-03-28 18:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9ab4fc4-4c34-5084-87f2-38a39718a000
2026-03-28 18:48:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547a21d0>
2026-03-28 18:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_a684aa4f962479a8b7dbaa6f362ea03a.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_a684aa4f962479a8b7dbaa6f362ea03a.jpg saved to cache
2026-03-28 18:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b54d80ea-71b5-5cdd-a266-b510de27fe9f
2026-03-28 18:48:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638f150>
2026-03-28 18:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_bfa94db6d5363d483316fc59fd64ce05.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_bfa94db6d5363d483316fc59fd64ce05.jpg saved to cache
2026-03-28 18:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b54d80ea-71b5-5cdd-a266-b510de27fe9f
2026-03-28 18:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_e39bc16a0cb1e77e069d20758eb4f059.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3b017d1-5c92-51d4-b14b-acbbadf32f20 with identifier: KY61393
2026-03-28 18:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3b017d1-5c92-51d4-b14b-acbbadf32f20 with identifier: KY61393
2026-03-28 18:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3b017d1-5c92-51d4-b14b-acbbadf32f20 with identifier: KY61393 to the API
2026-03-28 18:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_5222ddf86d3117ddd0577999efb3c2d2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:31:47Z',
 'fuel_type': 'diesel',
 'id': 'd3b017d1-5c92-51d4-b14b-acbbadf32f20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY61393',
 'listing': 'auction',
 'location': 'DE, Stuttgart',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 125871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3007179,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_e7b1ece0504c3af7645dd98e49fcf610.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3105681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_5222ddf86d3117ddd0577999efb3c2d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_9549d9ccf5e0e0e5501146cb4fbba3b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_d54a08339f27bdfba46c6aa4b5f750f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3166586,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_218232417d35d41363b1ee7df499d856.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_0d9a8cc63763af172f48c016924f1b1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_2eb1df1ffa65d4cb703f867433af61c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_507910449d50912b491ae9913773e99a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_b32d7093e5609220d6b53063678072dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3b017d1-5c92-51d4-b14b-acbbadf32f20/d3b017d1-5c92-51d4-b14b-acbbadf32f20_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/96/b9960c8c9a106cd9817360b2b5874d00/pa/KY61393_a9df2f930872fb3c14566a041cb9b6cd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY61393%27 HTTP/1.1" 200 None
2026-03-28 18:48:15 [auto1.de] INFO: Saving data for KY61393: {'created_time': 1774723695.353073, 'last_price_update_time': 1774723695.353085, 'auction_closing_time': 1774884707.0}
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY61393') HTTP/1.1" 204 0
2026-03-28 18:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_0ef9cb9843011dbc77863d19d04171ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ32125/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG78174/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH81778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR28195> (referer: https://www.auto1.com/v1/car-details-view/YR28195/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR75246> (referer: https://www.auto1.com/v1/car-details-view/SR75246/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK51191/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC91438/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454644090>
2026-03-28 18:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_e39bc16a0cb1e77e069d20758eb4f059.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_e39bc16a0cb1e77e069d20758eb4f059.jpg saved to cache
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b54d80ea-71b5-5cdd-a266-b510de27fe9f
2026-03-28 18:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2465fac910>
2026-03-28 18:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_0ef9cb9843011dbc77863d19d04171ef.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_0ef9cb9843011dbc77863d19d04171ef.jpg saved to cache
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b54d80ea-71b5-5cdd-a266-b510de27fe9f
2026-03-28 18:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_affaed0196cfce86326b09536db28ecb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd3f45a-a74a-520e-9028-ab5cc3c18e13 with identifier: YR28195
2026-03-28 18:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd3f45a-a74a-520e-9028-ab5cc3c18e13 with scrape type 1
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5fd3f45a-a74a-520e-9028-ab5cc3c18e13
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb1%252F18b10ae750170f50e9a7768143c877d5%252Fpa%252FYR28195_29ee8f6e362cba6585f459f773b93bb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_29ee8f6e362cba6585f459f773b93bb6.jpg not downloaded yet
2026-03-28 18:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac28de86-0f2e-5214-840d-8ef262063c5b with identifier: SR75246
2026-03-28 18:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac28de86-0f2e-5214-840d-8ef262063c5b with scrape type 1
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac28de86-0f2e-5214-840d-8ef262063c5b
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F85%252F7f859ce6f15c3e3054da90c27ea0bd23%252Fpa%252FSR75246_d24f0802c7c98bed8a388c72d5dfc1dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_d24f0802c7c98bed8a388c72d5dfc1dc.jpg already downloaded
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F85%252F7f859ce6f15c3e3054da90c27ea0bd23%252Fpa%252FSR75246_3bc186337e5785bb1bffb0843956f879.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_3bc186337e5785bb1bffb0843956f879.jpg already downloaded
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F85%252F7f859ce6f15c3e3054da90c27ea0bd23%252Fpa%252FSR75246_7e99add7d0109d7bfba30ce10ac1a9ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_7e99add7d0109d7bfba30ce10ac1a9ec.jpg already downloaded
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F85%252F7f859ce6f15c3e3054da90c27ea0bd23%252Fpa%252FSR75246_b9682e97e859bac6448dcbe212ba3054.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_b9682e97e859bac6448dcbe212ba3054.jpg already downloaded
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F85%252F7f859ce6f15c3e3054da90c27ea0bd23%252Fpa%252FSR75246_bfe871f3e396c281fa2e2516989769e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_bfe871f3e396c281fa2e2516989769e5.jpg already downloaded
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F85%252F7f859ce6f15c3e3054da90c27ea0bd23%252Fpa%252FSR75246_08e8ccda8cb6e3b57eca901732206ca8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_08e8ccda8cb6e3b57eca901732206ca8.jpg already downloaded
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F85%252F7f859ce6f15c3e3054da90c27ea0bd23%252Fpa%252FSR75246_57eaf3b4a3eef37672fda72a6681841a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_57eaf3b4a3eef37672fda72a6681841a.jpg already downloaded
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F85%252F7f859ce6f15c3e3054da90c27ea0bd23%252Fpa%252FSR75246_e05fd3252722525ededbf37bc6c493e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_e05fd3252722525ededbf37bc6c493e6.jpg already downloaded
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F85%252F7f859ce6f15c3e3054da90c27ea0bd23%252Fpa%252FSR75246_1b77543582016e5f4de41e42b9acb762.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_1b77543582016e5f4de41e42b9acb762.jpg already downloaded
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F85%252F7f859ce6f15c3e3054da90c27ea0bd23%252Fpa%252FSR75246_e74b1f9209eb32b280e9eda8f23b9f15.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_e74b1f9209eb32b280e9eda8f23b9f15.jpg already downloaded
2026-03-28 18:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac28de86-0f2e-5214-840d-8ef262063c5b, identifier: SR75246
2026-03-28 18:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac28de86-0f2e-5214-840d-8ef262063c5b with identifier: SR75246
2026-03-28 18:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac28de86-0f2e-5214-840d-8ef262063c5b with identifier: SR75246
2026-03-28 18:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac28de86-0f2e-5214-840d-8ef262063c5b with identifier: SR75246 to the API
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SR75246>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:10:12Z',
 'fuel_type': 'petrol',
 'id': 'ac28de86-0f2e-5214-840d-8ef262063c5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR75246',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 182331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_d24f0802c7c98bed8a388c72d5dfc1dc.jpg',
                'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_3bc186337e5785bb1bffb0843956f879.jpg',
                'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_7e99add7d0109d7bfba30ce10ac1a9ec.jpg',
                'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_b9682e97e859bac6448dcbe212ba3054.jpg',
                'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_bfe871f3e396c281fa2e2516989769e5.jpg',
                'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_08e8ccda8cb6e3b57eca901732206ca8.jpg',
                'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_57eaf3b4a3eef37672fda72a6681841a.jpg',
                'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_e05fd3252722525ededbf37bc6c493e6.jpg',
                'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_1b77543582016e5f4de41e42b9acb762.jpg',
                'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_e74b1f9209eb32b280e9eda8f23b9f15.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac28de86-0f2e-5214-840d-8ef262063c5b/ac28de86-0f2e-5214-840d-8ef262063c5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_d24f0802c7c98bed8a388c72d5dfc1dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac28de86-0f2e-5214-840d-8ef262063c5b/ac28de86-0f2e-5214-840d-8ef262063c5b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_3bc186337e5785bb1bffb0843956f879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac28de86-0f2e-5214-840d-8ef262063c5b/ac28de86-0f2e-5214-840d-8ef262063c5b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_7e99add7d0109d7bfba30ce10ac1a9ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac28de86-0f2e-5214-840d-8ef262063c5b/ac28de86-0f2e-5214-840d-8ef262063c5b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_b9682e97e859bac6448dcbe212ba3054.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac28de86-0f2e-5214-840d-8ef262063c5b/ac28de86-0f2e-5214-840d-8ef262063c5b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_bfe871f3e396c281fa2e2516989769e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac28de86-0f2e-5214-840d-8ef262063c5b/ac28de86-0f2e-5214-840d-8ef262063c5b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_08e8ccda8cb6e3b57eca901732206ca8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac28de86-0f2e-5214-840d-8ef262063c5b/ac28de86-0f2e-5214-840d-8ef262063c5b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_57eaf3b4a3eef37672fda72a6681841a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac28de86-0f2e-5214-840d-8ef262063c5b/ac28de86-0f2e-5214-840d-8ef262063c5b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_e05fd3252722525ededbf37bc6c493e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac28de86-0f2e-5214-840d-8ef262063c5b/ac28de86-0f2e-5214-840d-8ef262063c5b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_1b77543582016e5f4de41e42b9acb762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac28de86-0f2e-5214-840d-8ef262063c5b/ac28de86-0f2e-5214-840d-8ef262063c5b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/85/7f859ce6f15c3e3054da90c27ea0bd23/pa/SR75246_e74b1f9209eb32b280e9eda8f23b9f15.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T AMG Line',
 'transmission': 'manual',
 'trim': 'T AMG Line',
 'year': 2015}
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR75246%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Saving data for SR75246: {'created_time': 1774723696.39255, 'last_price_update_time': 1774723696.392562, 'auction_closing_time': 1774883412.0}
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR75246') HTTP/1.1" 204 0
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb1%252F18b10ae750170f50e9a7768143c877d5%252Fpa%252FYR28195_ef7a8a55d412c5be9d3ec47519713e1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_ef7a8a55d412c5be9d3ec47519713e1a.jpg not downloaded yet
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_692c797f825394076a7f63665563d8e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_2c11455f1b67c9715d360b3579828b2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb1%252F18b10ae750170f50e9a7768143c877d5%252Fpa%252FYR28195_0233b83aef579fc1ff5ead1298a4270d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_0233b83aef579fc1ff5ead1298a4270d.jpg not downloaded yet
2026-03-28 18:48:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456112f90>
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_affaed0196cfce86326b09536db28ecb.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_affaed0196cfce86326b09536db28ecb.jpg saved to cache
2026-03-28 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b54d80ea-71b5-5cdd-a266-b510de27fe9f
2026-03-28 18:48:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb1%252F18b10ae750170f50e9a7768143c877d5%252Fpa%252FYR28195_f8605ddb3a1e27fbd560e2662835bf3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_f8605ddb3a1e27fbd560e2662835bf3c.jpg not downloaded yet
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546a1890>
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_692c797f825394076a7f63665563d8e0.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_692c797f825394076a7f63665563d8e0.jpg saved to cache
2026-03-28 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10bf9abd-ed49-5e26-8d07-67425d4023ae
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454790910>
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_2c11455f1b67c9715d360b3579828b2c.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_2c11455f1b67c9715d360b3579828b2c.jpg saved to cache
2026-03-28 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10bf9abd-ed49-5e26-8d07-67425d4023ae
2026-03-28 18:48:16 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 6020 | hits on page: 40
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb1%252F18b10ae750170f50e9a7768143c877d5%252Fpa%252FYR28195_01abc0aa7994df1b59adf1697de77a2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_01abc0aa7994df1b59adf1697de77a2e.jpg not downloaded yet
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_2e1d7d793d2e1735a8e2747c1ae3a5ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR42013%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Scrape type for CR42013: 0
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU69011%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Scrape type for CU69011: 0
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD92607%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Scrape type for WD92607: 0
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM28208%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Scrape type for GM28208: 0
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE92374%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Scrape type for XE92374: 0
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ06190%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Scrape type for EZ06190: 0
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE79871%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Scrape type for RE79871: 0
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71513%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Scrape type for GJ71513: 0
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67531%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Scrape type for XT67531: 0
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB33753%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Scrape type for PB33753: 0
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU57767%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Scrape type for TU57767: 0
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR78495%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Scrape type for HR78495: 0
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU85035%27 HTTP/1.1" 200 None
2026-03-28 18:48:16 [auto1.de] INFO: Scrape type for RU85035: 0
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-28 18:48:16 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_807e6ac6f751821856d7c80095fe17f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456419410>
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_2e1d7d793d2e1735a8e2747c1ae3a5ea.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_2e1d7d793d2e1735a8e2747c1ae3a5ea.jpg saved to cache
2026-03-28 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_ea937f8a0cc57b8814630312e8777691.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_954ad31ebd9953f8196ffe36a85c4cf7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_df0c20a0db2b31d6272a62e9bdf4cfb5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_a0d89820d417961711068d4a462a7736.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_3f213e142c3dc50df1bb63b6264f26b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_0fc841b187a04e09cca6de0544c93f43.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_94f8ffcd6b0f2d4c1ae546f9dd3da462.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_05d56a69b99b3f8d5b248efe434b5351.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_fbd8a9fe1a30ae628a1d5f48247adcd6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456060190>
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_807e6ac6f751821856d7c80095fe17f0.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_807e6ac6f751821856d7c80095fe17f0.jpg saved to cache
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f
2026-03-28 18:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_29ee8f6e362cba6585f459f773b93bb6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618f190>
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_ea937f8a0cc57b8814630312e8777691.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_ea937f8a0cc57b8814630312e8777691.jpg saved to cache
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbb98a53-7a1a-5938-8404-a38b8206175c
2026-03-28 18:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_f8605ddb3a1e27fbd560e2662835bf3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_01abc0aa7994df1b59adf1697de77a2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_0233b83aef579fc1ff5ead1298a4270d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a8150>
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_954ad31ebd9953f8196ffe36a85c4cf7.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_954ad31ebd9953f8196ffe36a85c4cf7.jpg saved to cache
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f
2026-03-28 18:48:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458274910>
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_df0c20a0db2b31d6272a62e9bdf4cfb5.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_df0c20a0db2b31d6272a62e9bdf4cfb5.jpg saved to cache
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9ab4fc4-4c34-5084-87f2-38a39718a000
2026-03-28 18:48:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456248090>
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6a%252F986a89926b3603757ea920962e819b19%252Fpa%252FJS00894_a0d89820d417961711068d4a462a7736.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_a0d89820d417961711068d4a462a7736.jpg saved to cache
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9ab4fc4-4c34-5084-87f2-38a39718a000
2026-03-28 18:48:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9ab4fc4-4c34-5084-87f2-38a39718a000, skipping ID generation
2026-03-28 18:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9ab4fc4-4c34-5084-87f2-38a39718a000 with scrape type 1
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9ab4fc4-4c34-5084-87f2-38a39718a000 sending to next pipeline
2026-03-28 18:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9ab4fc4-4c34-5084-87f2-38a39718a000, identifier: JS00894
2026-03-28 18:48:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561bee50>
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_3f213e142c3dc50df1bb63b6264f26b5.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_3f213e142c3dc50df1bb63b6264f26b5.jpg saved to cache
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10bf9abd-ed49-5e26-8d07-67425d4023ae
2026-03-28 18:48:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564ac310>
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4e%252F294e5f305c2ba734c80e81cb8feb135c%252Fpa%252FHL64703_0fc841b187a04e09cca6de0544c93f43.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_0fc841b187a04e09cca6de0544c93f43.jpg saved to cache
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b54d80ea-71b5-5cdd-a266-b510de27fe9f
2026-03-28 18:48:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b54d80ea-71b5-5cdd-a266-b510de27fe9f, skipping ID generation
2026-03-28 18:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b54d80ea-71b5-5cdd-a266-b510de27fe9f with scrape type 1
2026-03-28 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b54d80ea-71b5-5cdd-a266-b510de27fe9f sending to next pipeline
2026-03-28 18:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b54d80ea-71b5-5cdd-a266-b510de27fe9f, identifier: HL64703
2026-03-28 18:48:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245475d290>
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_94f8ffcd6b0f2d4c1ae546f9dd3da462.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_94f8ffcd6b0f2d4c1ae546f9dd3da462.jpg saved to cache
2026-03-28 18:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10bf9abd-ed49-5e26-8d07-67425d4023ae
2026-03-28 18:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564af9d0>
2026-03-28 18:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6b87ac-7b0d-549f-9093-c347185962f5/3e6b87ac-7b0d-549f-9093-c347185962f5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F8f%252F948f08d7c40341fd6fffef79f91f9c98%252Fpa%252FCL01053_05d56a69b99b3f8d5b248efe434b5351.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_05d56a69b99b3f8d5b248efe434b5351.jpg saved to cache
2026-03-28 18:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e6b87ac-7b0d-549f-9093-c347185962f5
2026-03-28 18:48:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e6b87ac-7b0d-549f-9093-c347185962f5, skipping ID generation
2026-03-28 18:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e6b87ac-7b0d-549f-9093-c347185962f5 with scrape type 1
2026-03-28 18:48:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e6b87ac-7b0d-549f-9093-c347185962f5 sending to next pipeline
2026-03-28 18:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e6b87ac-7b0d-549f-9093-c347185962f5, identifier: CL01053
2026-03-28 18:48:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245616de50>
2026-03-28 18:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F83%252Fe78381416b336ce57131fa8aab617ea0%252Fpa%252FKJ49270_fbd8a9fe1a30ae628a1d5f48247adcd6.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_fbd8a9fe1a30ae628a1d5f48247adcd6.jpg saved to cache
2026-03-28 18:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10bf9abd-ed49-5e26-8d07-67425d4023ae
2026-03-28 18:48:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10bf9abd-ed49-5e26-8d07-67425d4023ae, skipping ID generation
2026-03-28 18:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10bf9abd-ed49-5e26-8d07-67425d4023ae with scrape type 1
2026-03-28 18:48:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10bf9abd-ed49-5e26-8d07-67425d4023ae sending to next pipeline
2026-03-28 18:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10bf9abd-ed49-5e26-8d07-67425d4023ae, identifier: KJ49270
2026-03-28 18:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9ab4fc4-4c34-5084-87f2-38a39718a000 with identifier: JS00894
2026-03-28 18:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9ab4fc4-4c34-5084-87f2-38a39718a000 with identifier: JS00894
2026-03-28 18:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9ab4fc4-4c34-5084-87f2-38a39718a000 with identifier: JS00894 to the API
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_a0d89820d417961711068d4a462a7736.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:32:43Z',
 'fuel_type': 'petrol',
 'id': 'b9ab4fc4-4c34-5084-87f2-38a39718a000',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS00894',
 'listing': 'auction',
 'location': 'DE, Braunschweig',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 139174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2521882,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_df0c20a0db2b31d6272a62e9bdf4cfb5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2572898,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_a0d89820d417961711068d4a462a7736.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2396508,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_aff5d053eec865e319a55939629b48ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2355243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_c9257ebfb1472f70c10de55e4fa265be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_9b350ccf3e86622e6afe5fbe07edaa45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_42a34394d9bd14c951ccd492dbadaaac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2515642,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_d47daf8ab4fd18c72d13170d6d3e08c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2591036,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_67c89a1fb0d2d2099ae28507d7b7ef4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2564969,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_3c1dd446b1d5a71a71fc0f23469314a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ab4fc4-4c34-5084-87f2-38a39718a000/b9ab4fc4-4c34-5084-87f2-38a39718a000_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6a/986a89926b3603757ea920962e819b19/pa/JS00894_c4d73848b27d10267ac6dcd153f35c2b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS00894%27 HTTP/1.1" 200 None
2026-03-28 18:48:18 [auto1.de] INFO: Saving data for JS00894: {'created_time': 1774723698.720092, 'last_price_update_time': 1774723698.720103, 'auction_closing_time': 1774884763.0}
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS00894') HTTP/1.1" 204 0
2026-03-28 18:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b54d80ea-71b5-5cdd-a266-b510de27fe9f with identifier: HL64703
2026-03-28 18:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b54d80ea-71b5-5cdd-a266-b510de27fe9f with identifier: HL64703
2026-03-28 18:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b54d80ea-71b5-5cdd-a266-b510de27fe9f with identifier: HL64703 to the API
2026-03-28 18:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_0fc841b187a04e09cca6de0544c93f43.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:16Z',
 'fuel_type': 'petrol',
 'id': 'b54d80ea-71b5-5cdd-a266-b510de27fe9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL64703',
 'listing': 'auction',
 'location': 'DE, Trier',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 90289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3223610,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_0fc841b187a04e09cca6de0544c93f43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3116324,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_affaed0196cfce86326b09536db28ecb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_e39bc16a0cb1e77e069d20758eb4f059.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_0ef9cb9843011dbc77863d19d04171ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_ef6e77fb2d79d2cad6259b632833c8de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2988565,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_a684aa4f962479a8b7dbaa6f362ea03a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_fe2e47776a6b3f9bda5b91944677a721.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_f65e9e4f789078f24fea7d9c1bc3a2df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3220304,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_bfa94db6d5363d483316fc59fd64ce05.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b54d80ea-71b5-5cdd-a266-b510de27fe9f/b54d80ea-71b5-5cdd-a266-b510de27fe9f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/4e/294e5f305c2ba734c80e81cb8feb135c/pa/HL64703_4663fe95520b59659302c9fbafe1be0a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.5 TSI ACT Soleil',
 'transmission': 'automatic',
 'trim': 'Soleil',
 'year': 2019}
2026-03-28 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL64703%27 HTTP/1.1" 200 None
2026-03-28 18:48:19 [auto1.de] INFO: Saving data for HL64703: {'created_time': 1774723699.259565, 'last_price_update_time': 1774723699.259576, 'auction_closing_time': 1774885816.0}
2026-03-28 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL64703') HTTP/1.1" 204 0
2026-03-28 18:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e6b87ac-7b0d-549f-9093-c347185962f5 with identifier: CL01053
2026-03-28 18:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e6b87ac-7b0d-549f-9093-c347185962f5 with identifier: CL01053
2026-03-28 18:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e6b87ac-7b0d-549f-9093-c347185962f5 with identifier: CL01053 to the API
2026-03-28 18:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_05d56a69b99b3f8d5b248efe434b5351.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:47:33Z',
 'fuel_type': 'diesel',
 'id': '3e6b87ac-7b0d-549f-9093-c347185962f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL01053',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Dacia',
 'model': 'Logan',
 'odometer': 149937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6b87ac-7b0d-549f-9093-c347185962f5/3e6b87ac-7b0d-549f-9093-c347185962f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_05d56a69b99b3f8d5b248efe434b5351.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6b87ac-7b0d-549f-9093-c347185962f5/3e6b87ac-7b0d-549f-9093-c347185962f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_c0f3ac43ea4d257db9c7b257b84dad8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6b87ac-7b0d-549f-9093-c347185962f5/3e6b87ac-7b0d-549f-9093-c347185962f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_13e802b41d3cbee736f5cbd959253b02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6b87ac-7b0d-549f-9093-c347185962f5/3e6b87ac-7b0d-549f-9093-c347185962f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_ec17dc68bc4d7f7080ec6899fc992635.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6b87ac-7b0d-549f-9093-c347185962f5/3e6b87ac-7b0d-549f-9093-c347185962f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 149715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_510a56a3613f8b3a9bb0da5321e4d0ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6b87ac-7b0d-549f-9093-c347185962f5/3e6b87ac-7b0d-549f-9093-c347185962f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/8f/948f08d7c40341fd6fffef79f91f9c98/pa/CL01053_a447753668a6d5f7c2426f8bec4274d0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-05-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Logan 1.5 dCi Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2006}
2026-03-28 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL01053%27 HTTP/1.1" 200 None
2026-03-28 18:48:19 [auto1.de] INFO: Saving data for CL01053: {'created_time': 1774723699.651373, 'last_price_update_time': 1774723699.651383, 'auction_closing_time': 1774885653.0}
2026-03-28 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL01053') HTTP/1.1" 204 0
2026-03-28 18:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10bf9abd-ed49-5e26-8d07-67425d4023ae with identifier: KJ49270
2026-03-28 18:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10bf9abd-ed49-5e26-8d07-67425d4023ae with identifier: KJ49270
2026-03-28 18:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10bf9abd-ed49-5e26-8d07-67425d4023ae with identifier: KJ49270 to the API
2026-03-28 18:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_fbd8a9fe1a30ae628a1d5f48247adcd6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:20:18Z',
 'fuel_type': 'petrol',
 'id': '10bf9abd-ed49-5e26-8d07-67425d4023ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ49270',
 'listing': 'auction',
 'location': 'DE, Mönchengladbach',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 110910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3510787,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_fbd8a9fe1a30ae628a1d5f48247adcd6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3199618,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_7786fa040df6002914ba0a139d5de73c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_2c11455f1b67c9715d360b3579828b2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_692c797f825394076a7f63665563d8e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3296641,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_94f8ffcd6b0f2d4c1ae546f9dd3da462.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3320824,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_c674b772e5e757a935b500bc6b166c00.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3008859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_3f213e142c3dc50df1bb63b6264f26b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3204914,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_41a8798f7bd4f539dd5536e245564972.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3158013,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_aaa4bfe2f4e54a25b4f255a52b28f922.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10bf9abd-ed49-5e26-8d07-67425d4023ae/10bf9abd-ed49-5e26-8d07-67425d4023ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3459951,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/83/e78381416b336ce57131fa8aab617ea0/pa/KJ49270_5bbfd461ed73aba24ba0323906cc64f0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 I-Tech',
 'transmission': 'manual',
 'trim': 'I-Tech',
 'year': 2014}
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ49270%27 HTTP/1.1" 200 None
2026-03-28 18:48:20 [auto1.de] INFO: Saving data for KJ49270: {'created_time': 1774723700.06533, 'last_price_update_time': 1774723700.065341, 'auction_closing_time': 1774884018.0}
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ49270') HTTP/1.1" 204 0
2026-03-28 18:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_ef7a8a55d412c5be9d3ec47519713e1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC91438> (referer: https://www.auto1.com/v1/car-details-view/SC91438/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK51191> (referer: https://www.auto1.com/v1/car-details-view/HK51191/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN41694> (referer: https://www.auto1.com/v1/car-details-view/UN41694/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT00661> (referer: https://www.auto1.com/v1/car-details-view/ZT00661/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454687690>
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fd3f45a-a74a-520e-9028-ab5cc3c18e13/5fd3f45a-a74a-520e-9028-ab5cc3c18e13_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb1%252F18b10ae750170f50e9a7768143c877d5%252Fpa%252FYR28195_29ee8f6e362cba6585f459f773b93bb6.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_29ee8f6e362cba6585f459f773b93bb6.jpg saved to cache
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fd3f45a-a74a-520e-9028-ab5cc3c18e13
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245627e810>
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fd3f45a-a74a-520e-9028-ab5cc3c18e13/5fd3f45a-a74a-520e-9028-ab5cc3c18e13_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb1%252F18b10ae750170f50e9a7768143c877d5%252Fpa%252FYR28195_f8605ddb3a1e27fbd560e2662835bf3c.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_f8605ddb3a1e27fbd560e2662835bf3c.jpg saved to cache
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5fd3f45a-a74a-520e-9028-ab5cc3c18e13
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563c2b10>
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fd3f45a-a74a-520e-9028-ab5cc3c18e13/5fd3f45a-a74a-520e-9028-ab5cc3c18e13_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb1%252F18b10ae750170f50e9a7768143c877d5%252Fpa%252FYR28195_01abc0aa7994df1b59adf1697de77a2e.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_01abc0aa7994df1b59adf1697de77a2e.jpg saved to cache
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5fd3f45a-a74a-520e-9028-ab5cc3c18e13
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456499490>
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fd3f45a-a74a-520e-9028-ab5cc3c18e13/5fd3f45a-a74a-520e-9028-ab5cc3c18e13_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb1%252F18b10ae750170f50e9a7768143c877d5%252Fpa%252FYR28195_0233b83aef579fc1ff5ead1298a4270d.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_0233b83aef579fc1ff5ead1298a4270d.jpg saved to cache
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5fd3f45a-a74a-520e-9028-ab5cc3c18e13
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245467ad50>
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fd3f45a-a74a-520e-9028-ab5cc3c18e13/5fd3f45a-a74a-520e-9028-ab5cc3c18e13_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fb1%252F18b10ae750170f50e9a7768143c877d5%252Fpa%252FYR28195_ef7a8a55d412c5be9d3ec47519713e1a.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_ef7a8a55d412c5be9d3ec47519713e1a.jpg saved to cache
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5fd3f45a-a74a-520e-9028-ab5cc3c18e13
2026-03-28 18:48:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fd3f45a-a74a-520e-9028-ab5cc3c18e13, skipping ID generation
2026-03-28 18:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd3f45a-a74a-520e-9028-ab5cc3c18e13 with scrape type 1
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fd3f45a-a74a-520e-9028-ab5cc3c18e13 sending to next pipeline
2026-03-28 18:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fd3f45a-a74a-520e-9028-ab5cc3c18e13, identifier: YR28195
2026-03-28 18:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4ac8ee3-b98b-500b-a220-115938e6565b with identifier: SC91438
2026-03-28 18:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4ac8ee3-b98b-500b-a220-115938e6565b with scrape type 1
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f4ac8ee3-b98b-500b-a220-115938e6565b
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F76%252F207643929fb85c25869d629059c67be8%252Fpa%252FSC91438_543eadc173c88f2a1570b037bcb52353.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_543eadc173c88f2a1570b037bcb52353.jpg not downloaded yet
2026-03-28 18:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 404e397b-be34-542b-80b5-1a9b2bae2987 with identifier: HK51191
2026-03-28 18:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 404e397b-be34-542b-80b5-1a9b2bae2987 with scrape type 1
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 404e397b-be34-542b-80b5-1a9b2bae2987
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F11%252Fd611611071c42f653aa1345723e211c1%252Fpa%252FHK51191_4dda5d12bc92004051fa46c68e9ecc1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_4dda5d12bc92004051fa46c68e9ecc1e.jpg not downloaded yet
2026-03-28 18:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080 with identifier: UN41694
2026-03-28 18:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080 with scrape type 1
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F5a%252Fe85a460efcccce2239dfab38d2c50f5b%252Fpa%252FUN41694_6db86d115a22b4a7bae78da419025cc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_6db86d115a22b4a7bae78da419025cc9.jpg not downloaded yet
2026-03-28 18:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba with identifier: ZT00661
2026-03-28 18:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba with scrape type 1
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_931de8d5cbd37d5ba723df6cf77d0b0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_931de8d5cbd37d5ba723df6cf77d0b0a.jpg not downloaded yet
2026-03-28 18:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fd3f45a-a74a-520e-9028-ab5cc3c18e13 with identifier: YR28195
2026-03-28 18:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fd3f45a-a74a-520e-9028-ab5cc3c18e13 with identifier: YR28195
2026-03-28 18:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fd3f45a-a74a-520e-9028-ab5cc3c18e13 with identifier: YR28195 to the API
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_ef7a8a55d412c5be9d3ec47519713e1a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:51:22Z',
 'fuel_type': 'petrol',
 'id': '5fd3f45a-a74a-520e-9028-ab5cc3c18e13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR28195',
 'listing': 'auction',
 'location': 'DE, Offenbach am Main',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 175229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd3f45a-a74a-520e-9028-ab5cc3c18e13/5fd3f45a-a74a-520e-9028-ab5cc3c18e13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_29ee8f6e362cba6585f459f773b93bb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd3f45a-a74a-520e-9028-ab5cc3c18e13/5fd3f45a-a74a-520e-9028-ab5cc3c18e13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_ef7a8a55d412c5be9d3ec47519713e1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd3f45a-a74a-520e-9028-ab5cc3c18e13/5fd3f45a-a74a-520e-9028-ab5cc3c18e13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_0233b83aef579fc1ff5ead1298a4270d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd3f45a-a74a-520e-9028-ab5cc3c18e13/5fd3f45a-a74a-520e-9028-ab5cc3c18e13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_f8605ddb3a1e27fbd560e2662835bf3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd3f45a-a74a-520e-9028-ab5cc3c18e13/5fd3f45a-a74a-520e-9028-ab5cc3c18e13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/b1/18b10ae750170f50e9a7768143c877d5/pa/YR28195_01abc0aa7994df1b59adf1697de77a2e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Venga 1.6 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2011}
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR28195%27 HTTP/1.1" 200 None
2026-03-28 18:48:20 [auto1.de] INFO: Saving data for YR28195: {'created_time': 1774723700.876153, 'last_price_update_time': 1774723700.876169, 'auction_closing_time': 1774885882.0}
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR28195') HTTP/1.1" 204 0
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F76%252F207643929fb85c25869d629059c67be8%252Fpa%252FSC91438_8a6b2652c7cc264c3d0f290f7d82837b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_8a6b2652c7cc264c3d0f290f7d82837b.jpg not downloaded yet
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F11%252Fd611611071c42f653aa1345723e211c1%252Fpa%252FHK51191_243273e6578fa326ff2fe4ebd5d33a80.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_243273e6578fa326ff2fe4ebd5d33a80.jpg not downloaded yet
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F5a%252Fe85a460efcccce2239dfab38d2c50f5b%252Fpa%252FUN41694_8d7bc902866b2d146a3fa8f9a3443323.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_8d7bc902866b2d146a3fa8f9a3443323.jpg not downloaded yet
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_bac4579ea9a1bf7fd614baa8157c6c0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_bac4579ea9a1bf7fd614baa8157c6c0f.jpg not downloaded yet
2026-03-28 18:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_e9dbb0bef9f35c6a06359d68daa38c81.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_12bd06d5bc5048367f4b2365584a83d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_69e24a016fc4274917e663dd530798c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F76%252F207643929fb85c25869d629059c67be8%252Fpa%252FSC91438_2e57f381510dc6b2e18046dfb7d57ca9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_2e57f381510dc6b2e18046dfb7d57ca9.jpg not downloaded yet
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F11%252Fd611611071c42f653aa1345723e211c1%252Fpa%252FHK51191_dc0fad1ee259b9972537d7e4c1a4159e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_dc0fad1ee259b9972537d7e4c1a4159e.jpg not downloaded yet
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F5a%252Fe85a460efcccce2239dfab38d2c50f5b%252Fpa%252FUN41694_ef7b4d5254c4039e77e957a2546d999b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_ef7b4d5254c4039e77e957a2546d999b.jpg not downloaded yet
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_885c953e671bcaed178dc3e2bf814a9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_885c953e671bcaed178dc3e2bf814a9e.jpg not downloaded yet
2026-03-28 18:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F76%252F207643929fb85c25869d629059c67be8%252Fpa%252FSC91438_e2b0df0d0705eaf8d7d3b6b870f2d812.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_e2b0df0d0705eaf8d7d3b6b870f2d812.jpg not downloaded yet
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F11%252Fd611611071c42f653aa1345723e211c1%252Fpa%252FHK51191_fce8a262b035a37e00a1241a8b060978.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_fce8a262b035a37e00a1241a8b060978.jpg not downloaded yet
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F5a%252Fe85a460efcccce2239dfab38d2c50f5b%252Fpa%252FUN41694_5b1b63f9efedaa9b14c68d369ca61f26.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_5b1b63f9efedaa9b14c68d369ca61f26.jpg not downloaded yet
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_c32e4789dfafe8c0a93d626ce37f19ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_c32e4789dfafe8c0a93d626ce37f19ba.jpg not downloaded yet
2026-03-28 18:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_08e613b87f84a1bc7588a88c9e1ddfa8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F76%252F207643929fb85c25869d629059c67be8%252Fpa%252FSC91438_9cd4d7d69b03d7f834179dc36d196bc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_9cd4d7d69b03d7f834179dc36d196bc5.jpg not downloaded yet
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F11%252Fd611611071c42f653aa1345723e211c1%252Fpa%252FHK51191_e027864cbc8aa6e1667d9744b8a12ed5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_e027864cbc8aa6e1667d9744b8a12ed5.jpg not downloaded yet
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F5a%252Fe85a460efcccce2239dfab38d2c50f5b%252Fpa%252FUN41694_cc5ccff411e394e484a621728af840ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_cc5ccff411e394e484a621728af840ca.jpg not downloaded yet
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_a6031687f63c70ee7f24765bfb2f30a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_a6031687f63c70ee7f24765bfb2f30a1.jpg not downloaded yet
2026-03-28 18:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_931de8d5cbd37d5ba723df6cf77d0b0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F5a%252Fe85a460efcccce2239dfab38d2c50f5b%252Fpa%252FUN41694_6e66ef95373b4b965b78302477a0837d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_6e66ef95373b4b965b78302477a0837d.jpg not downloaded yet
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_dafaa16d72335fd05a190b3c3bb77723.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_dafaa16d72335fd05a190b3c3bb77723.jpg not downloaded yet
2026-03-28 18:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454679890>
2026-03-28 18:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_e9dbb0bef9f35c6a06359d68daa38c81.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_e9dbb0bef9f35c6a06359d68daa38c81.jpg saved to cache
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f
2026-03-28 18:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245828ad50>
2026-03-28 18:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fa7%252Faca7af4ba56f15a7b3b0b3fdba91d563%252Fpa%252FGK17224_12bd06d5bc5048367f4b2365584a83d3.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_12bd06d5bc5048367f4b2365584a83d3.jpg saved to cache
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbb98a53-7a1a-5938-8404-a38b8206175c
2026-03-28 18:48:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbb98a53-7a1a-5938-8404-a38b8206175c, skipping ID generation
2026-03-28 18:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbb98a53-7a1a-5938-8404-a38b8206175c with scrape type 1
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbb98a53-7a1a-5938-8404-a38b8206175c sending to next pipeline
2026-03-28 18:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbb98a53-7a1a-5938-8404-a38b8206175c, identifier: GK17224
2026-03-28 18:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456297650>
2026-03-28 18:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_69e24a016fc4274917e663dd530798c5.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_69e24a016fc4274917e663dd530798c5.jpg saved to cache
2026-03-28 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc
2026-03-28 18:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbb98a53-7a1a-5938-8404-a38b8206175c with identifier: GK17224
2026-03-28 18:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbb98a53-7a1a-5938-8404-a38b8206175c with identifier: GK17224
2026-03-28 18:48:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbb98a53-7a1a-5938-8404-a38b8206175c with identifier: GK17224 to the API
2026-03-28 18:48:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_12bd06d5bc5048367f4b2365584a83d3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:09:42Z',
 'fuel_type': 'diesel',
 'id': 'fbb98a53-7a1a-5938-8404-a38b8206175c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK17224',
 'listing': 'auction',
 'location': 'DE, Aschaffenburg',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 231020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_12bd06d5bc5048367f4b2365584a83d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_ea937f8a0cc57b8814630312e8777691.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_49eb43d2f8b029fec8c92c77dbc46ee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_e26a0950e20542370fe62f00c8c2b57d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_0e9711dd1c39af2a65634ebdcf2f74ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_471aedbc4f95553bbea266f0938e05a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_6d9e9fcd348c76bdfa42a81856294f90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_a7442c48b0eca41fa8eebd9c1dd0105f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_c45e7ee63531988ae08b07c40cc1605e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb98a53-7a1a-5938-8404-a38b8206175c/fbb98a53-7a1a-5938-8404-a38b8206175c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/a7/aca7af4ba56f15a7b3b0b3fdba91d563/pa/GK17224_4144334bcc263b818d4622f77c3314b2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion Tech',
 'year': 2014}
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK17224%27 HTTP/1.1" 200 None
2026-03-28 18:48:22 [auto1.de] INFO: Saving data for GK17224: {'created_time': 1774723702.843296, 'last_price_update_time': 1774723702.843306, 'auction_closing_time': 1774883382.0}
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK17224') HTTP/1.1" 204 0
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_51a5dbc83973a595417c42d03e46709c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_51a5dbc83973a595417c42d03e46709c.jpg not downloaded yet
2026-03-28 18:48:22 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 6020 | hits on page: 40
2026-03-28 18:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_6db86d115a22b4a7bae78da419025cc9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_4dda5d12bc92004051fa46c68e9ecc1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_87f7e3e0f36704ffc7413995414ff6e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_87f7e3e0f36704ffc7413995414ff6e1.jpg not downloaded yet
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ45584%27 HTTP/1.1" 200 None
2026-03-28 18:48:22 [auto1.de] INFO: Scrape type for VJ45584: 0
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45344%27 HTTP/1.1" 200 None
2026-03-28 18:48:22 [auto1.de] INFO: Scrape type for UB45344: 0
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65282%27 HTTP/1.1" 200 None
2026-03-28 18:48:22 [auto1.de] INFO: Scrape type for NF65282: 0
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10522%27 HTTP/1.1" 200 None
2026-03-28 18:48:22 [auto1.de] INFO: Scrape type for LM10522: 0
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG29831%27 HTTP/1.1" 200 None
2026-03-28 18:48:22 [auto1.de] INFO: Scrape type for VG29831: 0
2026-03-28 18:48:22 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-28 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX51381%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [auto1.de] INFO: Scrape type for GX51381: 0
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP50016%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [auto1.de] INFO: Scrape type for YP50016: 0
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN06908%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [auto1.de] INFO: Scrape type for XN06908: 0
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY64199%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [auto1.de] INFO: Scrape type for SY64199: 0
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62067%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [auto1.de] INFO: Scrape type for XV62067: 0
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91582%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [auto1.de] INFO: Scrape type for EH91582: 0
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58819%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [auto1.de] INFO: Scrape type for SG58819: 0
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE70575%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [auto1.de] INFO: Scrape type for FE70575: 0
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97651%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [auto1.de] INFO: Scrape type for TK97651: 0
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER21698%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [auto1.de] INFO: Scrape type for ER21698: 0
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY33691%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [auto1.de] INFO: Scrape type for DY33691: 0
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV98635%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [auto1.de] INFO: Scrape type for WV98635: 0
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-28 18:48:23 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-28 18:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ32125> (referer: https://www.auto1.com/v1/car-details-view/RZ32125/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH81778> (referer: https://www.auto1.com/v1/car-details-view/NH81778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG78174> (referer: https://www.auto1.com/v1/car-details-view/RG78174/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245860a490>
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_08e613b87f84a1bc7588a88c9e1ddfa8.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_08e613b87f84a1bc7588a88c9e1ddfa8.jpg saved to cache
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458a90410>
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_931de8d5cbd37d5ba723df6cf77d0b0a.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_931de8d5cbd37d5ba723df6cf77d0b0a.jpg saved to cache
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_90952f056e8dbd85d288ac14a0575e59.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_90952f056e8dbd85d288ac14a0575e59.jpg not downloaded yet
2026-03-28 18:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_885c953e671bcaed178dc3e2bf814a9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245476e210>
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cec2c4f-3ecf-5d65-b460-e80a2b2bb080/4cec2c4f-3ecf-5d65-b460-e80a2b2bb080_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F5a%252Fe85a460efcccce2239dfab38d2c50f5b%252Fpa%252FUN41694_6db86d115a22b4a7bae78da419025cc9.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_6db86d115a22b4a7bae78da419025cc9.jpg saved to cache
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546a0590>
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404e397b-be34-542b-80b5-1a9b2bae2987/404e397b-be34-542b-80b5-1a9b2bae2987_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F11%252Fd611611071c42f653aa1345723e211c1%252Fpa%252FHK51191_4dda5d12bc92004051fa46c68e9ecc1e.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_4dda5d12bc92004051fa46c68e9ecc1e.jpg saved to cache
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 404e397b-be34-542b-80b5-1a9b2bae2987
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_716a79a09b9c713f06663107ce2e31b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_716a79a09b9c713f06663107ce2e31b5.jpg not downloaded yet
2026-03-28 18:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e7f37c-07e4-5534-93d1-a7ba172d6ced with identifier: RZ32125
2026-03-28 18:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e7f37c-07e4-5534-93d1-a7ba172d6ced with scrape type 1
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b4e7f37c-07e4-5534-93d1-a7ba172d6ced
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdc%252F22dc77d42a9057dba0a60ace5665c93e%252Fpa%252FRZ32125_1f2b5735af321e8e3aa1490bf034dbd9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_1f2b5735af321e8e3aa1490bf034dbd9.jpg already downloaded
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdc%252F22dc77d42a9057dba0a60ace5665c93e%252Fpa%252FRZ32125_655e18f150b431c6334f8bc6b2f94161.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_655e18f150b431c6334f8bc6b2f94161.jpg already downloaded
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdc%252F22dc77d42a9057dba0a60ace5665c93e%252Fpa%252FRZ32125_5ba6fd44d4bdc98dc9ef952614a37730.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_5ba6fd44d4bdc98dc9ef952614a37730.jpg already downloaded
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdc%252F22dc77d42a9057dba0a60ace5665c93e%252Fpa%252FRZ32125_c03309588c468dcd935d155e67a217f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_c03309588c468dcd935d155e67a217f1.jpg already downloaded
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fdc%252F22dc77d42a9057dba0a60ace5665c93e%252Fpa%252FRZ32125_90f23a58b85b0c349b0c74b44c3a24d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_90f23a58b85b0c349b0c74b44c3a24d3.jpg already downloaded
2026-03-28 18:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4e7f37c-07e4-5534-93d1-a7ba172d6ced, identifier: RZ32125
2026-03-28 18:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4e7f37c-07e4-5534-93d1-a7ba172d6ced with identifier: RZ32125
2026-03-28 18:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4e7f37c-07e4-5534-93d1-a7ba172d6ced with identifier: RZ32125
2026-03-28 18:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4e7f37c-07e4-5534-93d1-a7ba172d6ced with identifier: RZ32125 to the API
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RZ32125>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:00:42Z',
 'fuel_type': 'diesel',
 'id': 'b4e7f37c-07e4-5534-93d1-a7ba172d6ced',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ32125',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'BMW',
 'model': '3er',
 'odometer': 341608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_1f2b5735af321e8e3aa1490bf034dbd9.jpg',
                'https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_655e18f150b431c6334f8bc6b2f94161.jpg',
                'https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_5ba6fd44d4bdc98dc9ef952614a37730.jpg',
                'https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_c03309588c468dcd935d155e67a217f1.jpg',
                'https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_90f23a58b85b0c349b0c74b44c3a24d3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e7f37c-07e4-5534-93d1-a7ba172d6ced/b4e7f37c-07e4-5534-93d1-a7ba172d6ced_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_1f2b5735af321e8e3aa1490bf034dbd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e7f37c-07e4-5534-93d1-a7ba172d6ced/b4e7f37c-07e4-5534-93d1-a7ba172d6ced_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_655e18f150b431c6334f8bc6b2f94161.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e7f37c-07e4-5534-93d1-a7ba172d6ced/b4e7f37c-07e4-5534-93d1-a7ba172d6ced_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_5ba6fd44d4bdc98dc9ef952614a37730.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e7f37c-07e4-5534-93d1-a7ba172d6ced/b4e7f37c-07e4-5534-93d1-a7ba172d6ced_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_c03309588c468dcd935d155e67a217f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e7f37c-07e4-5534-93d1-a7ba172d6ced/b4e7f37c-07e4-5534-93d1-a7ba172d6ced_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/dc/22dc77d42a9057dba0a60ace5665c93e/pa/RZ32125_90f23a58b85b0c349b0c74b44c3a24d3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 325d',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ32125%27 HTTP/1.1" 200 None
2026-03-28 18:48:23 [auto1.de] INFO: Saving data for RZ32125: {'created_time': 1774723703.922749, 'last_price_update_time': 1774723703.922762, 'auction_closing_time': 1774882842.0}
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ32125') HTTP/1.1" 204 0
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_c32e4789dfafe8c0a93d626ce37f19ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88a464b-67d2-50eb-b326-9193ed45f227 with identifier: NH81778
2026-03-28 18:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88a464b-67d2-50eb-b326-9193ed45f227 with scrape type 1
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e88a464b-67d2-50eb-b326-9193ed45f227
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_dae22bcd287954d47e2a1f13650649ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_dae22bcd287954d47e2a1f13650649ba.jpg not downloaded yet
2026-03-28 18:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a79f196-2fff-59c7-a2c7-258273abaa85 with identifier: RG78174
2026-03-28 18:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a79f196-2fff-59c7-a2c7-258273abaa85 with scrape type 1
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a79f196-2fff-59c7-a2c7-258273abaa85
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_7584134c6b803cbe808b000d683fc931.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_7584134c6b803cbe808b000d683fc931.jpg not downloaded yet
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_a6031687f63c70ee7f24765bfb2f30a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL33602/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_de134ab3f962aee4792368693fb5a083.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_de134ab3f962aee4792368693fb5a083.jpg not downloaded yet
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_db71c4cbb620c7675d2b7dc8860d3845.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_db71c4cbb620c7675d2b7dc8860d3845.jpg not downloaded yet
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561548d0>
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_885c953e671bcaed178dc3e2bf814a9e.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_885c953e671bcaed178dc3e2bf814a9e.jpg saved to cache
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_726b211479f350e00df1106dd861ca6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_726b211479f350e00df1106dd861ca6a.jpg not downloaded yet
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_69afe5cbc940404b5de4c132154be858.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_69afe5cbc940404b5de4c132154be858.jpg not downloaded yet
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_dafaa16d72335fd05a190b3c3bb77723.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456157590>
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_c32e4789dfafe8c0a93d626ce37f19ba.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_c32e4789dfafe8c0a93d626ce37f19ba.jpg saved to cache
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_51a5dbc83973a595417c42d03e46709c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_b65d74e9d77e1c41f0c391166f5ad4f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_b65d74e9d77e1c41f0c391166f5ad4f9.jpg not downloaded yet
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_3af961e18b4528da113e62a95afbdce6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_3af961e18b4528da113e62a95afbdce6.jpg not downloaded yet
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_625178f0c1de8fc1fbf3d702c5ff952e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_625178f0c1de8fc1fbf3d702c5ff952e.jpg not downloaded yet
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_56f84b757a15b5a9a66f970d266a1a52.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_56f84b757a15b5a9a66f970d266a1a52.jpg not downloaded yet
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456197190>
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_a6031687f63c70ee7f24765bfb2f30a1.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_a6031687f63c70ee7f24765bfb2f30a1.jpg saved to cache
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_6e66ef95373b4b965b78302477a0837d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_3369aa16959e9d3574e5aa740af0907d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_3369aa16959e9d3574e5aa740af0907d.jpg not downloaded yet
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_e746f368f4778b31430c87bbf1e950be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_e746f368f4778b31430c87bbf1e950be.jpg not downloaded yet
2026-03-28 18:48:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547a2ed0>
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_dafaa16d72335fd05a190b3c3bb77723.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_dafaa16d72335fd05a190b3c3bb77723.jpg saved to cache
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456212710>
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_51a5dbc83973a595417c42d03e46709c.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_51a5dbc83973a595417c42d03e46709c.jpg saved to cache
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_d3cab7be139b710df43400f0520bf06c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_d3cab7be139b710df43400f0520bf06c.jpg not downloaded yet
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_0d09433d432ed2b0e52edb2f76304d8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_0d09433d432ed2b0e52edb2f76304d8d.jpg not downloaded yet
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_cc5ccff411e394e484a621728af840ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_0e97ad227398526e017bd91f4be76667.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_0e97ad227398526e017bd91f4be76667.jpg not downloaded yet
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_9f77a092ba2ed3ca4953c7f08d08efda.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_9f77a092ba2ed3ca4953c7f08d08efda.jpg not downloaded yet
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2466af46d0>
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cec2c4f-3ecf-5d65-b460-e80a2b2bb080/4cec2c4f-3ecf-5d65-b460-e80a2b2bb080_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F5a%252Fe85a460efcccce2239dfab38d2c50f5b%252Fpa%252FUN41694_6e66ef95373b4b965b78302477a0837d.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_6e66ef95373b4b965b78302477a0837d.jpg saved to cache
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_87f7e3e0f36704ffc7413995414ff6e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_b330bd7b979f5041a0cb6d318f003870.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_b330bd7b979f5041a0cb6d318f003870.jpg not downloaded yet
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_e71d3edc7f7a6072fe3c81cf2d98fd70.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_e71d3edc7f7a6072fe3c81cf2d98fd70.jpg not downloaded yet
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_9772ca25c8bfbbdc1592280ce5449621.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_9772ca25c8bfbbdc1592280ce5449621.jpg not downloaded yet
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_6d1c5528a2fd7d2c2571eba647eb66b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_6d1c5528a2fd7d2c2571eba647eb66b2.jpg not downloaded yet
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_716a79a09b9c713f06663107ce2e31b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245628f590>
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cec2c4f-3ecf-5d65-b460-e80a2b2bb080/4cec2c4f-3ecf-5d65-b460-e80a2b2bb080_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F5a%252Fe85a460efcccce2239dfab38d2c50f5b%252Fpa%252FUN41694_cc5ccff411e394e484a621728af840ca.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_cc5ccff411e394e484a621728af840ca.jpg saved to cache
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_7584134c6b803cbe808b000d683fc931.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_534a3de68ef363409d4c9cd29ca6f9f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561fae50>
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_87f7e3e0f36704ffc7413995414ff6e1.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_87f7e3e0f36704ffc7413995414ff6e1.jpg saved to cache
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_dae22bcd287954d47e2a1f13650649ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_8022c9579e460c5a52065fe6c36e0372.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_ae3a5e979f8d0f71095b3122c6478784.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_3957eb03ce59d41695ab7041e88fb78d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_93c7c73a2a7a6129c12b0ae310ea4204.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_883299ad3b9772ea96d50c4c17b2b37d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245479e810>
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_716a79a09b9c713f06663107ce2e31b5.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_716a79a09b9c713f06663107ce2e31b5.jpg saved to cache
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618b850>
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_7584134c6b803cbe808b000d683fc931.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_7584134c6b803cbe808b000d683fc931.jpg saved to cache
2026-03-28 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a79f196-2fff-59c7-a2c7-258273abaa85
2026-03-28 18:48:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245479c110>
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_534a3de68ef363409d4c9cd29ca6f9f6.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_534a3de68ef363409d4c9cd29ca6f9f6.jpg saved to cache
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1
2026-03-28 18:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_0d09433d432ed2b0e52edb2f76304d8d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_db71c4cbb620c7675d2b7dc8860d3845.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546a3190>
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_dae22bcd287954d47e2a1f13650649ba.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_dae22bcd287954d47e2a1f13650649ba.jpg saved to cache
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e88a464b-67d2-50eb-b326-9193ed45f227
2026-03-28 18:48:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618f910>
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F99%252F97993a0fb75883c55edb4e4a66b40737%252Fpa%252FXE09172_8022c9579e460c5a52065fe6c36e0372.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_8022c9579e460c5a52065fe6c36e0372.jpg saved to cache
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f
2026-03-28 18:48:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02e08ae0-dd15-5f34-a1ee-77fb71e2558f, skipping ID generation
2026-03-28 18:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f with scrape type 1
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f sending to next pipeline
2026-03-28 18:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02e08ae0-dd15-5f34-a1ee-77fb71e2558f, identifier: XE09172
2026-03-28 18:48:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456534f50>
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_ae3a5e979f8d0f71095b3122c6478784.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_ae3a5e979f8d0f71095b3122c6478784.jpg saved to cache
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc
2026-03-28 18:48:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245649fa90>
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_3957eb03ce59d41695ab7041e88fb78d.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_3957eb03ce59d41695ab7041e88fb78d.jpg saved to cache
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc
2026-03-28 18:48:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546df0d0>
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_93c7c73a2a7a6129c12b0ae310ea4204.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_93c7c73a2a7a6129c12b0ae310ea4204.jpg saved to cache
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc
2026-03-28 18:48:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564d0cd0>
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2c%252F732c58ebf9a8b1660a37db024f75be7e%252Fpa%252FFZ76900_883299ad3b9772ea96d50c4c17b2b37d.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_883299ad3b9772ea96d50c4c17b2b37d.jpg saved to cache
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc
2026-03-28 18:48:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc, skipping ID generation
2026-03-28 18:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc with scrape type 1
2026-03-28 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc sending to next pipeline
2026-03-28 18:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc, identifier: FZ76900
2026-03-28 18:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02e08ae0-dd15-5f34-a1ee-77fb71e2558f with identifier: XE09172
2026-03-28 18:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02e08ae0-dd15-5f34-a1ee-77fb71e2558f with identifier: XE09172
2026-03-28 18:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02e08ae0-dd15-5f34-a1ee-77fb71e2558f with identifier: XE09172 to the API
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_8022c9579e460c5a52065fe6c36e0372.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:24:16Z',
 'fuel_type': 'petrol',
 'id': '02e08ae0-dd15-5f34-a1ee-77fb71e2558f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE09172',
 'listing': 'auction',
 'location': 'DE, Kamen',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 83684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3238386,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_a2d4f2b3580096bd146f0fdf1a28bafa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3255969,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_8022c9579e460c5a52065fe6c36e0372.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_e9dbb0bef9f35c6a06359d68daa38c81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_954ad31ebd9953f8196ffe36a85c4cf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_2e1d7d793d2e1735a8e2747c1ae3a5ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_43919ed5e109e234c25e8d89910c2a5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3331086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_24fd78ed655dd3877cd8ab55338ca8f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_f3096b24c0db375ebcfda60ecd1906d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3045443,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_29966439b9e740769cb6838d98513b7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e08ae0-dd15-5f34-a1ee-77fb71e2558f/02e08ae0-dd15-5f34-a1ee-77fb71e2558f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/99/97993a0fb75883c55edb4e4a66b40737/pa/XE09172_807e6ac6f751821856d7c80095fe17f0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-02-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'automatic',
 'trim': 'Filou',
 'year': 2009}
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE09172%27 HTTP/1.1" 200 None
2026-03-28 18:48:26 [auto1.de] INFO: Saving data for XE09172: {'created_time': 1774723706.412985, 'last_price_update_time': 1774723706.412995, 'auction_closing_time': 1774884256.0}
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE09172') HTTP/1.1" 204 0
2026-03-28 18:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc with identifier: FZ76900
2026-03-28 18:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc with identifier: FZ76900
2026-03-28 18:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc with identifier: FZ76900 to the API
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_883299ad3b9772ea96d50c4c17b2b37d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:40:04Z',
 'fuel_type': 'petrol',
 'id': '0d312d8d-b5cf-5660-bffa-a48e5cdaaedc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ76900',
 'listing': 'auction',
 'location': 'DE, Eschwege',
 'make': 'BMW',
 'model': '1er',
 'odometer': 102895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_26d0337459732f3993bbcf7b3325690a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3218734,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_3957eb03ce59d41695ab7041e88fb78d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_69e24a016fc4274917e663dd530798c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_48a4047357f72e0679c95b535bafdab9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3598186,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_93c7c73a2a7a6129c12b0ae310ea4204.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_2a023d2c1a01b70ceca700fdb8ed3ac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_4c90b6fecd00e22da2efecfc31d3d2c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_90e1e9c622b3f6d038068388ca07d3cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3530399,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_ae3a5e979f8d0f71095b3122c6478784.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d312d8d-b5cf-5660-bffa-a48e5cdaaedc/0d312d8d-b5cf-5660-bffa-a48e5cdaaedc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3694934,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2c/732c58ebf9a8b1660a37db024f75be7e/pa/FZ76900_883299ad3b9772ea96d50c4c17b2b37d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ76900%27 HTTP/1.1" 200 None
2026-03-28 18:48:26 [auto1.de] INFO: Saving data for FZ76900: {'created_time': 1774723706.811403, 'last_price_update_time': 1774723706.811414, 'auction_closing_time': 1774885204.0}
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ76900') HTTP/1.1" 204 0
2026-03-28 18:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456194410>
2026-03-28 18:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_0d09433d432ed2b0e52edb2f76304d8d.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_0d09433d432ed2b0e52edb2f76304d8d.jpg saved to cache
2026-03-28 18:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a79f196-2fff-59c7-a2c7-258273abaa85
2026-03-28 18:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456491110>
2026-03-28 18:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_db71c4cbb620c7675d2b7dc8860d3845.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_db71c4cbb620c7675d2b7dc8860d3845.jpg saved to cache
2026-03-28 18:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a79f196-2fff-59c7-a2c7-258273abaa85
2026-03-28 18:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_9f77a092ba2ed3ca4953c7f08d08efda.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_69afe5cbc940404b5de4c132154be858.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_6d1c5528a2fd7d2c2571eba647eb66b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_e71d3edc7f7a6072fe3c81cf2d98fd70.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_9772ca25c8bfbbdc1592280ce5449621.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_b330bd7b979f5041a0cb6d318f003870.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245632a7d0>
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_9f77a092ba2ed3ca4953c7f08d08efda.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_9f77a092ba2ed3ca4953c7f08d08efda.jpg saved to cache
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a79f196-2fff-59c7-a2c7-258273abaa85
2026-03-28 18:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_0e97ad227398526e017bd91f4be76667.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_d3cab7be139b710df43400f0520bf06c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456197110>
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_69afe5cbc940404b5de4c132154be858.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_69afe5cbc940404b5de4c132154be858.jpg saved to cache
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a79f196-2fff-59c7-a2c7-258273abaa85
2026-03-28 18:48:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245480b1d0>
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_6d1c5528a2fd7d2c2571eba647eb66b2.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_6d1c5528a2fd7d2c2571eba647eb66b2.jpg saved to cache
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a79f196-2fff-59c7-a2c7-258273abaa85
2026-03-28 18:48:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bf550>
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_e71d3edc7f7a6072fe3c81cf2d98fd70.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_e71d3edc7f7a6072fe3c81cf2d98fd70.jpg saved to cache
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a79f196-2fff-59c7-a2c7-258273abaa85
2026-03-28 18:48:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245476ac50>
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_9772ca25c8bfbbdc1592280ce5449621.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_9772ca25c8bfbbdc1592280ce5449621.jpg saved to cache
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e88a464b-67d2-50eb-b326-9193ed45f227
2026-03-28 18:48:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24548089d0>
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_b330bd7b979f5041a0cb6d318f003870.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_b330bd7b979f5041a0cb6d318f003870.jpg saved to cache
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e88a464b-67d2-50eb-b326-9193ed45f227
2026-03-28 18:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_726b211479f350e00df1106dd861ca6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24582615d0>
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_0e97ad227398526e017bd91f4be76667.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_0e97ad227398526e017bd91f4be76667.jpg saved to cache
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e88a464b-67d2-50eb-b326-9193ed45f227
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561567d0>
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_d3cab7be139b710df43400f0520bf06c.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_d3cab7be139b710df43400f0520bf06c.jpg saved to cache
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e88a464b-67d2-50eb-b326-9193ed45f227
2026-03-28 18:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_e746f368f4778b31430c87bbf1e950be.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_b65d74e9d77e1c41f0c391166f5ad4f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24547e7110>
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_726b211479f350e00df1106dd861ca6a.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_726b211479f350e00df1106dd861ca6a.jpg saved to cache
2026-03-28 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e88a464b-67d2-50eb-b326-9193ed45f227
2026-03-28 18:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_3af961e18b4528da113e62a95afbdce6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_90952f056e8dbd85d288ac14a0575e59.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_56f84b757a15b5a9a66f970d266a1a52.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_9cd4d7d69b03d7f834179dc36d196bc5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_3369aa16959e9d3574e5aa740af0907d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_625178f0c1de8fc1fbf3d702c5ff952e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_e027864cbc8aa6e1667d9744b8a12ed5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_ef7b4d5254c4039e77e957a2546d999b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454772e90>
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_e746f368f4778b31430c87bbf1e950be.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_e746f368f4778b31430c87bbf1e950be.jpg saved to cache
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a79f196-2fff-59c7-a2c7-258273abaa85
2026-03-28 18:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_5b1b63f9efedaa9b14c68d369ca61f26.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_dc0fad1ee259b9972537d7e4c1a4159e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_e2b0df0d0705eaf8d7d3b6b870f2d812.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_de134ab3f962aee4792368693fb5a083.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638ead0>
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_b65d74e9d77e1c41f0c391166f5ad4f9.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_b65d74e9d77e1c41f0c391166f5ad4f9.jpg saved to cache
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e88a464b-67d2-50eb-b326-9193ed45f227
2026-03-28 18:48:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245609dd50>
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_3af961e18b4528da113e62a95afbdce6.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_3af961e18b4528da113e62a95afbdce6.jpg saved to cache
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a79f196-2fff-59c7-a2c7-258273abaa85
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454665bd0>
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_90952f056e8dbd85d288ac14a0575e59.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_90952f056e8dbd85d288ac14a0575e59.jpg saved to cache
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba
2026-03-28 18:48:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458558f90>
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F48%252F874883a21d9807dac198d50a647c3435%252Fpa%252FRG78174_56f84b757a15b5a9a66f970d266a1a52.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_56f84b757a15b5a9a66f970d266a1a52.jpg saved to cache
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a79f196-2fff-59c7-a2c7-258273abaa85
2026-03-28 18:48:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a79f196-2fff-59c7-a2c7-258273abaa85, skipping ID generation
2026-03-28 18:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a79f196-2fff-59c7-a2c7-258273abaa85 with scrape type 1
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a79f196-2fff-59c7-a2c7-258273abaa85 sending to next pipeline
2026-03-28 18:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a79f196-2fff-59c7-a2c7-258273abaa85, identifier: RG78174
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456493490>
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ac8ee3-b98b-500b-a220-115938e6565b/f4ac8ee3-b98b-500b-a220-115938e6565b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F76%252F207643929fb85c25869d629059c67be8%252Fpa%252FSC91438_9cd4d7d69b03d7f834179dc36d196bc5.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_9cd4d7d69b03d7f834179dc36d196bc5.jpg saved to cache
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4ac8ee3-b98b-500b-a220-115938e6565b
2026-03-28 18:48:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562bfdd0>
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_3369aa16959e9d3574e5aa740af0907d.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_3369aa16959e9d3574e5aa740af0907d.jpg saved to cache
2026-03-28 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e88a464b-67d2-50eb-b326-9193ed45f227
2026-03-28 18:48:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456410d90>
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_625178f0c1de8fc1fbf3d702c5ff952e.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_625178f0c1de8fc1fbf3d702c5ff952e.jpg saved to cache
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e88a464b-67d2-50eb-b326-9193ed45f227
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456329990>
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404e397b-be34-542b-80b5-1a9b2bae2987/404e397b-be34-542b-80b5-1a9b2bae2987_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F11%252Fd611611071c42f653aa1345723e211c1%252Fpa%252FHK51191_e027864cbc8aa6e1667d9744b8a12ed5.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_e027864cbc8aa6e1667d9744b8a12ed5.jpg saved to cache
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 404e397b-be34-542b-80b5-1a9b2bae2987
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245630b310>
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cec2c4f-3ecf-5d65-b460-e80a2b2bb080/4cec2c4f-3ecf-5d65-b460-e80a2b2bb080_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F5a%252Fe85a460efcccce2239dfab38d2c50f5b%252Fpa%252FUN41694_ef7b4d5254c4039e77e957a2546d999b.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_ef7b4d5254c4039e77e957a2546d999b.jpg saved to cache
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080
2026-03-28 18:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_fce8a262b035a37e00a1241a8b060978.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a79f196-2fff-59c7-a2c7-258273abaa85 with identifier: RG78174
2026-03-28 18:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a79f196-2fff-59c7-a2c7-258273abaa85 with identifier: RG78174
2026-03-28 18:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a79f196-2fff-59c7-a2c7-258273abaa85 with identifier: RG78174 to the API
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_56f84b757a15b5a9a66f970d266a1a52.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:10:59Z',
 'fuel_type': 'petrol',
 'id': '1a79f196-2fff-59c7-a2c7-258273abaa85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG78174',
 'listing': 'auction',
 'location': 'DE, Hamburg-Billstedt',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 132719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_7584134c6b803cbe808b000d683fc931.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_db71c4cbb620c7675d2b7dc8860d3845.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2329121,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_69afe5cbc940404b5de4c132154be858.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2251703,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_3af961e18b4528da113e62a95afbdce6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2417635,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_56f84b757a15b5a9a66f970d266a1a52.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2348705,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_e746f368f4778b31430c87bbf1e950be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_0d09433d432ed2b0e52edb2f76304d8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2283165,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_9f77a092ba2ed3ca4953c7f08d08efda.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2492163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_e71d3edc7f7a6072fe3c81cf2d98fd70.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a79f196-2fff-59c7-a2c7-258273abaa85/1a79f196-2fff-59c7-a2c7-258273abaa85_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412766,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/48/874883a21d9807dac198d50a647c3435/pa/RG78174_6d1c5528a2fd7d2c2571eba647eb66b2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG78174%27 HTTP/1.1" 200 None
2026-03-28 18:48:29 [auto1.de] INFO: Saving data for RG78174: {'created_time': 1774723709.474921, 'last_price_update_time': 1774723709.474932, 'auction_closing_time': 1774883459.0}
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG78174') HTTP/1.1" 204 0
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245610d650>
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cec2c4f-3ecf-5d65-b460-e80a2b2bb080/4cec2c4f-3ecf-5d65-b460-e80a2b2bb080_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F5a%252Fe85a460efcccce2239dfab38d2c50f5b%252Fpa%252FUN41694_5b1b63f9efedaa9b14c68d369ca61f26.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_5b1b63f9efedaa9b14c68d369ca61f26.jpg saved to cache
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563c1a90>
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404e397b-be34-542b-80b5-1a9b2bae2987/404e397b-be34-542b-80b5-1a9b2bae2987_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F11%252Fd611611071c42f653aa1345723e211c1%252Fpa%252FHK51191_dc0fad1ee259b9972537d7e4c1a4159e.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_dc0fad1ee259b9972537d7e4c1a4159e.jpg saved to cache
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 404e397b-be34-542b-80b5-1a9b2bae2987
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456196cd0>
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ac8ee3-b98b-500b-a220-115938e6565b/f4ac8ee3-b98b-500b-a220-115938e6565b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F76%252F207643929fb85c25869d629059c67be8%252Fpa%252FSC91438_e2b0df0d0705eaf8d7d3b6b870f2d812.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_e2b0df0d0705eaf8d7d3b6b870f2d812.jpg saved to cache
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4ac8ee3-b98b-500b-a220-115938e6565b
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563bd290>
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Ff7%252F28f75e27ea5aac7107f17aedee5d19f4%252Fpa%252FNH81778_de134ab3f962aee4792368693fb5a083.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_de134ab3f962aee4792368693fb5a083.jpg saved to cache
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e88a464b-67d2-50eb-b326-9193ed45f227
2026-03-28 18:48:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e88a464b-67d2-50eb-b326-9193ed45f227, skipping ID generation
2026-03-28 18:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88a464b-67d2-50eb-b326-9193ed45f227 with scrape type 1
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e88a464b-67d2-50eb-b326-9193ed45f227 sending to next pipeline
2026-03-28 18:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e88a464b-67d2-50eb-b326-9193ed45f227, identifier: NH81778
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245610e5d0>
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404e397b-be34-542b-80b5-1a9b2bae2987/404e397b-be34-542b-80b5-1a9b2bae2987_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F11%252Fd611611071c42f653aa1345723e211c1%252Fpa%252FHK51191_fce8a262b035a37e00a1241a8b060978.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_fce8a262b035a37e00a1241a8b060978.jpg saved to cache
2026-03-28 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 404e397b-be34-542b-80b5-1a9b2bae2987
2026-03-28 18:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e88a464b-67d2-50eb-b326-9193ed45f227 with identifier: NH81778
2026-03-28 18:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e88a464b-67d2-50eb-b326-9193ed45f227 with identifier: NH81778
2026-03-28 18:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e88a464b-67d2-50eb-b326-9193ed45f227 with identifier: NH81778 to the API
2026-03-28 18:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_de134ab3f962aee4792368693fb5a083.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:58:49Z',
 'fuel_type': 'petrol',
 'id': 'e88a464b-67d2-50eb-b326-9193ed45f227',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH81778',
 'listing': 'auction',
 'location': 'DE, Tradein',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 48365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_dae22bcd287954d47e2a1f13650649ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_de134ab3f962aee4792368693fb5a083.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_726b211479f350e00df1106dd861ca6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2183594,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_b65d74e9d77e1c41f0c391166f5ad4f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2928788,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_625178f0c1de8fc1fbf3d702c5ff952e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2952760,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_3369aa16959e9d3574e5aa740af0907d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_d3cab7be139b710df43400f0520bf06c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_0e97ad227398526e017bd91f4be76667.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2779471,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_b330bd7b979f5041a0cb6d318f003870.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e88a464b-67d2-50eb-b326-9193ed45f227/e88a464b-67d2-50eb-b326-9193ed45f227_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2546649,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/f7/28f75e27ea5aac7107f17aedee5d19f4/pa/NH81778_9772ca25c8bfbbdc1592280ce5449621.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2017}
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81778%27 HTTP/1.1" 200 None
2026-03-28 18:48:30 [auto1.de] INFO: Saving data for NH81778: {'created_time': 1774723710.167942, 'last_price_update_time': 1774723710.167953, 'auction_closing_time': 1774886329.0}
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH81778') HTTP/1.1" 204 0
2026-03-28 18:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_5f5aa3afca809c1ca83b526f48ce367a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_8d7bc902866b2d146a3fa8f9a3443323.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_243273e6578fa326ff2fe4ebd5d33a80.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_543eadc173c88f2a1570b037bcb52353.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_8a6b2652c7cc264c3d0f290f7d82837b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_2e57f381510dc6b2e18046dfb7d57ca9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_71e8a1b576b560daf1b65670a5bbaf8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_bac4579ea9a1bf7fd614baa8157c6c0f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_bef4ffd2be923bf31997b7fc693a9e2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_3d770284e59eac4ea27887425aff36c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_482e975ed6d402a07244e7668b9ddc82.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245651a9d0>
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_5f5aa3afca809c1ca83b526f48ce367a.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_5f5aa3afca809c1ca83b526f48ce367a.jpg saved to cache
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245476a810>
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cec2c4f-3ecf-5d65-b460-e80a2b2bb080/4cec2c4f-3ecf-5d65-b460-e80a2b2bb080_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F5a%252Fe85a460efcccce2239dfab38d2c50f5b%252Fpa%252FUN41694_8d7bc902866b2d146a3fa8f9a3443323.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_8d7bc902866b2d146a3fa8f9a3443323.jpg saved to cache
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080
2026-03-28 18:48:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080, skipping ID generation
2026-03-28 18:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080 with scrape type 1
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080 sending to next pipeline
2026-03-28 18:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080, identifier: UN41694
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454768690>
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404e397b-be34-542b-80b5-1a9b2bae2987/404e397b-be34-542b-80b5-1a9b2bae2987_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F11%252Fd611611071c42f653aa1345723e211c1%252Fpa%252FHK51191_243273e6578fa326ff2fe4ebd5d33a80.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_243273e6578fa326ff2fe4ebd5d33a80.jpg saved to cache
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 404e397b-be34-542b-80b5-1a9b2bae2987
2026-03-28 18:48:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 404e397b-be34-542b-80b5-1a9b2bae2987, skipping ID generation
2026-03-28 18:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 404e397b-be34-542b-80b5-1a9b2bae2987 with scrape type 1
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 404e397b-be34-542b-80b5-1a9b2bae2987 sending to next pipeline
2026-03-28 18:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 404e397b-be34-542b-80b5-1a9b2bae2987, identifier: HK51191
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245624bd10>
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ac8ee3-b98b-500b-a220-115938e6565b/f4ac8ee3-b98b-500b-a220-115938e6565b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F76%252F207643929fb85c25869d629059c67be8%252Fpa%252FSC91438_543eadc173c88f2a1570b037bcb52353.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_543eadc173c88f2a1570b037bcb52353.jpg saved to cache
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4ac8ee3-b98b-500b-a220-115938e6565b
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454662d50>
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ac8ee3-b98b-500b-a220-115938e6565b/f4ac8ee3-b98b-500b-a220-115938e6565b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F76%252F207643929fb85c25869d629059c67be8%252Fpa%252FSC91438_8a6b2652c7cc264c3d0f290f7d82837b.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_8a6b2652c7cc264c3d0f290f7d82837b.jpg saved to cache
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4ac8ee3-b98b-500b-a220-115938e6565b
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245624ad50>
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ac8ee3-b98b-500b-a220-115938e6565b/f4ac8ee3-b98b-500b-a220-115938e6565b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F76%252F207643929fb85c25869d629059c67be8%252Fpa%252FSC91438_2e57f381510dc6b2e18046dfb7d57ca9.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_2e57f381510dc6b2e18046dfb7d57ca9.jpg saved to cache
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4ac8ee3-b98b-500b-a220-115938e6565b
2026-03-28 18:48:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4ac8ee3-b98b-500b-a220-115938e6565b, skipping ID generation
2026-03-28 18:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4ac8ee3-b98b-500b-a220-115938e6565b with scrape type 1
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4ac8ee3-b98b-500b-a220-115938e6565b sending to next pipeline
2026-03-28 18:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4ac8ee3-b98b-500b-a220-115938e6565b, identifier: SC91438
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456156410>
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b96697-f0d5-51a2-99bd-a75d924e95ad/83b96697-f0d5-51a2-99bd-a75d924e95ad_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4d%252F104d56e36cab306fd164fb85d99a34f9%252Fpa%252FAZ02782_71e8a1b576b560daf1b65670a5bbaf8a.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_71e8a1b576b560daf1b65670a5bbaf8a.jpg saved to cache
2026-03-28 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83b96697-f0d5-51a2-99bd-a75d924e95ad
2026-03-28 18:48:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a45d0>
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F21%252Fc3219063b8802a8c2837f9bfde56e4fb%252Fpa%252FZT00661_bac4579ea9a1bf7fd614baa8157c6c0f.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_bac4579ea9a1bf7fd614baa8157c6c0f.jpg saved to cache
2026-03-28 18:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba
2026-03-28 18:48:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba, skipping ID generation
2026-03-28 18:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba with scrape type 1
2026-03-28 18:48:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba sending to next pipeline
2026-03-28 18:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba, identifier: ZT00661
2026-03-28 18:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454711150>
2026-03-28 18:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_bef4ffd2be923bf31997b7fc693a9e2a.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_bef4ffd2be923bf31997b7fc693a9e2a.jpg saved to cache
2026-03-28 18:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1
2026-03-28 18:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a7d90>
2026-03-28 18:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b96697-f0d5-51a2-99bd-a75d924e95ad/83b96697-f0d5-51a2-99bd-a75d924e95ad_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4d%252F104d56e36cab306fd164fb85d99a34f9%252Fpa%252FAZ02782_3d770284e59eac4ea27887425aff36c8.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_3d770284e59eac4ea27887425aff36c8.jpg saved to cache
2026-03-28 18:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83b96697-f0d5-51a2-99bd-a75d924e95ad
2026-03-28 18:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564a3150>
2026-03-28 18:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b96697-f0d5-51a2-99bd-a75d924e95ad/83b96697-f0d5-51a2-99bd-a75d924e95ad_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4d%252F104d56e36cab306fd164fb85d99a34f9%252Fpa%252FAZ02782_482e975ed6d402a07244e7668b9ddc82.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_482e975ed6d402a07244e7668b9ddc82.jpg saved to cache
2026-03-28 18:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83b96697-f0d5-51a2-99bd-a75d924e95ad
2026-03-28 18:48:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83b96697-f0d5-51a2-99bd-a75d924e95ad, skipping ID generation
2026-03-28 18:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83b96697-f0d5-51a2-99bd-a75d924e95ad with scrape type 1
2026-03-28 18:48:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83b96697-f0d5-51a2-99bd-a75d924e95ad sending to next pipeline
2026-03-28 18:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83b96697-f0d5-51a2-99bd-a75d924e95ad, identifier: AZ02782
2026-03-28 18:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080 with identifier: UN41694
2026-03-28 18:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080 with identifier: UN41694
2026-03-28 18:48:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080 with identifier: UN41694 to the API
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_8d7bc902866b2d146a3fa8f9a3443323.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:57:56Z',
 'fuel_type': 'petrol',
 'id': '4cec2c4f-3ecf-5d65-b460-e80a2b2bb080',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN41694',
 'listing': 'auction',
 'location': 'DE, Halle',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 290737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cec2c4f-3ecf-5d65-b460-e80a2b2bb080/4cec2c4f-3ecf-5d65-b460-e80a2b2bb080_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_6db86d115a22b4a7bae78da419025cc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cec2c4f-3ecf-5d65-b460-e80a2b2bb080/4cec2c4f-3ecf-5d65-b460-e80a2b2bb080_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_8d7bc902866b2d146a3fa8f9a3443323.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cec2c4f-3ecf-5d65-b460-e80a2b2bb080/4cec2c4f-3ecf-5d65-b460-e80a2b2bb080_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_ef7b4d5254c4039e77e957a2546d999b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cec2c4f-3ecf-5d65-b460-e80a2b2bb080/4cec2c4f-3ecf-5d65-b460-e80a2b2bb080_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_5b1b63f9efedaa9b14c68d369ca61f26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cec2c4f-3ecf-5d65-b460-e80a2b2bb080/4cec2c4f-3ecf-5d65-b460-e80a2b2bb080_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_cc5ccff411e394e484a621728af840ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cec2c4f-3ecf-5d65-b460-e80a2b2bb080/4cec2c4f-3ecf-5d65-b460-e80a2b2bb080_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/5a/e85a460efcccce2239dfab38d2c50f5b/pa/UN41694_6e66ef95373b4b965b78302477a0837d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Best of',
 'transmission': 'manual',
 'trim': 'Best of',
 'year': 2012}
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN41694%27 HTTP/1.1" 200 None
2026-03-28 18:48:31 [auto1.de] INFO: Saving data for UN41694: {'created_time': 1774723711.896454, 'last_price_update_time': 1774723711.896466, 'auction_closing_time': 1774886276.0}
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN41694') HTTP/1.1" 204 0
2026-03-28 18:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 404e397b-be34-542b-80b5-1a9b2bae2987 with identifier: HK51191
2026-03-28 18:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 404e397b-be34-542b-80b5-1a9b2bae2987 with identifier: HK51191
2026-03-28 18:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 404e397b-be34-542b-80b5-1a9b2bae2987 with identifier: HK51191 to the API
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_243273e6578fa326ff2fe4ebd5d33a80.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:12:24Z',
 'fuel_type': 'petrol',
 'id': '404e397b-be34-542b-80b5-1a9b2bae2987',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK51191',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 121455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404e397b-be34-542b-80b5-1a9b2bae2987/404e397b-be34-542b-80b5-1a9b2bae2987_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_4dda5d12bc92004051fa46c68e9ecc1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404e397b-be34-542b-80b5-1a9b2bae2987/404e397b-be34-542b-80b5-1a9b2bae2987_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_243273e6578fa326ff2fe4ebd5d33a80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404e397b-be34-542b-80b5-1a9b2bae2987/404e397b-be34-542b-80b5-1a9b2bae2987_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_dc0fad1ee259b9972537d7e4c1a4159e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404e397b-be34-542b-80b5-1a9b2bae2987/404e397b-be34-542b-80b5-1a9b2bae2987_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_fce8a262b035a37e00a1241a8b060978.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404e397b-be34-542b-80b5-1a9b2bae2987/404e397b-be34-542b-80b5-1a9b2bae2987_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/11/d611611071c42f653aa1345723e211c1/pa/HK51191_e027864cbc8aa6e1667d9744b8a12ed5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-12-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2003}
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK51191%27 HTTP/1.1" 200 None
2026-03-28 18:48:32 [auto1.de] INFO: Saving data for HK51191: {'created_time': 1774723712.279121, 'last_price_update_time': 1774723712.279133, 'auction_closing_time': 1774883544.0}
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK51191') HTTP/1.1" 204 0
2026-03-28 18:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4ac8ee3-b98b-500b-a220-115938e6565b with identifier: SC91438
2026-03-28 18:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4ac8ee3-b98b-500b-a220-115938e6565b with identifier: SC91438
2026-03-28 18:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4ac8ee3-b98b-500b-a220-115938e6565b with identifier: SC91438 to the API
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_2e57f381510dc6b2e18046dfb7d57ca9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:41:31Z',
 'fuel_type': 'petrol',
 'id': 'f4ac8ee3-b98b-500b-a220-115938e6565b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC91438',
 'listing': 'auction',
 'location': 'DE, Eschwege',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 190414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ac8ee3-b98b-500b-a220-115938e6565b/f4ac8ee3-b98b-500b-a220-115938e6565b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_543eadc173c88f2a1570b037bcb52353.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ac8ee3-b98b-500b-a220-115938e6565b/f4ac8ee3-b98b-500b-a220-115938e6565b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_8a6b2652c7cc264c3d0f290f7d82837b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ac8ee3-b98b-500b-a220-115938e6565b/f4ac8ee3-b98b-500b-a220-115938e6565b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_2e57f381510dc6b2e18046dfb7d57ca9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ac8ee3-b98b-500b-a220-115938e6565b/f4ac8ee3-b98b-500b-a220-115938e6565b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_e2b0df0d0705eaf8d7d3b6b870f2d812.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4ac8ee3-b98b-500b-a220-115938e6565b/f4ac8ee3-b98b-500b-a220-115938e6565b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/76/207643929fb85c25869d629059c67be8/pa/SC91438_9cd4d7d69b03d7f834179dc36d196bc5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2005}
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC91438%27 HTTP/1.1" 200 None
2026-03-28 18:48:32 [auto1.de] INFO: Saving data for SC91438: {'created_time': 1774723712.680953, 'last_price_update_time': 1774723712.680966, 'auction_closing_time': 1774885291.0}
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC91438') HTTP/1.1" 204 0
2026-03-28 18:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba with identifier: ZT00661
2026-03-28 18:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba with identifier: ZT00661
2026-03-28 18:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba with identifier: ZT00661 to the API
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_bac4579ea9a1bf7fd614baa8157c6c0f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:24:17Z',
 'fuel_type': 'petrol',
 'id': '312f9c5f-5b67-5d37-b8b5-78c56c1b07ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT00661',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 119356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_931de8d5cbd37d5ba723df6cf77d0b0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2779637,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_bac4579ea9a1bf7fd614baa8157c6c0f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_885c953e671bcaed178dc3e2bf814a9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_c32e4789dfafe8c0a93d626ce37f19ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_a6031687f63c70ee7f24765bfb2f30a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_dafaa16d72335fd05a190b3c3bb77723.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_51a5dbc83973a595417c42d03e46709c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_87f7e3e0f36704ffc7413995414ff6e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_90952f056e8dbd85d288ac14a0575e59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312f9c5f-5b67-5d37-b8b5-78c56c1b07ba/312f9c5f-5b67-5d37-b8b5-78c56c1b07ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/21/c3219063b8802a8c2837f9bfde56e4fb/pa/ZT00661_716a79a09b9c713f06663107ce2e31b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 TGDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00661%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Saving data for ZT00661: {'created_time': 1774723713.062657, 'last_price_update_time': 1774723713.062669, 'auction_closing_time': 1774884257.0}
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT00661') HTTP/1.1" 204 0
2026-03-28 18:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83b96697-f0d5-51a2-99bd-a75d924e95ad with identifier: AZ02782
2026-03-28 18:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83b96697-f0d5-51a2-99bd-a75d924e95ad with identifier: AZ02782
2026-03-28 18:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83b96697-f0d5-51a2-99bd-a75d924e95ad with identifier: AZ02782 to the API
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_482e975ed6d402a07244e7668b9ddc82.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:28:57Z',
 'fuel_type': 'petrol',
 'id': '83b96697-f0d5-51a2-99bd-a75d924e95ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ02782',
 'listing': 'auction',
 'location': 'DE, Mönchengladbach',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 221435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b96697-f0d5-51a2-99bd-a75d924e95ad/83b96697-f0d5-51a2-99bd-a75d924e95ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_482e975ed6d402a07244e7668b9ddc82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b96697-f0d5-51a2-99bd-a75d924e95ad/83b96697-f0d5-51a2-99bd-a75d924e95ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_3d770284e59eac4ea27887425aff36c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b96697-f0d5-51a2-99bd-a75d924e95ad/83b96697-f0d5-51a2-99bd-a75d924e95ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_71e8a1b576b560daf1b65670a5bbaf8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b96697-f0d5-51a2-99bd-a75d924e95ad/83b96697-f0d5-51a2-99bd-a75d924e95ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_7915d07ee15ee0d64af1f02153942747.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b96697-f0d5-51a2-99bd-a75d924e95ad/83b96697-f0d5-51a2-99bd-a75d924e95ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4d/104d56e36cab306fd164fb85d99a34f9/pa/AZ02782_3d23e65a14da504e431f315bb702adab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2013}
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ02782%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Saving data for AZ02782: {'created_time': 1774723713.430015, 'last_price_update_time': 1774723713.430027, 'auction_closing_time': 1774884537.0}
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ02782') HTTP/1.1" 204 0
2026-03-28 18:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR44802/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL33602> (referer: https://www.auto1.com/v1/car-details-view/PL33602/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_68876756c05e32dcbcf1cb7980b9dee8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_c698349e93279570c5c0b54b0511be35.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:33 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 6020 | hits on page: 40
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF26983%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for WF26983: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB01809%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for PB01809: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA97993%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for DA97993: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD84103%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for AD84103: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV43592%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for NV43592: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL81843%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for PL81843: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW38185%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for WW38185: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13690%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for UW13690: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW14038%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for CW14038: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS42053%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for HS42053: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY14416%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for PY14416: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM10226%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for DM10226: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE69038%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for EE69038: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA12194%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for PA12194: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13405%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for HZ13405: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05124%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for LU05124: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ50371%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for TJ50371: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA26532%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for PA26532: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY89611%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [auto1.de] INFO: Scrape type for CY89611: 0
2026-03-28 18:48:33 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-28 18:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce9fead6-196c-50bf-ad4f-a3bf19212a9b with identifier: PL33602
2026-03-28 18:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce9fead6-196c-50bf-ad4f-a3bf19212a9b with scrape type 1
2026-03-28 18:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ce9fead6-196c-50bf-ad4f-a3bf19212a9b
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd6%252Fabd630eb86c3e0d0cc4fef60f9b045fb%252Fpa%252FPL33602_8425f764ec5ed5c880ccd514a9dc9d89.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_8425f764ec5ed5c880ccd514a9dc9d89.jpg not downloaded yet
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd6%252Fabd630eb86c3e0d0cc4fef60f9b045fb%252Fpa%252FPL33602_871d73ffa382c98dfb3326e109087864.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_871d73ffa382c98dfb3326e109087864.jpg not downloaded yet
2026-03-28 18:48:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a6510>
2026-03-28 18:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_68876756c05e32dcbcf1cb7980b9dee8.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_68876756c05e32dcbcf1cb7980b9dee8.jpg saved to cache
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1
2026-03-28 18:48:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24582a67d0>
2026-03-28 18:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F7c%252Fb67c1945ab32f1b335836789412f8963%252Fpa%252FYD24318_c698349e93279570c5c0b54b0511be35.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_c698349e93279570c5c0b54b0511be35.jpg saved to cache
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1
2026-03-28 18:48:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ed97780-76bd-5aed-92fe-9ef5de9494f1, skipping ID generation
2026-03-28 18:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1 with scrape type 1
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1 sending to next pipeline
2026-03-28 18:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ed97780-76bd-5aed-92fe-9ef5de9494f1, identifier: YD24318
2026-03-28 18:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ed97780-76bd-5aed-92fe-9ef5de9494f1 with identifier: YD24318
2026-03-28 18:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ed97780-76bd-5aed-92fe-9ef5de9494f1 with identifier: YD24318
2026-03-28 18:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ed97780-76bd-5aed-92fe-9ef5de9494f1 with identifier: YD24318 to the API
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_c698349e93279570c5c0b54b0511be35.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:07:28Z',
 'fuel_type': 'diesel',
 'id': '0ed97780-76bd-5aed-92fe-9ef5de9494f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD24318',
 'listing': 'auction',
 'location': 'DE, Krefeld',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 112984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977789,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_c698349e93279570c5c0b54b0511be35.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2769200,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_68876756c05e32dcbcf1cb7980b9dee8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_bef4ffd2be923bf31997b7fc693a9e2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_5f5aa3afca809c1ca83b526f48ce367a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_08e613b87f84a1bc7588a88c9e1ddfa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_dbefca3df527fd8ae7515ca5e99fb3c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2843449,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_534a3de68ef363409d4c9cd29ca6f9f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_96acdd7ede441c8d9063b2de25ae3672.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2927625,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_78d23719d43a3d0febcb3a981c8dfa47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ed97780-76bd-5aed-92fe-9ef5de9494f1/0ed97780-76bd-5aed-92fe-9ef5de9494f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3022253,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/7c/b67c1945ab32f1b335836789412f8963/pa/YD24318_816530c5efcba62e723a18e7b86b2706.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 111 CDI lang Tourer Edition',
 'transmission': 'manual',
 'trim': 'lang Tourer Edition',
 'year': 2020}
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD24318%27 HTTP/1.1" 200 None
2026-03-28 18:48:34 [auto1.de] INFO: Saving data for YD24318: {'created_time': 1774723714.616011, 'last_price_update_time': 1774723714.616027, 'auction_closing_time': 1774883248.0}
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD24318') HTTP/1.1" 204 0
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd6%252Fabd630eb86c3e0d0cc4fef60f9b045fb%252Fpa%252FPL33602_ec9e652177331bc4431a2d5a5bd47c4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_ec9e652177331bc4431a2d5a5bd47c4c.jpg not downloaded yet
2026-03-28 18:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF19813> (referer: https://www.auto1.com/v1/car-details-view/AF19813/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV41751/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd6%252Fabd630eb86c3e0d0cc4fef60f9b045fb%252Fpa%252FPL33602_cc829c6f0e0fd04bafeaf07d6fc2320b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_cc829c6f0e0fd04bafeaf07d6fc2320b.jpg not downloaded yet
2026-03-28 18:48:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd6%252Fabd630eb86c3e0d0cc4fef60f9b045fb%252Fpa%252FPL33602_92a932c9549769ace7e1a0766566aa77.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_92a932c9549769ace7e1a0766566aa77.jpg not downloaded yet
2026-03-28 18:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT45397/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_8425f764ec5ed5c880ccd514a9dc9d89.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_ec9e652177331bc4431a2d5a5bd47c4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e1fd07-8e0f-5629-b1a7-33b7d4aeede4 with identifier: AF19813
2026-03-28 18:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e1fd07-8e0f-5629-b1a7-33b7d4aeede4 with scrape type 1
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41e1fd07-8e0f-5629-b1a7-33b7d4aeede4
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F4c%252Fed4c84813eab6e823e4a4486acdd1ddc%252Fpa%252FAF19813_5875504857c6b0185831be45a28c79d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_5875504857c6b0185831be45a28c79d6.jpg already downloaded
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F4c%252Fed4c84813eab6e823e4a4486acdd1ddc%252Fpa%252FAF19813_6add5e978269ddf85d97f101510c80a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_6add5e978269ddf85d97f101510c80a6.jpg already downloaded
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F4c%252Fed4c84813eab6e823e4a4486acdd1ddc%252Fpa%252FAF19813_823c6844a3b2e7c24d4e7a154ff270cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_823c6844a3b2e7c24d4e7a154ff270cf.jpg already downloaded
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F4c%252Fed4c84813eab6e823e4a4486acdd1ddc%252Fpa%252FAF19813_fd43f298a52d11eef592cfc842097473.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_fd43f298a52d11eef592cfc842097473.jpg already downloaded
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F4c%252Fed4c84813eab6e823e4a4486acdd1ddc%252Fpa%252FAF19813_63899d2667095ec1b2cf3ac8d2f41c40.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_63899d2667095ec1b2cf3ac8d2f41c40.jpg already downloaded
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F4c%252Fed4c84813eab6e823e4a4486acdd1ddc%252Fpa%252FAF19813_d6e0b5e00cf6e36fa2c69c64461d962d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_d6e0b5e00cf6e36fa2c69c64461d962d.jpg already downloaded
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F4c%252Fed4c84813eab6e823e4a4486acdd1ddc%252Fpa%252FAF19813_d125e034515063b58a875092d00b095c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_d125e034515063b58a875092d00b095c.jpg already downloaded
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F4c%252Fed4c84813eab6e823e4a4486acdd1ddc%252Fpa%252FAF19813_aec5da09f3ac72857657d9da48331ea4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_aec5da09f3ac72857657d9da48331ea4.jpg already downloaded
2026-03-28 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F4c%252Fed4c84813eab6e823e4a4486acdd1ddc%252Fpa%252FAF19813_c2736942fa86cec164b0dc31724b5b1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_c2736942fa86cec164b0dc31724b5b1f.jpg already downloaded
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F4c%252Fed4c84813eab6e823e4a4486acdd1ddc%252Fpa%252FAF19813_d552ab188b87fa5b36148e5528d4bff9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_d552ab188b87fa5b36148e5528d4bff9.jpg already downloaded
2026-03-28 18:48:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41e1fd07-8e0f-5629-b1a7-33b7d4aeede4, identifier: AF19813
2026-03-28 18:48:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41e1fd07-8e0f-5629-b1a7-33b7d4aeede4 with identifier: AF19813
2026-03-28 18:48:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41e1fd07-8e0f-5629-b1a7-33b7d4aeede4 with identifier: AF19813
2026-03-28 18:48:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41e1fd07-8e0f-5629-b1a7-33b7d4aeede4 with identifier: AF19813 to the API
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AF19813>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:58:51Z',
 'fuel_type': 'diesel',
 'id': '41e1fd07-8e0f-5629-b1a7-33b7d4aeede4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF19813',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 114399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_5875504857c6b0185831be45a28c79d6.jpg',
                'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_6add5e978269ddf85d97f101510c80a6.jpg',
                'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_823c6844a3b2e7c24d4e7a154ff270cf.jpg',
                'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_fd43f298a52d11eef592cfc842097473.jpg',
                'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_63899d2667095ec1b2cf3ac8d2f41c40.jpg',
                'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_d6e0b5e00cf6e36fa2c69c64461d962d.jpg',
                'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_d125e034515063b58a875092d00b095c.jpg',
                'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_aec5da09f3ac72857657d9da48331ea4.jpg',
                'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_c2736942fa86cec164b0dc31724b5b1f.jpg',
                'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_d552ab188b87fa5b36148e5528d4bff9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e1fd07-8e0f-5629-b1a7-33b7d4aeede4/41e1fd07-8e0f-5629-b1a7-33b7d4aeede4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_5875504857c6b0185831be45a28c79d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e1fd07-8e0f-5629-b1a7-33b7d4aeede4/41e1fd07-8e0f-5629-b1a7-33b7d4aeede4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_6add5e978269ddf85d97f101510c80a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e1fd07-8e0f-5629-b1a7-33b7d4aeede4/41e1fd07-8e0f-5629-b1a7-33b7d4aeede4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_823c6844a3b2e7c24d4e7a154ff270cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e1fd07-8e0f-5629-b1a7-33b7d4aeede4/41e1fd07-8e0f-5629-b1a7-33b7d4aeede4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_fd43f298a52d11eef592cfc842097473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e1fd07-8e0f-5629-b1a7-33b7d4aeede4/41e1fd07-8e0f-5629-b1a7-33b7d4aeede4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_63899d2667095ec1b2cf3ac8d2f41c40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e1fd07-8e0f-5629-b1a7-33b7d4aeede4/41e1fd07-8e0f-5629-b1a7-33b7d4aeede4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_d6e0b5e00cf6e36fa2c69c64461d962d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e1fd07-8e0f-5629-b1a7-33b7d4aeede4/41e1fd07-8e0f-5629-b1a7-33b7d4aeede4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_d125e034515063b58a875092d00b095c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e1fd07-8e0f-5629-b1a7-33b7d4aeede4/41e1fd07-8e0f-5629-b1a7-33b7d4aeede4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_aec5da09f3ac72857657d9da48331ea4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e1fd07-8e0f-5629-b1a7-33b7d4aeede4/41e1fd07-8e0f-5629-b1a7-33b7d4aeede4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_c2736942fa86cec164b0dc31724b5b1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e1fd07-8e0f-5629-b1a7-33b7d4aeede4/41e1fd07-8e0f-5629-b1a7-33b7d4aeede4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/4c/ed4c84813eab6e823e4a4486acdd1ddc/pa/AF19813_d552ab188b87fa5b36148e5528d4bff9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Beach Edition 4Motion',
 'transmission': 'automatic',
 'trim': 'Beach Edition 4Motion',
 'year': 2016}
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF19813%27 HTTP/1.1" 200 None
2026-03-28 18:48:35 [auto1.de] INFO: Saving data for AF19813: {'created_time': 1774723715.449553, 'last_price_update_time': 1774723715.449564, 'auction_closing_time': 1774886331.0}
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF19813') HTTP/1.1" 204 0
2026-03-28 18:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_92a932c9549769ace7e1a0766566aa77.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_871d73ffa382c98dfb3326e109087864.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_cc829c6f0e0fd04bafeaf07d6fc2320b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456158f90>
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce9fead6-196c-50bf-ad4f-a3bf19212a9b/ce9fead6-196c-50bf-ad4f-a3bf19212a9b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd6%252Fabd630eb86c3e0d0cc4fef60f9b045fb%252Fpa%252FPL33602_8425f764ec5ed5c880ccd514a9dc9d89.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_8425f764ec5ed5c880ccd514a9dc9d89.jpg saved to cache
2026-03-28 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce9fead6-196c-50bf-ad4f-a3bf19212a9b
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561e7b90>
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce9fead6-196c-50bf-ad4f-a3bf19212a9b/ce9fead6-196c-50bf-ad4f-a3bf19212a9b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd6%252Fabd630eb86c3e0d0cc4fef60f9b045fb%252Fpa%252FPL33602_ec9e652177331bc4431a2d5a5bd47c4c.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_ec9e652177331bc4431a2d5a5bd47c4c.jpg saved to cache
2026-03-28 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce9fead6-196c-50bf-ad4f-a3bf19212a9b
2026-03-28 18:48:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456343950>
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce9fead6-196c-50bf-ad4f-a3bf19212a9b/ce9fead6-196c-50bf-ad4f-a3bf19212a9b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd6%252Fabd630eb86c3e0d0cc4fef60f9b045fb%252Fpa%252FPL33602_92a932c9549769ace7e1a0766566aa77.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_92a932c9549769ace7e1a0766566aa77.jpg saved to cache
2026-03-28 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce9fead6-196c-50bf-ad4f-a3bf19212a9b
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24563e8810>
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce9fead6-196c-50bf-ad4f-a3bf19212a9b/ce9fead6-196c-50bf-ad4f-a3bf19212a9b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd6%252Fabd630eb86c3e0d0cc4fef60f9b045fb%252Fpa%252FPL33602_871d73ffa382c98dfb3326e109087864.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_871d73ffa382c98dfb3326e109087864.jpg saved to cache
2026-03-28 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce9fead6-196c-50bf-ad4f-a3bf19212a9b
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456320f10>
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce9fead6-196c-50bf-ad4f-a3bf19212a9b/ce9fead6-196c-50bf-ad4f-a3bf19212a9b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fd6%252Fabd630eb86c3e0d0cc4fef60f9b045fb%252Fpa%252FPL33602_cc829c6f0e0fd04bafeaf07d6fc2320b.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_cc829c6f0e0fd04bafeaf07d6fc2320b.jpg saved to cache
2026-03-28 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce9fead6-196c-50bf-ad4f-a3bf19212a9b
2026-03-28 18:48:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce9fead6-196c-50bf-ad4f-a3bf19212a9b, skipping ID generation
2026-03-28 18:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce9fead6-196c-50bf-ad4f-a3bf19212a9b with scrape type 1
2026-03-28 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce9fead6-196c-50bf-ad4f-a3bf19212a9b sending to next pipeline
2026-03-28 18:48:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce9fead6-196c-50bf-ad4f-a3bf19212a9b, identifier: PL33602
2026-03-28 18:48:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce9fead6-196c-50bf-ad4f-a3bf19212a9b with identifier: PL33602
2026-03-28 18:48:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce9fead6-196c-50bf-ad4f-a3bf19212a9b with identifier: PL33602
2026-03-28 18:48:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce9fead6-196c-50bf-ad4f-a3bf19212a9b with identifier: PL33602 to the API
2026-03-28 18:48:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_cc829c6f0e0fd04bafeaf07d6fc2320b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 283,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:40:41Z',
 'fuel_type': 'diesel',
 'id': 'ce9fead6-196c-50bf-ad4f-a3bf19212a9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL33602',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 379367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce9fead6-196c-50bf-ad4f-a3bf19212a9b/ce9fead6-196c-50bf-ad4f-a3bf19212a9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_8425f764ec5ed5c880ccd514a9dc9d89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce9fead6-196c-50bf-ad4f-a3bf19212a9b/ce9fead6-196c-50bf-ad4f-a3bf19212a9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_871d73ffa382c98dfb3326e109087864.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce9fead6-196c-50bf-ad4f-a3bf19212a9b/ce9fead6-196c-50bf-ad4f-a3bf19212a9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_ec9e652177331bc4431a2d5a5bd47c4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce9fead6-196c-50bf-ad4f-a3bf19212a9b/ce9fead6-196c-50bf-ad4f-a3bf19212a9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_cc829c6f0e0fd04bafeaf07d6fc2320b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce9fead6-196c-50bf-ad4f-a3bf19212a9b/ce9fead6-196c-50bf-ad4f-a3bf19212a9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/d6/abd630eb86c3e0d0cc4fef60f9b045fb/pa/PL33602_92a932c9549769ace7e1a0766566aa77.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL33602%27 HTTP/1.1" 200 None
2026-03-28 18:48:36 [auto1.de] INFO: Saving data for PL33602: {'created_time': 1774723716.227619, 'last_price_update_time': 1774723716.227631, 'auction_closing_time': 1774885241.0}
2026-03-28 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL33602') HTTP/1.1" 204 0
2026-03-28 18:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL96080/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR44802> (referer: https://www.auto1.com/v1/car-details-view/PR44802/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:37 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 6020 | hits on page: 40
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV90621%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for DV90621: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG97842%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for AG97842: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA95104%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for LA95104: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX44847%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for LX44847: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG20866%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for GG20866: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY65265%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for WY65265: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV78416%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for RV78416: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB67844%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for GB67844: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ08958%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for GJ08958: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD45339%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for ZD45339: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU26829%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for BU26829: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL74029%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for UL74029: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41650%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for MF41650: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71817%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for NV71817: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG89658%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for TG89658: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA70819%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for GA70819: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW55074%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for BW55074: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE90423%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for XE90423: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK80695%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for SK80695: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72554%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for XV72554: 0
2026-03-28 18:48:37 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU93693%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [auto1.de] INFO: Scrape type for DU93693: 0
2026-03-28 18:48:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b18cf49-041a-5c48-89bc-9b5a0db4388f with identifier: PR44802
2026-03-28 18:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f with scrape type 1
2026-03-28 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_7256853428f122faa61359157793338b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_7256853428f122faa61359157793338b.jpg not downloaded yet
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_8db20b689728d31c02e61ced4f7aa606.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_8db20b689728d31c02e61ced4f7aa606.jpg not downloaded yet
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_f48b1e7bab28693e0a491ee9c22ea000.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_f48b1e7bab28693e0a491ee9c22ea000.jpg not downloaded yet
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_11f53b31646ef6e7b1be20b5953979b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_11f53b31646ef6e7b1be20b5953979b6.jpg not downloaded yet
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_1055d5b0df8e0814351a2b6136a5800f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_1055d5b0df8e0814351a2b6136a5800f.jpg not downloaded yet
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_89a021b83a15dd630fa967d35be0251f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_89a021b83a15dd630fa967d35be0251f.jpg not downloaded yet
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_d24cd0b1f3e9d83c3bdd61a7b7a74647.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_d24cd0b1f3e9d83c3bdd61a7b7a74647.jpg not downloaded yet
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_41fe7a896d7cc6a36279face3e922058.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_41fe7a896d7cc6a36279face3e922058.jpg not downloaded yet
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_10735422555d9b1cad47e0028f01fcfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_10735422555d9b1cad47e0028f01fcfd.jpg not downloaded yet
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_aad83b2f1b1d13ba3ea76d046978f6fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_aad83b2f1b1d13ba3ea76d046978f6fc.jpg not downloaded yet
2026-03-28 18:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_8db20b689728d31c02e61ced4f7aa606.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_11f53b31646ef6e7b1be20b5953979b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_89a021b83a15dd630fa967d35be0251f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546a4150>
2026-03-28 18:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_8db20b689728d31c02e61ced4f7aa606.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_8db20b689728d31c02e61ced4f7aa606.jpg saved to cache
2026-03-28 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f
2026-03-28 18:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_d24cd0b1f3e9d83c3bdd61a7b7a74647.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_41fe7a896d7cc6a36279face3e922058.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24565370d0>
2026-03-28 18:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_11f53b31646ef6e7b1be20b5953979b6.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_11f53b31646ef6e7b1be20b5953979b6.jpg saved to cache
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f
2026-03-28 18:48:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245608fd10>
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_89a021b83a15dd630fa967d35be0251f.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_89a021b83a15dd630fa967d35be0251f.jpg saved to cache
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f
2026-03-28 18:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_7256853428f122faa61359157793338b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546a3b90>
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_d24cd0b1f3e9d83c3bdd61a7b7a74647.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_d24cd0b1f3e9d83c3bdd61a7b7a74647.jpg saved to cache
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546a6010>
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_41fe7a896d7cc6a36279face3e922058.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_41fe7a896d7cc6a36279face3e922058.jpg saved to cache
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f
2026-03-28 18:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_10735422555d9b1cad47e0028f01fcfd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_1055d5b0df8e0814351a2b6136a5800f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_aad83b2f1b1d13ba3ea76d046978f6fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_f48b1e7bab28693e0a491ee9c22ea000.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456111a10>
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_7256853428f122faa61359157793338b.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_7256853428f122faa61359157793338b.jpg saved to cache
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f
2026-03-28 18:48:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562f67d0>
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_10735422555d9b1cad47e0028f01fcfd.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_10735422555d9b1cad47e0028f01fcfd.jpg saved to cache
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f
2026-03-28 18:48:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245638fd50>
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_1055d5b0df8e0814351a2b6136a5800f.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_1055d5b0df8e0814351a2b6136a5800f.jpg saved to cache
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f
2026-03-28 18:48:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245832d810>
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_aad83b2f1b1d13ba3ea76d046978f6fc.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_aad83b2f1b1d13ba3ea76d046978f6fc.jpg saved to cache
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f
2026-03-28 18:48:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24560a6250>
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F6b%252Fee6b49f06701987b9311c0f224f9f9c1%252Fpa%252FPR44802_f48b1e7bab28693e0a491ee9c22ea000.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_f48b1e7bab28693e0a491ee9c22ea000.jpg saved to cache
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f
2026-03-28 18:48:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b18cf49-041a-5c48-89bc-9b5a0db4388f, skipping ID generation
2026-03-28 18:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f with scrape type 1
2026-03-28 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f sending to next pipeline
2026-03-28 18:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b18cf49-041a-5c48-89bc-9b5a0db4388f, identifier: PR44802
2026-03-28 18:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL96080> (referer: https://www.auto1.com/v1/car-details-view/EL96080/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b18cf49-041a-5c48-89bc-9b5a0db4388f with identifier: PR44802
2026-03-28 18:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b18cf49-041a-5c48-89bc-9b5a0db4388f with identifier: PR44802
2026-03-28 18:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b18cf49-041a-5c48-89bc-9b5a0db4388f with identifier: PR44802 to the API
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_f48b1e7bab28693e0a491ee9c22ea000.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:50:18Z',
 'fuel_type': 'petrol',
 'id': '6b18cf49-041a-5c48-89bc-9b5a0db4388f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR44802',
 'listing': 'auction',
 'location': 'DE, Mülheim\xad-Kärlich',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 151429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2961878,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_7256853428f122faa61359157793338b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2902768,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_8db20b689728d31c02e61ced4f7aa606.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3181602,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_f48b1e7bab28693e0a491ee9c22ea000.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2997620,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_11f53b31646ef6e7b1be20b5953979b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2913872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_1055d5b0df8e0814351a2b6136a5800f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3085984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_89a021b83a15dd630fa967d35be0251f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_d24cd0b1f3e9d83c3bdd61a7b7a74647.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_41fe7a896d7cc6a36279face3e922058.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2777427,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_10735422555d9b1cad47e0028f01fcfd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b18cf49-041a-5c48-89bc-9b5a0db4388f/6b18cf49-041a-5c48-89bc-9b5a0db4388f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2891452,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/6b/ee6b49f06701987b9311c0f224f9f9c1/pa/PR44802_aad83b2f1b1d13ba3ea76d046978f6fc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Style Salsa',
 'transmission': 'manual',
 'trim': 'Style Salsa',
 'year': 2014}
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR44802%27 HTTP/1.1" 200 None
2026-03-28 18:48:39 [auto1.de] INFO: Saving data for PR44802: {'created_time': 1774723719.389118, 'last_price_update_time': 1774723719.38913, 'auction_closing_time': 1774885818.0}
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR44802') HTTP/1.1" 204 0
2026-03-28 18:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c18172c-ad6a-5a62-ac66-8935478b7cbf with identifier: EL96080
2026-03-28 18:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c18172c-ad6a-5a62-ac66-8935478b7cbf with scrape type 1
2026-03-28 18:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c18172c-ad6a-5a62-ac66-8935478b7cbf
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223726080d8a06eeac7be1ef453d53%252Fpa%252FEL96080_249008c90f04a9836dc6be11f96e5633.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_249008c90f04a9836dc6be11f96e5633.jpg already downloaded
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223726080d8a06eeac7be1ef453d53%252Fpa%252FEL96080_2afb1d4cd0b426ebeebe483f77eb0dcd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_2afb1d4cd0b426ebeebe483f77eb0dcd.jpg already downloaded
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223726080d8a06eeac7be1ef453d53%252Fpa%252FEL96080_773201f68a794e846bac02262ec83661.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_773201f68a794e846bac02262ec83661.jpg already downloaded
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223726080d8a06eeac7be1ef453d53%252Fpa%252FEL96080_a733da2f66e7a228ac73e4273c8068f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_a733da2f66e7a228ac73e4273c8068f0.jpg already downloaded
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223726080d8a06eeac7be1ef453d53%252Fpa%252FEL96080_f908b946e3871975106fea3c86b6b398.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_f908b946e3871975106fea3c86b6b398.jpg already downloaded
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223726080d8a06eeac7be1ef453d53%252Fpa%252FEL96080_6d9e084fdaa84efe80bd1a69864d9c2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_6d9e084fdaa84efe80bd1a69864d9c2e.jpg already downloaded
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223726080d8a06eeac7be1ef453d53%252Fpa%252FEL96080_064c2856251561989357b738dd526f41.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_064c2856251561989357b738dd526f41.jpg already downloaded
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223726080d8a06eeac7be1ef453d53%252Fpa%252FEL96080_552a50ed4b69a7bf2f23285d4e5c3120.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_552a50ed4b69a7bf2f23285d4e5c3120.jpg already downloaded
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223726080d8a06eeac7be1ef453d53%252Fpa%252FEL96080_2f9e21574d7f51a91f0f312d98ea7774.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_2f9e21574d7f51a91f0f312d98ea7774.jpg already downloaded
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F22%252Ff8223726080d8a06eeac7be1ef453d53%252Fpa%252FEL96080_6e10ad4c561e39eecf4403d4f3a00574.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_6e10ad4c561e39eecf4403d4f3a00574.jpg already downloaded
2026-03-28 18:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c18172c-ad6a-5a62-ac66-8935478b7cbf, identifier: EL96080
2026-03-28 18:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c18172c-ad6a-5a62-ac66-8935478b7cbf with identifier: EL96080
2026-03-28 18:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c18172c-ad6a-5a62-ac66-8935478b7cbf with identifier: EL96080
2026-03-28 18:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c18172c-ad6a-5a62-ac66-8935478b7cbf with identifier: EL96080 to the API
2026-03-28 18:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EL96080>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:15:09Z',
 'fuel_type': 'diesel',
 'id': '4c18172c-ad6a-5a62-ac66-8935478b7cbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL96080',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 122072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_249008c90f04a9836dc6be11f96e5633.jpg',
                'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_2afb1d4cd0b426ebeebe483f77eb0dcd.jpg',
                'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_773201f68a794e846bac02262ec83661.jpg',
                'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_a733da2f66e7a228ac73e4273c8068f0.jpg',
                'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_f908b946e3871975106fea3c86b6b398.jpg',
                'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_6d9e084fdaa84efe80bd1a69864d9c2e.jpg',
                'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_064c2856251561989357b738dd526f41.jpg',
                'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_552a50ed4b69a7bf2f23285d4e5c3120.jpg',
                'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_2f9e21574d7f51a91f0f312d98ea7774.jpg',
                'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_6e10ad4c561e39eecf4403d4f3a00574.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c18172c-ad6a-5a62-ac66-8935478b7cbf/4c18172c-ad6a-5a62-ac66-8935478b7cbf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_249008c90f04a9836dc6be11f96e5633.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c18172c-ad6a-5a62-ac66-8935478b7cbf/4c18172c-ad6a-5a62-ac66-8935478b7cbf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_2afb1d4cd0b426ebeebe483f77eb0dcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c18172c-ad6a-5a62-ac66-8935478b7cbf/4c18172c-ad6a-5a62-ac66-8935478b7cbf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2641611,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_773201f68a794e846bac02262ec83661.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c18172c-ad6a-5a62-ac66-8935478b7cbf/4c18172c-ad6a-5a62-ac66-8935478b7cbf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2627552,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_a733da2f66e7a228ac73e4273c8068f0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c18172c-ad6a-5a62-ac66-8935478b7cbf/4c18172c-ad6a-5a62-ac66-8935478b7cbf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2560537,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_f908b946e3871975106fea3c86b6b398.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c18172c-ad6a-5a62-ac66-8935478b7cbf/4c18172c-ad6a-5a62-ac66-8935478b7cbf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_6d9e084fdaa84efe80bd1a69864d9c2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c18172c-ad6a-5a62-ac66-8935478b7cbf/4c18172c-ad6a-5a62-ac66-8935478b7cbf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2299474,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_064c2856251561989357b738dd526f41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c18172c-ad6a-5a62-ac66-8935478b7cbf/4c18172c-ad6a-5a62-ac66-8935478b7cbf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2709122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_552a50ed4b69a7bf2f23285d4e5c3120.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c18172c-ad6a-5a62-ac66-8935478b7cbf/4c18172c-ad6a-5a62-ac66-8935478b7cbf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_2f9e21574d7f51a91f0f312d98ea7774.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c18172c-ad6a-5a62-ac66-8935478b7cbf/4c18172c-ad6a-5a62-ac66-8935478b7cbf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/22/f8223726080d8a06eeac7be1ef453d53/pa/EL96080_6e10ad4c561e39eecf4403d4f3a00574.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2015}
2026-03-28 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL96080%27 HTTP/1.1" 200 None
2026-03-28 18:48:40 [auto1.de] INFO: Saving data for EL96080: {'created_time': 1774723720.140808, 'last_price_update_time': 1774723720.140823, 'auction_closing_time': 1774883709.0}
2026-03-28 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL96080') HTTP/1.1" 204 0
2026-03-28 18:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT45397> (referer: https://www.auto1.com/v1/car-details-view/CT45397/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0b2b446-fdd4-5297-ba3f-3bf516b0857e with identifier: CT45397
2026-03-28 18:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0b2b446-fdd4-5297-ba3f-3bf516b0857e with scrape type 1
2026-03-28 18:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f0b2b446-fdd4-5297-ba3f-3bf516b0857e
2026-03-28 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F23%252F02233dc7e58fd0460094e1b2ed6c7865%252Fpa%252FCT45397_f96dcd87805edc31726ba0246d4489bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_f96dcd87805edc31726ba0246d4489bf.jpg not downloaded yet
2026-03-28 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F23%252F02233dc7e58fd0460094e1b2ed6c7865%252Fpa%252FCT45397_c5c75b8a6534d0028d7a08373b63861d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_c5c75b8a6534d0028d7a08373b63861d.jpg not downloaded yet
2026-03-28 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F23%252F02233dc7e58fd0460094e1b2ed6c7865%252Fpa%252FCT45397_ee4777dd962d5c4a28c43916c37dc4ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_ee4777dd962d5c4a28c43916c37dc4ca.jpg not downloaded yet
2026-03-28 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F23%252F02233dc7e58fd0460094e1b2ed6c7865%252Fpa%252FCT45397_d1949d48f18934d62abba883e842c6b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_d1949d48f18934d62abba883e842c6b3.jpg not downloaded yet
2026-03-28 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F23%252F02233dc7e58fd0460094e1b2ed6c7865%252Fpa%252FCT45397_209bb3b965db93862794fea232023e1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_209bb3b965db93862794fea232023e1b.jpg not downloaded yet
2026-03-28 18:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_f96dcd87805edc31726ba0246d4489bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_209bb3b965db93862794fea232023e1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_d1949d48f18934d62abba883e842c6b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456286b90>
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b2b446-fdd4-5297-ba3f-3bf516b0857e/f0b2b446-fdd4-5297-ba3f-3bf516b0857e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F23%252F02233dc7e58fd0460094e1b2ed6c7865%252Fpa%252FCT45397_f96dcd87805edc31726ba0246d4489bf.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_f96dcd87805edc31726ba0246d4489bf.jpg saved to cache
2026-03-28 18:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0b2b446-fdd4-5297-ba3f-3bf516b0857e
2026-03-28 18:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_c5c75b8a6534d0028d7a08373b63861d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245605f290>
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b2b446-fdd4-5297-ba3f-3bf516b0857e/f0b2b446-fdd4-5297-ba3f-3bf516b0857e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F23%252F02233dc7e58fd0460094e1b2ed6c7865%252Fpa%252FCT45397_209bb3b965db93862794fea232023e1b.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_209bb3b965db93862794fea232023e1b.jpg saved to cache
2026-03-28 18:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0b2b446-fdd4-5297-ba3f-3bf516b0857e
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456320750>
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b2b446-fdd4-5297-ba3f-3bf516b0857e/f0b2b446-fdd4-5297-ba3f-3bf516b0857e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F23%252F02233dc7e58fd0460094e1b2ed6c7865%252Fpa%252FCT45397_d1949d48f18934d62abba883e842c6b3.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_d1949d48f18934d62abba883e842c6b3.jpg saved to cache
2026-03-28 18:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0b2b446-fdd4-5297-ba3f-3bf516b0857e
2026-03-28 18:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_ee4777dd962d5c4a28c43916c37dc4ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561db5d0>
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b2b446-fdd4-5297-ba3f-3bf516b0857e/f0b2b446-fdd4-5297-ba3f-3bf516b0857e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F23%252F02233dc7e58fd0460094e1b2ed6c7865%252Fpa%252FCT45397_c5c75b8a6534d0028d7a08373b63861d.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_c5c75b8a6534d0028d7a08373b63861d.jpg saved to cache
2026-03-28 18:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f0b2b446-fdd4-5297-ba3f-3bf516b0857e
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24561efe50>
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b2b446-fdd4-5297-ba3f-3bf516b0857e/f0b2b446-fdd4-5297-ba3f-3bf516b0857e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F23%252F02233dc7e58fd0460094e1b2ed6c7865%252Fpa%252FCT45397_ee4777dd962d5c4a28c43916c37dc4ca.jpg') HTTP/1.1" 204 0
2026-03-28 18:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_ee4777dd962d5c4a28c43916c37dc4ca.jpg saved to cache
2026-03-28 18:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0b2b446-fdd4-5297-ba3f-3bf516b0857e
2026-03-28 18:48:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0b2b446-fdd4-5297-ba3f-3bf516b0857e, skipping ID generation
2026-03-28 18:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0b2b446-fdd4-5297-ba3f-3bf516b0857e with scrape type 1
2026-03-28 18:48:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0b2b446-fdd4-5297-ba3f-3bf516b0857e sending to next pipeline
2026-03-28 18:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0b2b446-fdd4-5297-ba3f-3bf516b0857e, identifier: CT45397
2026-03-28 18:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0b2b446-fdd4-5297-ba3f-3bf516b0857e with identifier: CT45397
2026-03-28 18:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0b2b446-fdd4-5297-ba3f-3bf516b0857e with identifier: CT45397
2026-03-28 18:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0b2b446-fdd4-5297-ba3f-3bf516b0857e with identifier: CT45397 to the API
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_ee4777dd962d5c4a28c43916c37dc4ca.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 2',
 'engine': '1.7L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:07:20Z',
 'fuel_type': 'petrol',
 'id': 'f0b2b446-fdd4-5297-ba3f-3bf516b0857e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT45397',
 'listing': 'auction',
 'location': 'DE, Kumhausen',
 'make': 'Fiat',
 'model': 'Barchetta',
 'odometer': 114978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b2b446-fdd4-5297-ba3f-3bf516b0857e/f0b2b446-fdd4-5297-ba3f-3bf516b0857e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_f96dcd87805edc31726ba0246d4489bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b2b446-fdd4-5297-ba3f-3bf516b0857e/f0b2b446-fdd4-5297-ba3f-3bf516b0857e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_c5c75b8a6534d0028d7a08373b63861d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b2b446-fdd4-5297-ba3f-3bf516b0857e/f0b2b446-fdd4-5297-ba3f-3bf516b0857e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_ee4777dd962d5c4a28c43916c37dc4ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b2b446-fdd4-5297-ba3f-3bf516b0857e/f0b2b446-fdd4-5297-ba3f-3bf516b0857e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_d1949d48f18934d62abba883e842c6b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b2b446-fdd4-5297-ba3f-3bf516b0857e/f0b2b446-fdd4-5297-ba3f-3bf516b0857e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/23/02233dc7e58fd0460094e1b2ed6c7865/pa/CT45397_209bb3b965db93862794fea232023e1b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-03-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat Barchetta 1.8 Lido',
 'transmission': 'manual',
 'trim': 'Lido',
 'year': 2000}
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT45397%27 HTTP/1.1" 200 None
2026-03-28 18:48:43 [auto1.de] INFO: Saving data for CT45397: {'created_time': 1774723723.83138, 'last_price_update_time': 1774723723.831392, 'auction_closing_time': 1774883240.0}
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT45397') HTTP/1.1" 204 0
2026-03-28 18:48:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:45 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 6021 | hits on page: 40
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU93693%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for DU93693: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG68419%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for RG68419: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE45887%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for NE45887: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ98908%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for VZ98908: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH58500%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for BH58500: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN47599%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for FN47599: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS16399%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for JS16399: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP40190%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for JP40190: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN77870%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for JN77870: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR31578%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for LR31578: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33816%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for KV33816: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV90577%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for MV90577: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF55649%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for DF55649: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED71538%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for ED71538: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ47645%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for PJ47645: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT04321%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for UT04321: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF72133%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for DF72133: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL77282%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for RL77282: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC99241%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for NC99241: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW14341%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for YW14341: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94546%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for WB94546: 0
2026-03-28 18:48:45 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV05660%27 HTTP/1.1" 200 None
2026-03-28 18:48:45 [auto1.de] INFO: Scrape type for LV05660: 0
2026-03-28 18:48:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:49 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 6021 | hits on page: 40
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ37250%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for UJ37250: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF02767%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for BF02767: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00661%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for HX00661: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC95289%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for RC95289: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96927%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for GE96927: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL36309%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for XL36309: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM75567%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for FM75567: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU93300%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for TU93300: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH00876%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for SH00876: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44580%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for AG44580: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP91666%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for RP91666: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS46144%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for YS46144: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE92832%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for BE92832: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63274%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for TN63274: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ75751%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for BJ75751: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT80456%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for ZT80456: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67413%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for VY67413: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69209%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for HB69209: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF17035%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for GF17035: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV63958%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for ZV63958: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG24913%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for VG24913: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE04045%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for XE04045: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV81203%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for UV81203: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK48222%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for FK48222: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90826%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for KE90826: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN93715%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for MN93715: 0
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: YJ19312
2026-03-28 18:48:49 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68769%27 HTTP/1.1" 200 None
2026-03-28 18:48:49 [auto1.de] INFO: Scrape type for BS68769: 0
2026-03-28 18:48:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:50 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 6021 | hits on page: 40
2026-03-28 18:48:50 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-28 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ34502%27 HTTP/1.1" 200 None
2026-03-28 18:48:50 [auto1.de] INFO: Scrape type for LJ34502: 2
2026-03-28 18:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a355cc45-b00a-515e-9827-996bbf42d84a with identifier: LJ34502
2026-03-28 18:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a355cc45-b00a-515e-9827-996bbf42d84a with scrape type 2
2026-03-28 18:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a355cc45-b00a-515e-9827-996bbf42d84a with scrape type 2
2026-03-28 18:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a355cc45-b00a-515e-9827-996bbf42d84a, identifier: LJ34502
2026-03-28 18:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a355cc45-b00a-515e-9827-996bbf42d84a with identifier: LJ34502
2026-03-28 18:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a355cc45-b00a-515e-9827-996bbf42d84a with identifier: LJ34502
2026-03-28 18:48:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a355cc45-b00a-515e-9827-996bbf42d84a with identifier: LJ34502 to the API
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:03:14Z',
 'fuel_type': 'diesel',
 'id': 'a355cc45-b00a-515e-9827-996bbf42d84a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ34502',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 87038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2017}
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ34502%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Saving data for LJ34502: {'auction_closing_time': 1774882994.0, 'created_time': 1774521625.805204, 'last_price_update_time': 1774723731.434646}
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ34502') HTTP/1.1" 204 0
2026-03-28 18:48:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ68834%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for TJ68834: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG50641%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for NG50641: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31995%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for BA31995: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF87793%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for PF87793: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR24690%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for RR24690: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD36777%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for XD36777: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC48603%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for PC48603: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17699%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for GJ17699: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47476%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for HF47476: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48276%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for DC48276: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS20438%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for DS20438: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC34542%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for CC34542: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC61131%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for WC61131: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU40839%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for RU40839: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC10414%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for BC10414: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG96250%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for LG96250: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB27489%27 HTTP/1.1" 200 None
2026-03-28 18:48:51 [auto1.de] INFO: Scrape type for SB27489: 0
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-28 18:48:51 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-28 18:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:48:58 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 6021 | hits on page: 40
2026-03-28 18:48:58 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-28 18:48:58 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG97894%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for FG97894: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX49171%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for PX49171: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU92609%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for SU92609: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG16297%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for CG16297: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97491%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for PF97491: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY05092%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for GY05092: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74932%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for NH74932: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86018%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for PC86018: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70645%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for EE70645: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV87257%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for GV87257: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR80797%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for MR80797: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW63947%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for DW63947: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG09776%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for JG09776: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN89851%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for KN89851: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN59057%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for SN59057: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN30713%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for HN30713: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX26034%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for HX26034: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM84539%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for JM84539: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA72016%27 HTTP/1.1" 200 None
2026-03-28 18:48:59 [auto1.de] INFO: Scrape type for SA72016: 0
2026-03-28 18:48:59 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-28 18:48:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:49:01 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 6021 | hits on page: 21
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR46432%27 HTTP/1.1" 200 None
2026-03-28 18:49:01 [auto1.de] INFO: Scrape type for NR46432: 0
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD21382%27 HTTP/1.1" 200 None
2026-03-28 18:49:01 [auto1.de] INFO: Scrape type for GD21382: 0
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX76510%27 HTTP/1.1" 200 None
2026-03-28 18:49:01 [auto1.de] INFO: Scrape type for GX76510: 0
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT67052%27 HTTP/1.1" 200 None
2026-03-28 18:49:01 [auto1.de] INFO: Scrape type for DT67052: 0
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX36608%27 HTTP/1.1" 200 None
2026-03-28 18:49:01 [auto1.de] INFO: Scrape type for YX36608: 0
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR58634%27 HTTP/1.1" 200 None
2026-03-28 18:49:01 [auto1.de] INFO: Scrape type for HR58634: 0
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM22131%27 HTTP/1.1" 200 None
2026-03-28 18:49:01 [auto1.de] INFO: Scrape type for LM22131: 0
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-28 18:49:01 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE63664%27 HTTP/1.1" 200 None
2026-03-28 18:49:01 [auto1.de] INFO: Scrape type for UE63664: 0
2026-03-28 18:49:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:49:04 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 6021 | hits on page: 0
2026-03-28 18:49:06 [scrapy.extensions.logstats] INFO: Crawled 625 pages (at 32 pages/min), scraped 839 items (at 25 items/min)
2026-03-28 18:49:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 197MiB
2026-03-28 18:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV41751> (referer: https://www.auto1.com/v1/car-details-view/TV41751/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:49:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81efebda-a175-5901-a395-b302417ff5f1 with identifier: TV41751
2026-03-28 18:49:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81efebda-a175-5901-a395-b302417ff5f1 with scrape type 1
2026-03-28 18:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81efebda-a175-5901-a395-b302417ff5f1
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_65cdcba2b799441326361c914086e102.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_65cdcba2b799441326361c914086e102.jpg not downloaded yet
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_d333e23726934472d209593ae437f731.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_d333e23726934472d209593ae437f731.jpg not downloaded yet
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_16c41573f0a06c47a34b664eb80cb85a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_16c41573f0a06c47a34b664eb80cb85a.jpg not downloaded yet
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_240a098182aa3c84109e06363bb67184.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_240a098182aa3c84109e06363bb67184.jpg not downloaded yet
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_d8f6e4dac275cf0ee4a538a8dd2b2bf0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_d8f6e4dac275cf0ee4a538a8dd2b2bf0.jpg not downloaded yet
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_8e15fa15655d5e57fe0594b556d3a8ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_8e15fa15655d5e57fe0594b556d3a8ec.jpg not downloaded yet
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_89b34b05a76bbb756ec4e764bd7dd7b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_89b34b05a76bbb756ec4e764bd7dd7b3.jpg not downloaded yet
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_c5e07f47eae4e3a491dcfa303aea9cd7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_c5e07f47eae4e3a491dcfa303aea9cd7.jpg not downloaded yet
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_7d17debf53b470b13857a1dc03ad97aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_7d17debf53b470b13857a1dc03ad97aa.jpg not downloaded yet
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_899f0a3aa6dc6a03cc547aaa15e594c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_899f0a3aa6dc6a03cc547aaa15e594c2.jpg not downloaded yet
2026-03-28 18:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_d333e23726934472d209593ae437f731.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_65cdcba2b799441326361c914086e102.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_240a098182aa3c84109e06363bb67184.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:49:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245649c790>
2026-03-28 18:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_d333e23726934472d209593ae437f731.jpg') HTTP/1.1" 204 0
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_d333e23726934472d209593ae437f731.jpg saved to cache
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81efebda-a175-5901-a395-b302417ff5f1
2026-03-28 18:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_c5e07f47eae4e3a491dcfa303aea9cd7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_89b34b05a76bbb756ec4e764bd7dd7b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:49:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2454773710>
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_65cdcba2b799441326361c914086e102.jpg') HTTP/1.1" 204 0
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_65cdcba2b799441326361c914086e102.jpg saved to cache
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81efebda-a175-5901-a395-b302417ff5f1
2026-03-28 18:49:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24546df190>
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_240a098182aa3c84109e06363bb67184.jpg') HTTP/1.1" 204 0
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_240a098182aa3c84109e06363bb67184.jpg saved to cache
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81efebda-a175-5901-a395-b302417ff5f1
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245476df10>
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_c5e07f47eae4e3a491dcfa303aea9cd7.jpg') HTTP/1.1" 204 0
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_c5e07f47eae4e3a491dcfa303aea9cd7.jpg saved to cache
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81efebda-a175-5901-a395-b302417ff5f1
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2458262390>
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_89b34b05a76bbb756ec4e764bd7dd7b3.jpg') HTTP/1.1" 204 0
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_89b34b05a76bbb756ec4e764bd7dd7b3.jpg saved to cache
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81efebda-a175-5901-a395-b302417ff5f1
2026-03-28 18:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_7d17debf53b470b13857a1dc03ad97aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_16c41573f0a06c47a34b664eb80cb85a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_8e15fa15655d5e57fe0594b556d3a8ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_d8f6e4dac275cf0ee4a538a8dd2b2bf0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_899f0a3aa6dc6a03cc547aaa15e594c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:49:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2456274850>
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_7d17debf53b470b13857a1dc03ad97aa.jpg') HTTP/1.1" 204 0
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_7d17debf53b470b13857a1dc03ad97aa.jpg saved to cache
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81efebda-a175-5901-a395-b302417ff5f1
2026-03-28 18:49:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24562493d0>
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_16c41573f0a06c47a34b664eb80cb85a.jpg') HTTP/1.1" 204 0
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_16c41573f0a06c47a34b664eb80cb85a.jpg saved to cache
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81efebda-a175-5901-a395-b302417ff5f1
2026-03-28 18:49:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618c390>
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_8e15fa15655d5e57fe0594b556d3a8ec.jpg') HTTP/1.1" 204 0
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_8e15fa15655d5e57fe0594b556d3a8ec.jpg saved to cache
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81efebda-a175-5901-a395-b302417ff5f1
2026-03-28 18:49:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f245618f590>
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_d8f6e4dac275cf0ee4a538a8dd2b2bf0.jpg') HTTP/1.1" 204 0
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_d8f6e4dac275cf0ee4a538a8dd2b2bf0.jpg saved to cache
2026-03-28 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81efebda-a175-5901-a395-b302417ff5f1
2026-03-28 18:49:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f24564039d0>
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F48%252Ff2485ddd1bbd4a9aa190ce2d4b70b268%252Fpa%252FTV41751_899f0a3aa6dc6a03cc547aaa15e594c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_899f0a3aa6dc6a03cc547aaa15e594c2.jpg saved to cache
2026-03-28 18:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81efebda-a175-5901-a395-b302417ff5f1
2026-03-28 18:49:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81efebda-a175-5901-a395-b302417ff5f1, skipping ID generation
2026-03-28 18:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81efebda-a175-5901-a395-b302417ff5f1 with scrape type 1
2026-03-28 18:49:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81efebda-a175-5901-a395-b302417ff5f1 sending to next pipeline
2026-03-28 18:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81efebda-a175-5901-a395-b302417ff5f1, identifier: TV41751
2026-03-28 18:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81efebda-a175-5901-a395-b302417ff5f1 with identifier: TV41751
2026-03-28 18:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81efebda-a175-5901-a395-b302417ff5f1 with identifier: TV41751
2026-03-28 18:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81efebda-a175-5901-a395-b302417ff5f1 with identifier: TV41751 to the API
2026-03-28 18:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_899f0a3aa6dc6a03cc547aaa15e594c2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-03-30T15:56:31Z',
 'fuel_type': 'petrol',
 'id': '81efebda-a175-5901-a395-b302417ff5f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV41751',
 'listing': 'auction',
 'location': 'DE, Düren',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 4373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2394584,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_65cdcba2b799441326361c914086e102.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2326841,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_d333e23726934472d209593ae437f731.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2408063,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_16c41573f0a06c47a34b664eb80cb85a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2149928,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_240a098182aa3c84109e06363bb67184.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2284518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_d8f6e4dac275cf0ee4a538a8dd2b2bf0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2473654,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_8e15fa15655d5e57fe0594b556d3a8ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_89b34b05a76bbb756ec4e764bd7dd7b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_c5e07f47eae4e3a491dcfa303aea9cd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2391801,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_7d17debf53b470b13857a1dc03ad97aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81efebda-a175-5901-a395-b302417ff5f1/81efebda-a175-5901-a395-b302417ff5f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2546043,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/48/f2485ddd1bbd4a9aa190ce2d4b70b268/pa/TV41751_899f0a3aa6dc6a03cc547aaa15e594c2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid City Plus',
 'transmission': 'manual',
 'trim': 'City Plus',
 'year': 2023}
2026-03-28 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV41751%27 HTTP/1.1" 200 None
2026-03-28 18:49:09 [auto1.de] INFO: Saving data for TV41751: {'created_time': 1774723749.815592, 'last_price_update_time': 1774723749.815602, 'auction_closing_time': 1774886191.0}
2026-03-28 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV41751') HTTP/1.1" 204 0
2026-03-28 18:49:09 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 18:49:09 [auto1.de] INFO: auto1.de Batch config: batch 2/2
2026-03-28 18:49:09 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-28 18:49:10 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (840 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_18_2026-03-28T18_35_00.jl
2026-03-28 18:49:10 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 3208377,
 'downloader/request_count': 1872,
 'downloader/request_method_count/GET': 1718,
 'downloader/request_method_count/POST': 154,
 'downloader/response_bytes': 1472680204,
 'downloader/response_count': 1872,
 'downloader/response_status_count/200': 1872,
 'dupefilter/filtered': 2,
 'elapsed_time_seconds': 843.607093,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 18, 49, 10, 31492, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 840,
 'log_count/DEBUG': 24289,
 'log_count/INFO': 25890,
 'memusage/max': 207499264,
 'memusage/startup': 148303872,
 'photo_download_count': 1246,
 'request_depth_max': 155,
 'response_received_count': 626,
 'scheduler/dequeued': 1872,
 'scheduler/dequeued/memory': 1872,
 'scheduler/enqueued': 1872,
 'scheduler/enqueued/memory': 1872,
 'scrape_type/batch_skipped': 3024,
 'scrape_type/new': 235,
 'scrape_type/price_update': 605,
 'scrape_type/skipped': 2195,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 626,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.847420749427099,
 'scrapy-zyte-api/mean_response_seconds': 3.884119006507575,
 'scrapy-zyte-api/processed': 626,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 626,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 625,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 626,
 'scrapy-zyte-api/request_args/httpRequestBody': 154,
 'scrapy-zyte-api/request_args/httpRequestMethod': 154,
 'scrapy-zyte-api/request_args/httpResponseBody': 626,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 626,
 'scrapy-zyte-api/request_args/sessionContext': 626,
 'scrapy-zyte-api/request_args/url': 626,
 'scrapy-zyte-api/status_codes/200': 626,
 'scrapy-zyte-api/success': 626,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 6061,
 'source/total_available': 6021,
 'start_time': datetime.datetime(2026, 3, 28, 18, 35, 6, 424399, tzinfo=datetime.timezone.utc)}
2026-03-28 18:49:10 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 18:49:10 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f24582a6450>
2026-03-28 18:49:10 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f24582a6890>